cancel
Showing results for 
Search instead for 
Did you mean: 

I have some questions about importing data

namestudent
Node Clone

I am a neo4j beginner. I have some questions about importing data.

When we import billions of data, how to use java to import, what better information? What better way? Must they all be converted to CSV format? If converted to csv, is it necessary to pre-organize and modify it according to the specified format?

Thank you

4 REPLIES 4

12kunal34
Graph Fellow

First you should make sure that what would be your data model according to that you would frame queries for data import.
You should mention that what would be your data source and yes you have to make sure that your system must have the configuration to handle billions of records .

david_allen
Neo4j
Neo4j

There are lots of different ways of importing data into Neo4j.

Probably the most common route is to use CSV, so here's a page giving you full details on that:

Broadly, you can either use the LOAD CSV method or you can use the neo4j-import tool. If you only have a little data, LOAD CSV is easier. If you have lots and lots of data and high speed import is your highest priority, then you want neo4j-import.

ok!!I'll give it a try.

thank you.

benjamin_squire
Graph Voyager

Fastest way is using neo4j-admin import , this requires formatting all csvs. For billions of nodes its best to use descending ordering if at all possible. See here: https://neo4j.com/docs/operations-manual/current/tools/import/

You can import data in parallel and for approximately 1.8 TB of data I got around 4 hours on a 32 CPU machine with 244 GB ram. You will need a lot of RAM for the import for sure.

Nodes 2022
Nodes
NODES 2022, Neo4j Online Education Summit

On November 16 and 17 for 24 hours across all timezones, you’ll learn about best practices for beginners and experts alike.