Memory Config for large import


(Ishaan Madan) #1

I am trying to import 75GB worth of CSV's using the neo4j-admin import tool. My initial settings were as follows (memory.pagecache.size was left at default):

dbms.memory.heap.max_size=10g

When I ran the import, the following occurred (see screenshot) and the job killed itself. I am confused about a few things:

  1. Why does it think my is Configured max memory: 44.10 GB ?
  2. Why does it think my heap size 14.00 GB? I explicitly set it to 10GB.
  3. Does the Estimated disk space usage: 155.98 GB mean that once the graph is imported, it will take up 156 GB on my machine?
  4. What should I set my heap size and PageCacheSize to for this import to not be killed? Are there other configs required for this to run properly?


(Ishaan Madan) #2

Hey @michael.hunger would appreciate if you could have a look at this.