cancel
Showing results for 
Search instead for 
Did you mean: 

Memory Config for large import

ishaan_madan
Node Link

I am trying to import 75GB worth of CSV's using the neo4j-admin import tool. My initial settings were as follows (memory.pagecache.size was left at default):

dbms.memory.heap.max_size=10g

When I ran the import, the following occurred (see screenshot) and the job killed itself. I am confused about a few things:

  1. Why does it think my is Configured max memory: 44.10 GB ?
  2. Why does it think my heap size 14.00 GB? I explicitly set it to 10GB.
  3. Does the Estimated disk space usage: 155.98 GB mean that once the graph is imported, it will take up 156 GB on my machine?
  4. What should I set my heap size and PageCacheSize to for this import to not be killed? Are there other configs required for this to run properly?

2X_1_18923c3304d0a4be488fac6a32bc808190d82f82.png

1 REPLY 1

ishaan_madan
Node Link

Hey @michael.hunger would appreciate if you could have a look at this.