Import maxing out memory, but not using CPU

import

(Davemate23) #1

Hi,

I'm currently in the process of using neo4j-admin import for a dataset of ~8M nodes, 80M node properties, 700M relationships and 3.18G relationship properties - equating to ~87GB.

I tried with a sample set yesterday and it worked fine, but this was with neo4j-import as I had issues with missing nodes and couldn't seem to work the ignore-missing-nodes function.

With this (significantly larger dataset) it got through the first set of nodes and the relationships but after getting to 100% on the relationships it is just hanging. My memory is maxed out (at 8GB, not using the heaped memory from swap) but my CPUs are all at around 2%. Is this normal, or should I just crash out and start again?

Any help is appreciated.

Dave