Connection issue while data importing


(Kunal Goyal) #1

Hello ,

i am facing a strange problem with neo4j.
i am running some jar that is importing the data in neo4j . i am running this jar using crontab.
i have established the connection using this jar and inserting the data in neo4j. but after some 1 miilion records ,it is reconnecting and and asking for username password , when i give username password then giving below error ServiceUnavailable: Failed to establish connection in 5000ms and my jar has been stopped . then i have to restart neo4j and have to run jar again
this is happening again and again.
Logs:
m giving 1024m as heap size

Exception in thread "neo4j.Scheduler-1" java.lang.OutOfMemoryError: Java heap space
 at org.neo4j.kernel.impl.scheduler.ThreadPool.submit(ThreadPool.java:53)
 at org.neo4j.kernel.impl.scheduler.ThreadPoolManager.submit(ThreadPoolManager.java:48)
 at org.neo4j.kernel.impl.scheduler.ScheduledJobHandle.submitIfRunnable(ScheduledJobHandle.java:106)
 at org.neo4j.kernel.impl.scheduler.TimeBasedTaskScheduler.scheduleDueTasks(TimeBasedTaskScheduler.java:98)
 at org.neo4j.kernel.impl.scheduler.TimeBasedTaskScheduler.tick(TimeBasedTaskScheduler.java:83)
 at org.neo4j.kernel.impl.scheduler.TimeBasedTaskScheduler.run(TimeBasedTaskScheduler.java:71)
at java.lang.Thread.run(Thread.java:748)

what is problem here .?? is neo4j can not handle this much huge data ??

after increasing the heap size to 3 gb and pagecache size 1600 mb then i start monitor system.
connection failure happening when we have below data

Store Sizes
Count Store	3.50 KiB
Label Store	16.02 KiB
Index Store	26.91 MiB
Schema Store	8.01 KiB
Array Store	8.01 KiB
Logical Log	217.65 MiB
Node Store	6.09 MiB
Property Store	172.53 MiB
Relationship Store	28.93 MiB
String Store	2.62 MiB
Total Store Size	704.80 MiB

Page Cache
Faults	30378
Evictions	0
File Mappings	100
Bytes Read	247965093
Flushes	29
Eviction Exceptions	0
File Unmappings	55
Bytes Written	237568
Hit Ratio	97.22%
Usage Ratio	9.16%


Transactions
Last Tx Id	972227
Current	1
Peak	3
Opened	1221
Committed	1118