Hi, I am using neo4j ETL Tool for a while now and it was working fine with no errors and I was able to import data from PostgresSQL and save it into a graph database.
I didn't do any changes but now when I try to import data from PostgresSQL I get the error "Save mapping failed".
Thank you for help
@khalilamal114 - I have the same problem. It started after the latest update, Neo4j 3.5.11 released 2019-09-23, was downloaded and installed. Perhaps it might help if you indicated OS and versions of the tools for someone to suggest a fix.
Environment
OS: Windows 10 Home version 17134.1006
Neo4j version 3.5.6
Neo4j ETL Tool version 1.4.1
The log files on my machine do indicate a problem, here are the last few lines:
2019-09-26 15:53:13.737+0000 INFO [o.n.b.BoltServer] Bolt server loaded
2019-09-26 15:53:14.122+0000 INFO [o.n.b.BoltServer] Bolt enabled on 127.0.0.1:7687.
2019-09-26 15:53:16.000+0000 WARN [o.n.m.s.s.ServerMetrics] Server thread metrics not available (missing neo4j.server.threads.jetty.all)
2019-09-26 15:53:16.002+0000 WARN [o.n.m.s.s.ServerMetrics] Server thread metrics not available (missing neo4j.server.threads.jetty.idle)
2019-09-26 15:53:16.578+0000 INFO [o.n.i.d.DiagnosticsManager] --- SERVER STARTED START ---
2019-09-26 15:53:17.024+0000 INFO [o.n.m.s.s.ServerMetrics] Server thread metrics have been registered successfully
2019-09-26 15:53:18.012+0000 INFO [o.n.i.d.DiagnosticsManager] --- SERVER STARTED END ---
2019-09-26 16:55:54.438+0000 WARN [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=222, gcTime=0, gcCount=0}
2019-09-26 16:55:54.672+0000 WARN [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=379, gcTime=0, gcCount=0}
2019-09-26 17:21:06.581+0000 WARN [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=445979, gcTime=0, gcCount=0}
Detected VM stop-the-world pause... Basically some type of error, "scream and die".
I have uninstalled and reinstalled Neo4j, but still the same problem.
It would greatly appreciated if someone could suggest a fix. Thanks in advance for your help.
1 Like
Is that with a local or a remote database?
And what version of Neo4j Desktop are you running?
Yes, it started after the last update,
I am using Neo4j Desktop version 1.2.1 and working on a local database.
Thanks a lot, we'll look into it.
Can you try to close the etl tool and try again?
It worked for me on the 2nd attempt with a local db. Still trying to figure out the root cause.
I tried to close the ETL Tool and try again but I still have the same error.
@michael.hunger local db, desktop version 1.2.1. I have closed the ETL tool and tried again. Also uninstalled and reinstalled the app. Each time with the same result. Would log files help? Thanks for looking into this.
Yes log files would help.
Desktop has log files FAQ · neo4j-devtools/neo4j-desktop Wiki · GitHub
And you can enable developer mode for the desktop (at the bottom in settings)
And reload the etl tool then you have a button for the console.
What is the best way to upload a log file? Using the Upload button, log files are not available. Cutting and pasting the contents and yes of course too large. I will give you the log file but need a way to communicate the contents. What do you suggest?
@keith1 If you have a Github account you can add it here:
https://gist.github.com/
Gist URL: Neo4j ETL stopped working · GitHub
@michael.hunger any word on resolution of this problem? I have posted the log file contents here: Neo4j ETL stopped working · GitHub
Is there anything else needed to help solve the problem? Thanks.
Hi @keith1,
can you try with this?
In order to install it provide the path where you downloaded with the file:// prefix
Thanks a lot
Hi @conker84, thank you, I tried the ETL 1.4.0 and I was able to save the mapping but I've had an error in the importing of data.
I need some help, I am using neo4j ETL for my master thesis tests and now I can't finish them because it stopped saving the mapping.
Thank you for helping.
@khalilamal114 can you share the full log?
Another question which import mode are you using?
Online Import BATCHOnline Import LOAD CSV
This is the logs
COMMAND: java -cp "C:\Users\Mon pc\Desktop\Mémoire\Data\graphApps\_global\neo4j-etl-ui-1-4-0-release/dist/neo4j-etl.jar" org.neo4j.etl.NeoIntegrationCli export --mapping-file "C:\Users\MONPC~1\AppData\Local\Temp/postgresql_pilgrim_d1_n3_prm6_500_mapping.json" --rdbms:password "root" --rdbms:user "postgres" --rdbms:url "jdbc:postgresql://localhost:5432/pilgrim?ssl=false" --csv-directory "C:\Users\MONPC~1\AppData\Local\Temp" --options-file "C:\Users\MONPC~1\AppData\Local\Temp/import-tool-options.json" --using "cypher:batch" --unwindBatchSize 1000 --txBatchSize 10000 --neo4j:url "bolt://localhost:7687" --neo4j:user "neo4j" --neo4j:password "neo1234"
Cannot write file
- Skipping reading import options from file because file [C:\Users\MONPC~1\AppData\Local\Temp\import-tool-options.json] doesn't exist.
- Reading metadata mapping from file: C:\Users\MONPC~1\AppData\Local\Temp/postgresql_pilgrim_d1_n3_prm6_500_mapping.json
- Direct driver instance 150268540 created for server address localhost:7687
- Running ETL on Neo4j 3.5.9 - ENTERPRISE
- Exporting from RDBMS to CSV...
- CSV directory: C:\Users\MONPC~1\AppData\Local\Temp\csv-026
- Writing CSV headers for node NODE_d1n3prm6500.entity1_a54c15be-ab3e-43f6-8466-7c6dacaef72b
- Writing CSV headers for node NODE_d1n3prm6500.entity0_4f52e55c-011f-4696-8679-616d1d3a6670
- Writing CSV headers for node NODE_d1n3prm6500.entity2_c8cdc01d-279d-4b59-9551-8c4c46e92afc
- Writing CSV headers for relationship REL_RELATION0_863c297b-2aeb-4d79-a05f-eb0a234d3cd7
- Writing CSV headers for relationship REL_RELATION1_157be21a-5206-44c5-a1c3-363c7e48d19c
Export time: 0.266 (s)
- Creating Neo4j store from CSV...
- Direct driver instance 2125238280 created for server address localhost:7687
- Start Importing CSV nodes...
- Creating constraints on nodes...
- Created constraints
- Creating nodes...
- Creating node with label Entity1
- Creating node with label Entity0
- Creating node with label Entity2
- Start Importing CSV relationships...
- Creating relationships of type RELATION_0
- Creating relationships of type RELATION_1
- Data imported with errors. Below the list of errors:
- Errors type org.neo4j.driver.v1.exceptions.ClientException: Cannot merge node using null property value for entity2id
-
Unable to execute statement: Cannot merge node using null property value for entity2id
- Errors type org.neo4j.driver.v1.exceptions.ClientException: Cannot merge node using null property value for entity1id
-
Unable to execute statement: Cannot merge node using null property value for entity1id
- Errors type org.neo4j.driver.v1.exceptions.ClientException: Cannot merge node using null property value for entity0id
-
Unable to execute statement: Cannot merge node using null property value for entity0id
- Closing driver instance 2125238280
- Closing connection pool towards localhost:7687
- C:\Users\MONPC~1\AppData\Local\Temp\csv-026
It says that Cannot merge node using null property value for entity0id but in the relational database the property value is not null so it creates only the labels in the graph database.
I am using Online Import BATCH
Thank you
This is odd, it's a huge db? Is it possible to have it?
Thanks a lot