cancel
Showing results for 
Search instead for 
Did you mean: 

Problem with Export cvs in S3 (apoc.export.csv.query)

Hello,
I'm trying to export to Amazon S3 as indicated in the documentation as follows:

CALL apoc.export.csv.query(
"MATCH (a:Person) RETURN a.name",
"s3://s3.eu-west-1.amazonaws.com/<BUCKET_NAME>/example.csv?accessKey=<MY_ACCESS_KEY>&secretKey=<MY_SECRET_KEY>",
{}
)

I always get a error:

Neo.ClientError.Procedure.ProcedureCallFailed
Failed to invoke procedure apoc.export.csv.query:
Caused by: java.io.FileNotFoundException: s3:/s3-eu-west-1.amazonaws.com/<BUCKET_NAME>/example.csv?accessKey=<MY_ACCESS_KEY>&secretKey=<MY_SECRET_KEY> (No such file or directory)

I get the same error both by running the export command from the Neo4j Web Browser client, and by running a post directly on the endpoint http://ipserver:7474/db/data/transaction/commit

The configurations are:

  • neo4j version: "Neo4j Kernel 3.2.6 enterprise",
  • browser version: 3.0.10
  • plugins:
    apoc-3.2.3.6-all.jar
    aws-java-sdk-core-1.11.250.jar
    aws-java-sdk-s3-1.11.250.jar
    httpclient-4.5.4.jar
    httpcore-4.4.8.jar
    joda-time-2.9.9.jar

In neo4j.conf there are these entries:
dbms.active_database=graph
dbms.directories.plugins=plugins
unsupported.dbms.executiontime_limit.enabled=false
dbms.allow_format_migration=true
dbms.memory.heap.initial_size=8g
dbms.memory.heap.max_size=8g
dbms.memory.pagecache.size=5g
dbms.connector.bolt.enabled=true
dbms.connector.bolt.tls_level=DISABLED
dbms.connector.bolt.listen_address=0.0.0.0:7687
dbms.connector.http.enabled=true
dbms.connector.http.listen_address=0.0.0.0:7474
dbms.connector.https.enabled=true
dbms.directories.certificates and associated files
dbms.logs.debug.rotation.size=1m
dbms.logs.query.enabled=false
dbms.logs.query.threshold=200s
dbms.logs.query.rotation.size=1m
dbms.logs.security.rotation.delay=300s
ha.pull_interval=10
ha.heartbeat_timeout=40s
dbms.tx_log.rotation.retention_policy=false
dbms.shell.enabled=true
dbms.jvm.additional=-XX:+UseG1GC
dbms.jvm.additional=-XX:-OmitStackTraceInFastThrow
dbms.jvm.additional=-XX:+AlwaysPreTouch
dbms.jvm.additional=-XX:+UnlockExperimentalVMOptions
dbms.jvm.additional=-XX:+TrustFinalNonStaticFields
dbms.jvm.additional=-XX:+DisableExplicitGC
dbms.jvm.additional=-Djdk.tls.ephemeralDHKeySize=2048
dbms.windows_service_name=neo4j
dbms.jvm.additional=-Dunsupported.dbms.udc.source=tarball
dbms.security.procedures.unrestricted=apoc.,algo.
dbms.security.procedures.whitelist=apoc.,algo.
dbms.security.allow_csv_import_from_file_urls=true
apoc.import.file.use_neo4j_config=false
apoc.import.file.enabled=true
apoc.export.file.enabled=true

Can you tell me what the problem could be?

Thank you
Antonio Bruno

4 REPLIES 4

Can you share your debug.log I would like to see if the URL handler for s3 files was installed correctly.

Hello,
there he is

debug-log.txt (95.3 KB)

thank you
Antonio Bruno

Actually in the log there are WARNs for some classes that are not loaded but I don't understand why?

...
2021-04-29 20:33:45.669+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClient from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.676+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClientBuilder from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.678+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClientParamsWrapper from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.679+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClientParams from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.789+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.internal.crypto.ContentCryptoMaterial from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar: com/amazonaws/services/kms/AWSKMS
...

mike_r_black
Ninja
Ninja

Did you ever solve what the issue was, I'm experiencing the same thing and I'm configured just as you did.

Nodes 2022
Nodes
NODES 2022, Neo4j Online Education Summit

On November 16 and 17 for 24 hours across all timezones, you’ll learn about best practices for beginners and experts alike.