Migrate incremental data from RDBMS to neo4j

Neo4j Graph Platform Import / Export
1

Hello Guys,

I have a doubt regarding RDBMS to neo4j migration.
i have data in rdbms and it is continous increasing and i want to shift this data into neo4j .

how i can do this type of stuff and i have millions of rows in rdbms table so what should be the major factor while migrating that would help in performance,

2

How best to do this depends on a lot of factors including what other systems you have in place, how much data, how frequently it gets updated, and so on.

A common approach to suggest as a starting point:

  • Dump your existing relational DB as CSV and then use neo4j-import or LOAD CSV to do an "initial load" that gets most of it in.
  • Set up change data capture (CDC) from your relational database, for example to publish all changes to Kafka, and then use the neo4j-streams plugin to subscribe to those changes going through kafka. This handles the "ongoing" part of the change.

What you end up with is a Neo4j instance that is a follow-along copy of what's happening in the RDBMS.

3

Here's an example blog post describing that second point:

http://www.intelliwareness.org/2019/07/neo4j-kafka-mysql-configuration-part-1/?mkt_tok=eyJpIjoiWVRjNE9XTTBOR1l3TnpZeiIsInQiOiJmRUFPaTJFTW5qY3JGV2R1dmRXcmNJSEk3djFTRmZZcVdsNXIrQzhvZlBmK0d6bHNzdE5LbnM3YlFVWnlESTJqU0grSTdsSVpFRlJ5SkVZRDJcL04zbmdiWHhVamtHUlpaVXlhNjFSalo5cER5MVJHT0tHWmRQbjVnQitrelV3UkYifQ%3D%3D