- I have a neo4j database that updates in real time. I'm running a bunch of GDS algorithms like wcc, similarity and centrality measures to assign scores at a node level (these calculated scores are stored as properties at node level).
- I have a batch that runs every hour to calculate these values.
- Every time the batch job is run, cypher projections for the whole database are created and scores are recalculated for the whole database and assigned to their respective nodes.
- What is the best way to calculate these scores only for the newly added nodes to the database and not the whole database?
- Currently, I'm creating partial projections of the newly added nodes and running batch job on those projections but is there a better way to do this? (possibly a config that would enable me to calculate these scores only on the newly added data)