# Apoc iterated MergeNodes will not merge all matching nodes **URL:** \ **Category:** Cypher\ **Tags:** apoc\ **Created:** [August 29, 2019, 1:16pm UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765 "2019-08-29T13:16:29Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![jhellquist](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/jhellquist/32/6201_2.png) [@jhellquist](https://community.neo4j.com/u/jhellquist)\ **Post date:** [August 29, 2019, 1:16pm UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/1 "2019-08-29T13:16:29Z")
I am trying to merge duplicate nodes using a combination of apoc.periodic.iterate and apoc.refactor.mergeNodes but get a strange result. The code runs and seems to do the job with the clusters touched upon, but when finished there are still some clusters of duplicates left. When I run the code again some more duplicates are merged correctly but it does not go over the whole database. The principle is as follows: A central parent node (p) can have several child nodes (c) that sometimes are duplicates and should be merged. As merging criteria I am using a combination of 1. link to the same parent node (p) with a unique number (p.number) 2. identical property values on the linked child nodes (c.idstring) Neo4j 3.5.4 Enterprise edition Apoc 3.5.0.3 Code: ` CALL apoc.periodic.iterate( "Match (p:Parent) RETURN p",` "WITH p MATCH (p:Parent)-(r:HAS\_LINK)-(c:Child) WITH c.idstring AS idstring, p.number AS number, COLLECT p AS nodes CALL apoc.refactor.mergeNodes (nodes, {properties: 'discard', mergeRels: true}) YIELD node RETURN node", {batchsize: 1000, parallel: true}) ; ---
**Author:** ![michael.hunger](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/michael.hunger/32/27377_2.png) [@michael.hunger](https://community.neo4j.com/u/michael.hunger)\ **Post date:** [August 30, 2019, 10:07am UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/2 "2019-08-30T10:07:04Z")
Your statement cannot work, please try each query with explain e.g. `collect(p) as nodes` or the relationship-syntax `-[r:HAS_CHILD]->` I wouldn't do that in parallel because they can step on each other. Also you must make sure that the batch size doesn't split across parents that share a child. probably better to do the match in the driving query and pass the parent collection to the executing query something like: ```auto CALL apoc.periodic.iterate( "MATCH (p:Parent)-[:HAS_LINK]->(c:Child) WITH c.idstring AS idstring, p.number AS number, collect(p) AS nodes RETURN nodes", "CALL apoc.refactor.mergeNodes (nodes, {properties: 'discard', mergeRels: true}) YIELD node RETURN count(*)", {batchsize: 1000, parallel: true}) ; ``` ---
**Author:** ![jhellquist](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/jhellquist/32/6201_2.png) [@jhellquist](https://community.neo4j.com/u/jhellquist)\ **Post date:** [August 30, 2019, 11:10am UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/3 "2019-08-30T11:10:04Z")
The code I have been using works fine and does the job, but not all parent-child clusters are processed. They won't step on each other since no child has more than one parent. Since the batch focusses on the parents only, I thought that all clusters in the database would be handled, 1000 clusters in every iteration. Or will the batch size include both parents and children, thus leaving some duplicate children unmerged..? ---
**Author:** ![michael.hunger](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/michael.hunger/32/27377_2.png) [@michael.hunger](https://community.neo4j.com/u/michael.hunger)\ **Post date:** [August 31, 2019, 12:37am UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/4 "2019-08-31T00:37:27Z")
I just thought because you aggregate both on parent _and_ child information, if there is p.number shared between parents then you'd get the effect I mentioned. ---
**Author:** ![jhellquist](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/jhellquist/32/6201_2.png) [@jhellquist](https://community.neo4j.com/u/jhellquist)\ **Post date:** [August 31, 2019, 9:15am UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/5 "2019-08-31T09:15:40Z")
Ok, thanks. Any ideas about the batch content; will it only include parents or a mix of parents and linked child nodes? ---
**Author:** ![michael.hunger](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/michael.hunger/32/27377_2.png) [@michael.hunger](https://community.neo4j.com/u/michael.hunger)\ **Post date:** [August 31, 2019, 10:25am UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/6 "2019-08-31T10:25:54Z")
If your tree is clearly separated and no repeating parent.number then your query should have isolated baches of parents, which then are aggregated in your query and merged. Perhaps you can try to reproduce with one of the missing merged nodes in a non-periodic-iterate example? ---
**Author:** ![jhellquist](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/jhellquist/32/6201_2.png) [@jhellquist](https://community.neo4j.com/u/jhellquist)\ **Post date:** [September 4, 2019, 7:25am UTC](https://community.neo4j.com/t/apoc-iterated-mergenodes-will-not-merge-all-matching-nodes/9765/7 "2019-09-04T07:25:32Z")
I have repeated the mergenodes code without iteration on some remaining clusters, and then they are merged as they should... This is a mystery to me.