We are using neo4j enterprise v5.25.1 installed using helm charts provided (following instructions provided @ Kubernetes - Operations Manual)
We are trying to setup a backup mechanism using helm charts as described in Back up, aggregate, and restore (online) - Operations Manual. The backup job fails with a java exception (error logs below).
Does anyone know what might be causing this issue ?
2024-11-23 18:50:25.609+0000 INFO [c.n.b.v.b.BackupOutputMonitor] Falling back to full backup of database 'system'.
2024-11-23 18:50:25.609+0000 INFO [c.n.b.v.b.BackupOutputMonitor] Start full backup of database 'system'.
2024-11-23 18:50:25.629+0000 INFO [c.n.c.c.s.StoreCopyClient] Requesting store listing from: neo4j-ent-admin.uat.svc.cluster.local:6362
2024-11-23 18:50:25.700+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.counts.db from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.711+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.relationshipgroupstore.degrees.db from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.712+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.nodestore.db.labels.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.713+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.relationshipgroupstore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.718+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.relationshipstore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.719+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.propertystore.db.index.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.719+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.relationshiptypestore.db.names.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.720+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.propertystore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.721+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.propertystore.db.index.keys.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.722+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.propertystore.db.arrays.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.722+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.schemastore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.723+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.propertystore.db.strings.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.724+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.relationshiptypestore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.724+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.labeltokenstore.db.names.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.725+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.labeltokenstore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.726+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.nodestore.db.id from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.727+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: neostore.indexstats.db from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.729+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/token-lookup-1.0/1/index-1 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.731+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/token-lookup-1.0/2/index-2 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.732+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/3/index-3 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.733+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/4/index-4 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.733+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/5/index-5 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.734+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/6/index-6 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.735+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/7/index-7 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.736+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/8/index-8 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.736+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/15/index-15 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.738+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/16/index-16 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.739+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/17/index-17 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.739+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: schema/index/range-1.0/21/index-21 from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.741+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.nodestore.db.labels.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.741+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.742+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.schemastore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.743+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshipgroupstore.degrees.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.743+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.index.keys.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.744+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.index.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.744+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.strings.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.745+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshiptypestore.db.names.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.745+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.labeltokenstore.db.names.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.745+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.labeltokenstore.db.names.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.746+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.arrays.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.746+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshiptypestore.db.names.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.747+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.labeltokenstore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.748+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshiptypestore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.748+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.labeltokenstore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.749+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.strings.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.749+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.nodestore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.750+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.indexstats.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.750+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.schemastore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.750+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.index.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.751+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.751+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.nodestore.db.labels.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.752+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/8/index-8.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.753+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/21/index-21.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.753+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/5/index-5.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.754+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/4/index-4.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.754+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/17/index-17.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.754+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/7/index-7.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.755+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/6/index-6.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.755+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/15/index-15.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.756+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/3/index-3.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.757+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/range-1.0/16/index-16.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.758+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/token-lookup-1.0/2/index-2.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.758+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/schema/index/token-lookup-1.0/1/index-1.12404.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.759+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.arrays.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.759+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.760+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.nodestore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.760+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.counts.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.760+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshiptypestore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.761+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshipstore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.761+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.propertystore.db.index.keys.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.762+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshipstore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.762+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshipgroupstore.db.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.762+0000 INFO [c.n.c.c.p.ClientInstallerV2] Receiving file: profiles/neostore.relationshipgroupstore.db.id.12405.cacheprof from: neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362
2024-11-23 18:50:25.769+0000 ERROR [c.n.c.p.i.ClientChannelInitializer] Exception in inbound for channel: [id: 0x396775dc, L:/10.178.0.222:35290 - R:neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362]
io.netty.handler.codec.DecoderException: java.lang.IllegalArgumentException: No matching KernelVersion for version 20
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:499) ~[netty-codec-4.1.93.Final.jar:4.1.93.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:290) ~[netty-codec-4.1.93.Final.jar:4.1.93.Final]
at com.neo4j.causalclustering.net.app.common.RequestDecoderDispatcher.channelRead(RequestDecoderDispatcher.java:39) ~[neo4j-cluster-common-5.10.0.jar:5.10.0]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at com.neo4j.causalclustering.net.app.common.MessageTypeHandler.channelRead(MessageTypeHandler.java:39) [neo4j-cluster-common-5.10.0.jar:5.10.0]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) [netty-codec-4.1.93.Final.jar:4.1.93.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) [netty-codec-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at com.neo4j.causalclustering.protocol.NettyPipelineBuilder$ErrorHandlerHead.channelRead(NettyPipelineBuilder.java:290) [neo4j-cluster-common-5.10.0.jar:5.10.0]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:800) [netty-transport-classes-epoll-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) [netty-transport-classes-epoll-4.1.93.Final.jar:4.1.93.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) [netty-transport-classes-epoll-4.1.93.Final.jar:4.1.93.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.93.Final.jar:4.1.93.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.93.Final.jar:4.1.93.Final]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: java.lang.IllegalArgumentException: No matching KernelVersion for version 20
at org.neo4j.kernel.KernelVersion.getForVersion(KernelVersion.java:131) ~[neo4j-kernel-api-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.catchup.protocol.messages.get_prepare_store_copy.PrepareStoreCopyResponse$TransactionIdMarshal$2.unmarshal(PrepareStoreCopyResponse.java:195) ~[neo4j-protocol-catchup-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.catchup.protocol.messages.get_prepare_store_copy.PrepareStoreCopyResponse$TransactionIdMarshal$2.unmarshal(PrepareStoreCopyResponse.java:173) ~[neo4j-protocol-catchup-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.catchup.protocol.messages.get_prepare_store_copy.PrepareStoreCopyResponse$StoreListingMarshal.unmarshal0(PrepareStoreCopyResponse.java:117) ~[neo4j-protocol-catchup-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.catchup.protocol.messages.get_prepare_store_copy.PrepareStoreCopyResponse$StoreListingMarshal.unmarshal0(PrepareStoreCopyResponse.java:94) ~[neo4j-protocol-catchup-5.10.0.jar:5.10.0]
at org.neo4j.io.marshal.SafeChannelMarshal.unmarshal(SafeChannelMarshal.java:36) ~[neo4j-io-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.catchup.protocol.messages.get_prepare_store_copy.PrepareStoreCopyResponse$Decoder.decode(PrepareStoreCopyResponse.java:255) ~[neo4j-protocol-catchup-5.10.0.jar:5.10.0]
at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:529) ~[netty-codec-4.1.93.Final.jar:4.1.93.Final]
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:468) ~[netty-codec-4.1.93.Final.jar:4.1.93.Final]
... 32 more
2024-11-23 18:50:25.778+0000 INFO [c.n.c.p.h.HandshakeClientInitializer] Lost connection to neo4j-ent-admin.uat.svc.cluster.local/34.118.232.182:6362 [Catchup version:2.0]
2024-11-23 18:50:25.778+0000 DEBUG [c.n.c.c.s.StoreCopyClient] PrepareStoreCopyRequest to [neo4j-ent-admin.uat.svc.cluster.local:6362] failed with exception java.nio.channels.ClosedChannelException
2024-11-23 18:50:25.793+0000 ERROR [c.n.b.v.b.OnlineBackupExecutor] Error performing backup for database system
com.neo4j.backuprestore.v2.backup.BackupExecutionException: Backup of database system failed.
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.backup(DefaultOnlineDatabaseBackupAction.java:84) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.OnlineBackupExecutor.tryBackup(OnlineBackupExecutor.java:148) [neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.OnlineBackupExecutor.executeBackups(OnlineBackupExecutor.java:104) [neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.OnlineBackupCommand.executeBackups(OnlineBackupCommand.java:309) [neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.OnlineBackupCommand.execute(OnlineBackupCommand.java:216) [neo4j-backup-5.10.0.jar:5.10.0]
at org.neo4j.cli.AbstractCommand.call(AbstractCommand.java:92) [neo4j-command-line-5.10.0.jar:5.10.0]
at org.neo4j.cli.AbstractCommand.call(AbstractCommand.java:37) [neo4j-command-line-5.10.0.jar:5.10.0]
at picocli.CommandLine.executeUserObject(CommandLine.java:2041) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine.access$1500(CommandLine.java:148) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine$RunLast.handle(CommandLine.java:2453) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine$RunLast.handle(CommandLine.java:2415) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine$RunLast.execute(CommandLine.java:2417) [picocli-4.7.3.jar:4.7.3]
at picocli.CommandLine.execute(CommandLine.java:2170) [picocli-4.7.3.jar:4.7.3]
at org.neo4j.cli.AdminTool.execute(AdminTool.java:94) [neo4j-command-line-5.10.0.jar:5.10.0]
at org.neo4j.cli.AdminTool.main(AdminTool.java:82) [neo4j-command-line-5.10.0.jar:5.10.0]
Caused by: com.neo4j.causalclustering.catchup.store_copy.StoreCopyFailedException: java.util.concurrent.ExecutionException: java.nio.channels.ClosedChannelException
at com.neo4j.causalclustering.store.StoreFilesDownloader.prepareStoreCopy(StoreFilesDownloader.java:110) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.StoreFilesDownloader.downloadStoreFiles(StoreFilesDownloader.java:66) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.RemoteStore.copy(RemoteStore.java:238) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.RemoteStore.copy(RemoteStore.java:212) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.remote.BackupClient.fullStoreCopy(BackupClient.java:299) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.fullBackup(DefaultOnlineDatabaseBackupAction.java:158) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.performBackup(DefaultOnlineDatabaseBackupAction.java:143) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.backup(DefaultOnlineDatabaseBackupAction.java:70) ~[neo4j-backup-5.10.0.jar:5.10.0]
... 16 more
Caused by: java.util.concurrent.ExecutionException: java.nio.channels.ClosedChannelException
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
at com.neo4j.causalclustering.catchup.store_copy.StoreCopyClient.prepareStoreCopy(StoreCopyClient.java:51) ~[neo4j-protocol-catchup-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.StoreFilesDownloader.prepareStoreCopy(StoreFilesDownloader.java:108) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.StoreFilesDownloader.downloadStoreFiles(StoreFilesDownloader.java:66) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.RemoteStore.copy(RemoteStore.java:238) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.causalclustering.store.RemoteStore.copy(RemoteStore.java:212) ~[neo4j-store-management-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.remote.BackupClient.fullStoreCopy(BackupClient.java:299) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.fullBackup(DefaultOnlineDatabaseBackupAction.java:158) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.performBackup(DefaultOnlineDatabaseBackupAction.java:143) ~[neo4j-backup-5.10.0.jar:5.10.0]
at com.neo4j.backuprestore.v2.backup.DefaultOnlineDatabaseBackupAction.backup(DefaultOnlineDatabaseBackupAction.java:70) ~[neo4j-backup-5.10.0.jar:5.10.0]
2024-11-23 18:50:25.796+0000 WARN [c.n.b.v.b.BackupOutputMonitor] Backup of database 'system' failed, took 450ms.