Which version of Neo 4J driver to install for Neo4j versions 4.0 and 4.1

No it would be when you create the driver instance.