Out of the box, it allows 7474, 7687(bolt), SSH: 22000, 22001, and 22002. It also provisions LB and that will have URL, you need to access that URL:7474.
Check the network interface if these ports rules are available in inbound rule. Also try checking if neo4j instances are up and running fine using ssh.
It is not necessary. ssh is only required if you want to login into VM for any issues, like fetching logs, dump, load or neo4j instance has failed to start with any other reason.