Hi @rileyjenk,
Welcome to Neo4j Community!!
You do not need to use All (). When you wrote all(rel in relationships(path).... You are instructing that relationship(path) is an list, although it is not .
If you have stored rel.Visit_Arrive_Time as DateTime then try below:
MATCH (e)-[r:VISITED]->(b)
where datetime("2020-06-10T18:05:34Z")> r.Visit_Arrive_Time>datetime("2020-04-10T18:05:34Z")
return e,b
Also visit below if this is the case