The Text2Cypher task aims to translate natural language questions into Cypher queries. In late 2024, we shared our Neo4j Text2Cypher (2024) Dataset and took a deep dive into how baseline and fine-tuned models performed. We wanted to further understand where these models struggle the most and how we can make the dataset even better.
We analyzed the evaluation results from various angles to better understand how our models are performing:
First, we looked at the overall performance — analyzin...
Read it: Neo4j Text2Cypher: Analyzing Model Struggles and Dataset Improvements