Faster Data Imports With Concurrent Transactional Subqueries

Welcome to NODES 2024

Welcome to NODES 2024, the biggest graph community gathering dedicated to graph-powered apps and contextual AI with the latest GenAI innovations!

Join us on November 7, 2024, for a 24-hour free online conference accessible across all time zones and locations, catering to all levels of expertise.

Session Track:

Session Time: 03:30 pm - 03:45 pm November 7

Session description

When performing large write operations like batch updates, imports, and deletes, it is beneficial to execute subqueries in separate inner transactions. Cypher’s CALL { ... } IN TRANSACTIONS allows this, but each batch runs sequentially on a single thread, unnecessarily slowing down data imports. With Neo4j 5.21, the new `CALL { ... } IN CONCURRENT TRANSACTIONS` construct enables each batch to run on a separate thread, which can dramatically improve data loading performance.

Speaker

Robert Steward

Software Engineer, Neo4j

Robert is a Senior Software Engineer at Neo4j, specializing in Scala and Java development on the Runtime team. In the past 15 years he has had the privilege of working across diverse industries, leveraging an alphabet soup of languages and frameworks to tackle challenges related to scale, integration, and interface design. He thrives on the spark that is generated through collaborative problem solving with fellow engineers, which is possibly the only remaining difference between him and our new LLM based programming overlords.