Introduction
The Flex Template allows you to import data from a BigQuery dataset into a Neo4j database, through a Dataflow job. It also allows you to manipulate and transform the data at various steps of the import. You can use the template for both first-time and incremental imports.
|
This template runs as a batch Dataflow job, not a streaming one. Each run executes each source SQL query at most once per target, against a point-in-time snapshot of the BigQuery data. Sources do not read from a BigQuery change stream nor do they continuously ingest new data. "Incremental imports" above means re-running the job with a query that selects new or changed rows, not continuous or real-time ingestion. To keep Neo4j up to date, schedule the job to run on a recurring basis (for example with Cloud Scheduler). |
This guide walks you through how to import an example BigQuery dataset into a Neo4j database using a Dataflow job. It also provides a public dataset you can experiment with, before you go on and create an import job for your own dataset.
| To import data from CSV files rather than BigQuery, check out the Dataflow Flex Template for Google Cloud to Neo4j. |