Inserting data into Neo4j with Neo4j-Shell and Cypher

By Neo4j Staff | May 8, 2013
Reading time: 2 minutes

Alireza Rezaei Mahdiraji

I am Alireza Rezaei Mahdiraji and I am a PhD student. My field or research is database systems.

I am experimenting several databases to support large scale scientific and simulation data. Some of the datasets have an inherent graph structure which make graph databases a good choice for modeling and querying such data.

I picked Neo4j for my modeling tasks because it is an important open source graph database which draw a lot of attentions from database research community and companies.

Running a Cypher CREATE command in the Neo4j Shell with a large graph ends to the following error: “argument list too long”. So, how do we execute such large CREATE statement?

The solution is use Neo4j Shell transaction facility and break down the original CREATE command into several smaller CREATE command and write the result in a file. An excerpt of the output looks like as follows:

begin

CREATE

(m{n:’m’, d:’3′}),

(f0{n:’f0′, d:’2′}),

m-[:so]->f0

…;

commit

exit

begin

(v20825{n:’v20825′, d:’0′}),

(e102800{n:’e102800′, d:’1′}),

e102800-[:so]->v20624,

…;

commit

exit

…

begin

(v20825{n:’v20825′, d:’0′}),

(e102800{n:’e102800′, d:’1′}),

e102800-[:so]->v20624,

…;

commit

exit

(e198203{n:’e198203′, d:’1′}),

e198203-[:so]->v40000,

e198203-[:so]->v39800,

f39600-[:so]->e198203

…

commit

exit

For a file of 64M, I commit after each 500 node/relationship commands and it works just fine. I tried it with 1000 and I got the same error as above.

After creating the file with CREATE command like example above, stop Neo4j server and import using the following command:

rm -rf data/graph.db && cat path/to/create_statment.cql | ./path/to/neo4j-shell -path data/graph.db

In the command above, create_statment.cql is the name of the file with the CREATE command, graph.db is the folder which Neo4j uses to store the database informations (usually located at /path/to/neo4j-community-XX/data/). The first command just remove existing graph database files.

Now, start the Neo4j server and simply query neo4j to see the data:

START r=node(*) RETURN count(r);

START r=rel(*) RETURN count(r);

To sum up – if you are running long Cypher CREATE commands, be sure to break down the statements to smaller chunks wrapped inside transaction clause to be executable from neo4j-shell.

/Alireza

Want to learn more about graph databases? Click below to get your free copy of O’Reilly’s Graph Databases ebook and discover how to use graph technologies for your application today.

Download My Ebook

Keywords: cypher • databases • graph database

Neo4j Community Disclaimer

7 Comments

George Kowalski says:

May 12, 2013 at 12:41 pm

Is performance better doing inserts this way , with one large insert , or if one had a program that performed individual inserts and a commit at the end.

Alireza RM says:

May 13, 2013 at 12:37 pm

This comment has been removed by the author.

Alireza RM says:

May 13, 2013 at 12:39 pm

Hi George, <br />Actually, this is not a large insert. The idea is to break it down to small pieces (say 500 lines of insert) and commit it. I did not measure it with a program based on for instance Java for line by line insert. Usually, the bulk insert should perform better. You may try and report its performance.

Joel says:

April 4, 2016 at 8:16 am

Hi,
the commit worked some how but when i started neo4j i just found the first 500 objects.
my file looks like you discredit above every 500 elements i commit and exit.
…;
commit
exit
begin

sacha says:

September 28, 2016 at 2:51 pm

hello, i tried the command like :
rm -rf C:/data/Neo4j/graph.db && cat C:/data/Neo4j/create_statment.cql | C:/Program Files/Neo4j CE 3.0.4/bin/neo4j-shell -path c:/data/neo4j/graph.db

in the shell for windows, but it’s now working at all, i dont get it… Please tell me what’s wrong.

Shafeeque says:

January 18, 2017 at 2:47 am

Hi Support,

For initial Neo4j data setup I have execute one file which contains set of Cypher statements, please let me know how can I execute them via Neo4j-Shell,

I will appreciate your immediate response.

I am also interested to purchase a Neo4j licence.

Thanks,
Shafeeque

Daniel says:

August 2, 2018 at 6:36 am

since neo4j-shell is deprecated (https://neo4j.com/docs/operations-manual/current/configuration/ports) it took me a long time to realize this, it would be nice if this post was removed.

Upcoming Event

Have a Graph Question?

Reach out and connect with the Neo4j staff.

Stack Overflow
Slack
Contact Us

Share your Graph Story?

Email us: content@neo4j.com

Neo4j Blog