NODES 2023 – New Caledonia Open Data as a Whole Big Graph

The New-Caledonian government manages an Open Data platform that hosts and promotes all the Open Data of New-Caledonia on data.gouv.nc. As the underlying solution relies on OpenDataSoft, it makes interacting with all the data possible. In this session, Adrien will delve into all these metadata datasets to explore his country from a purely data-centric and graph perspective at a substantial scale.

Slides: https://drive.google.com/file/d/1fZJnKgnK3HU-uJiADFPwr_64cB6ExDIy/view?usp=sharing
Blog: https://dev.to/adriens/discover-a-country-un-sdgs-concerns-w-open-metadata-on-neo4j-13df

#neo4j #graphdatabase #nodes2023 #opendata

00:00 : Intro about New-Caledonia
01:08 : How do countries are connected to the world (and United Nations)
01:27 : Benchmarking countries Open Data maturity w/ the “Global Data Barometer” tool
02:17 : Introducing our data journey
02:52 : Ideating w/ AI : create a storytelling plan with AI crowd (Langchain SmartLLMChain & OpenAI gpt-4)
05:02 : Discovering storytelling keypoint 1/5 : Map Country’s Open Data to UN SDGs
05:35 : 2/5 Identifying relationships
06:07 : 3/5 predictive analysis
06:16 : 4/5 Gap Analysis
06:30 : 5/5 Storytelling with Data
06:52 : Get smart title and subtitle for the experience
07:18 : About UN SDGs
07:36 : The data pillars we used to connect country data to UN SDGs
07:59 : About data.gouv.nc (Open Data portal from New-Caledonia)
08:22 : UN SDGs Open Data Portal
08:36 : About Pacific Data Hub from The Pacific Community (SPC)
08:58 : Project workflow, schedule and stack
09:52 : Connecting datasets to UN SDGs
10:18 : Building and putting the data together on Kaggle/DuckDb
10:30 : Discovering the schema of our knowledge graph
11:26 : About SDG goal hierarchy and “foundational goals”
11:51 : Introducing RAG (Retrieval AUgmented Generation) w/ LangChain
15:19 : RAG with LLama_Index
17:29 : SDGs interactive discovery : storytelling on Neo4J Aura DB/Bloom
20:27 : Explore Gender Equity in 3D with Kineviz GraphXR
22:22 : Dataviz with Gephisto
22:38 : Kudos to the biggest Open Data Publishers
22:59 : About the stack
23:39 : Data art and contemplation (Gephi with Runway experiment) cf https://youtu.be/Acp_TcGW-9g
25:49 : Conclusion