NODES 2023 – New Caledonia Open Data as a Whole Big Graph

28 Mar, 2024



The New-Caledonian government manages an Open Data platform that hosts and promotes all the Open Data of New-Caledonia on data.gouv.nc. As the underlying solution relies on OpenDataSoft, it makes interacting with all the data possible. In this session, Adrien will delve into all these metadata datasets to explore his country from a purely data-centric and graph perspective at a substantial scale. Slides: https://drive.google.com/file/d/1fZJnKgnK3HU-uJiADFPwr_64cB6ExDIy/view?usp=sharing Blog: https://dev.to/adriens/discover-a-country-un-sdgs-concerns-w-open-metadata-on-neo4j-13df #neo4j #graphdatabase #nodes2023 #opendata 00:00 : Intro about New-Caledonia 01:08 : How do countries are connected to the world (and United Nations) 01:27 : Benchmarking countries Open Data maturity w/ the “Global Data Barometer” tool 02:17 : Introducing our data journey 02:52 : Ideating w/ AI : create a storytelling plan with AI crowd (Langchain SmartLLMChain & OpenAI gpt-4) 05:02 : Discovering storytelling keypoint 1/5 : Map Country’s Open Data to UN SDGs 05:35 : 2/5 Identifying relationships 06:07 : 3/5 predictive analysis 06:16 : 4/5 Gap Analysis 06:30 : 5/5 Storytelling with Data 06:52 : Get smart title and subtitle for the experience 07:18 : About UN SDGs 07:36 : The data pillars we used to connect country data to UN SDGs 07:59 : About data.gouv.nc (Open Data portal from New-Caledonia) 08:22 : UN SDGs Open Data Portal 08:36 : About Pacific Data Hub from The Pacific Community (SPC) 08:58 : Project workflow, schedule and stack 09:52 : Connecting datasets to UN SDGs 10:18 : Building and putting the data together on Kaggle/DuckDb 10:30 : Discovering the schema of our knowledge graph 11:26 : About SDG goal hierarchy and “foundational goals” 11:51 : Introducing RAG (Retrieval AUgmented Generation) w/ LangChain 15:19 : RAG with LLama_Index 17:29 : SDGs interactive discovery : storytelling on Neo4J Aura DB/Bloom 20:27 : Explore Gender Equity in 3D with Kineviz GraphXR 22:22 : Dataviz with Gephisto 22:38 : Kudos to the biggest Open Data Publishers 22:59 : About the stack 23:39 : Data art and contemplation (Gephi with Runway experiment) cf https://youtu.be/Acp_TcGW-9g 25:49 : Conclusion

Related Videos