Google Cloud Vertex AI

Deploying GenAI Applications and APIs with Vertex AI Reasoning Engine

GenAI developers, familiar with orchestration tools and architectures often face challenges when deploying their work to production. Google’s Vertex AI Reasoning Engine Runtime(preview) now offers an easy way to deploy, scale, and monitor GenAI applications and APIs without in-depth knowledge of containers or cloud configurations.

Compatible with various orchestration frameworks, including LangChain, this solution allows developers to use the Vertex AI Python SDK for setup, testing, deployment.

It works like this:

Create a Python class for your GenAI app class to store environment info and static data in the constructor.
Initialize your orchestration framework in a set_up method at startup.
Process user queries with a query method, returning text responses.
Deploy your GenAI API with llm_extension.ReasoningEngine.create, including class instance and requirements.

Our new integrations with Google Cloud, combined with our extensive LangChain integrations, allow you to seamlessly incorporate Neo4j knowledge graphs into your GenAI stack. You can use LangChain and other orchestration tools to deploy RAG architectures, like GraphRAG, with Reasoning Engine Runtime.

You can see below an example of GraphRAG on a Company News Knowledge Graph using LangChain, Neo4j and Gemini.

Knowledge Graph Generation with Gemini Pro

The LLM Graph Builder that extracts entities from unstructured text (PDFs, YouTube Transcripts, Wikipedia) can be configured to use VertexAI both as embedding model and Gemnini as LLM for the extraction. PDFs can be also be loaded from Google Cloud buckets.

It uses the underlying llm-graph-transformer library that we contributed to LangChain.

SEC Filings GenAI Labs

This example consists of two sample applications that show how to use Neo4j with the generative AI capabilities in Google Cloud Vertex AI. We explore how to leverage Google generative AI to build and consume a knowledge graph in Neo4j.

assetmanager - Parses data from the SEC containing quarterly filings of asset managers. We build a graph containing assets managers and the securities they hold. A chatbot that queries the knowledge graph is included as well.
resume - Extracts entities like jobs and skills from a collection of resumes, then builds a graphs showing what talents individuals share. A chatbot that queries the knowledge graph is included as well.