NODES 2024 – Developer Productivity for GenAI Apps

The GenAI landscape has grown a ton in the last year with many technologies and approaches that application developers must master to include AI in their end-user and enterprise apps. However, more focus must be put into enabling standard software development workflows, including testing, ensuring RAG correctness and efficiency, local development environment and CI setups, and security of LLM artifacts. In this session, we look at how application developers can integrate and test their GenAI apps with local models, augmented with RAG both locally and in CI. You'll learn how the setups for GenAI apps in the inner development loop can be programmatically managed and how new tools can get into typical software development workflows without impairing developer productivity.