Function Calling for LLMs: RAG without a Vector Database

Speaker: Jim Dowling, CEO, Hopsworks
In this talk, we will look at extending RAG with Function Calling to access structured/tabular data. We will look at how to enrich your tables with metadata and the expressivity of the queries that you can reasonably expect to perform well. We will examine function calling in the context of queries to the Hopsworks feature store, that supports extensive metadata and statistics for columns and tables (feature groups), used to improve function calling performance. We will look at both cloud hosted LLMs (like GPT-4) and private LLMs, such as Hermes-2 (a fine-tuned mistral 7b LLM).