How OpenTelemetry Helps Generative AI - Phillip Carter, Honeycomb

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at kubecon.io
How OpenTelemetry Helps Generative AI - Phillip Carter, Honeycomb
Generative AI has taken the industry by storm. Like it or not, it's here to stay, people are finding use for it, companies are building with it, and it needs help. The biggest challenge with Generative AI is that you can't debug it by stepping through code like you can "normal" software. So, how do you understand when it's working well, when it's not working well, and how to improve it? Observability! In this talk, we'll cover at a high level the problems that Generative AI introduces in production, why Observability matters, and some high level tips for how you can use OpenTelemetry to make progress with this tech. Finally, we'll make mention of the LLMs Semantic Conventions WG and how folks can engage.