Retrieval Augmented Generation // Syed Asad // MLOps Podcast

Join us at our first in-person conference on June 25 all about AI Quality: www.aiqualityconference.com/
MLOps podcast #233 with Syed Asad, Lead AI/ML Engineer at KiwiTech // Retrieval Augmented Generation.
Huge thank you to @amazonwebservices for sponsoring this episode. AWS - aws.amazon.com/
// Abstract
Everything and anything around RAG.
// Bio
Currently Exploring New Horizons:
Syed is diving deep into the exciting world of Semantic Vector Searches and Vector Databases. These innovative technologies are reshaping how we interact with and interpret vast data landscapes, opening new avenues for discovery and innovation.
Specializing in Retrieval Augmented Generation (RAG):
Syed's current focus also includes mastering Retrieval Augmented Generation Techniques (RAGs). This cutting-edge approach combines the power of information retrieval with generative models, setting new benchmarks in AI's capability and application.
// MLOps Jobs board
mlops.pallet.xyz/jobs
// MLOps Swag/Merch
mlops-community.myshopify.com/
// Related Links
github.com/asadnhasan
github.com/syedzaidi-kiwi/
huggingface.co/syedzaidi-kiwi
The Real E2E RAG Stack // Sam Bean // MLOps Podcast #217: • The Real E2E RAG Stack...
-------------- ✌️Connect With Us ✌️ ------------
Join our slack community: go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: mlops.community/
Connect with Demetrios on LinkedIn: / dpbrinkm
Connect with Syed on LinkedIn: / syed-asad-76815246
Timestamps:
[00:00] Syed's preferred coffee
[00:31] Takeaways
[03:17] Please like, share, leave a review, and subscribe to our MLOps channels!
[03:37] A production issue
[07:37] CSV file handling risks
[09:42] Embedding models not suitable
[11:22] Inference layer experiments and use cases
[14:00] AWS service handling the issue
[17:35] Salad testing and insights
[22:12] OpenAI vs Customization
[24:30] Difference between Olama and VLLM
[27:16] Fine-tuning of small LLMs
[29:51] Evaluation framework
[32:04] MLOps for efficient ML
[37:12] Determining the pricing of tools
[39:35] Manage Dependency Risk
[40:27] Get in touch with Syed on LinkedIn
[41:46] ML Engineers are now all AI Engineers
[43:01] The hard framework
[43:53] Wrap up

[@baplkkk]

Brilliant talk

[@Donald-mo2oe]

For a middle-aged guy halfway through a CS/DS undergrad degree with hopes of entering the ML career field, I understood less than a third of what was being discussed. At the same time, I now have 30 browser tabs open to research technologies I didn't know existed 45 minutes ago.
Thanks for the great content and keep up the good fight.

[@MLOps]

happy to help!