LangSmith Tutorial - LLM Evaluation for Beginners

Want to get started with freelancing? Let me help: www.datalumina...
Need help with a project? Work with me: www.datalumina...
This is a complete beginner tutorial for LangSmith. It allows you to find and fix errors, test, evaluate, and keep track of chains and smart agents made with any LLM framework. It also works seamlessly with LangChain, the preferred open-source framework for working with LLMs. LangSmith is developed by the company behind the open-source LangChain framework.
🔗 Links in this video
github.com/dav...
smith.langchai...
docs.smith.lan...
👋🏻 About Me
Hey there, my name is @daveebbelaar and I work as a freelance data scientist and run a company called Datalumina. You've stumbled upon my TH-cam channel, where I give away all my secrets when it comes to working with data. If you want to learn more about what I do, then head over to www.datalumina...

[@daveebbelaar]

🔐 Copy my AI tools & workflows: bit.ly/data-alchemy

[@bextuychiyev7435]

It is clear that you have a very organized mind - the video is crisp and neat. Great to have as a creator! I am actually watching this to write a tutorial on LangSmith for DataCamp blog.

[@daveebbelaar]

That's an awesome compliment :)

[@PorTierraMaryAirepodcast]

A really nice job. It's really hard to be updated about all these development, but with each passing week, the gap between us and those who do not want to take advantage of these opportunities is widening

[@daveebbelaar]

Thanks! And I know. It's crazy and a little overwhelming ;)

[@arkosnatoneogy2366]

cool tutorial. something i am finding a little fishy is how they use an LLM to evaluate the output of an LLM. is this objective? what if both the generator and evaluator suffer from the same biases?

[@orlandocastellanos9263]

I saw your video about deploying a Slack assistant on Azure, I loved it, but how can we deploy a vector database to have an assistant and memory?

[@kevon217]

I was literally searching for LangSmith tutorials and got your notification of this vid. Such a godsend!

[@pradyumagarwal3978]

can i use these langsmith tools for evaluating models from hugging face instead of openAI

[@vincent4384]

yes I have the same question- im using ollama

[@Mike.G97]

Did you use any vscode extension to generate those code comments in your file or?

[@vincent4384]

dang, there still isn't a way to connect Ollama instead of an openai key at time of writing. if someone has figured out before this has been made very available and you see this- please enlighten us!

[@JJaitley]

How to get access to Langsmith? What about the data privacy of the client? Can we have this on-prem for data privacy and security purposes? Any response to questions will be highly appreciated.

[@daveebbelaar]

You can sign up for the beta waitlist. For data privacy, please refer to this section in the docs: docs.smith.langchain.com/organizations#my-team-deals-with-sensitive-data-that-cannot-be-logged-how-can-i-ensure-that-only-my-team-can-access-it

[@user-wr4yl7tx3w]

only thing i noticed is that the website doesn't update even after running the code multiple times to reflect the new traces. may be langsmith is still under beta.

[@ahmedmusawir]

Thank you, my friend ... this is awesome!

[@vasioknow5638]

How can I integrate a pdf file to a chat gpt in python ( I want ai to use information from my pdf )

[@DANNYEL20122]

Learn langchain

[@vincent4384]

I sucesffully followed this tutorial th-cam.com/video/FDBnyJu_Ndg/w-d-xo.htmlsi=lDSkJceNIqAkbGBe

[@AlonAvramson]

Thank you! very informative and clear, and just in time. Is there also a way to evaluate using QAEgn and QAEval chains in Langchain?

[@AmandeepSingh-bx9pj]

Hi, can I get an invite code for Langsmith?

[@sorin9597]

Fantastic guide, thank you

[@daveebbelaar]

Thank you! 🙏🏻

[@user-pn1gq4rl8o]

amazing tutorial

[@Divy91311]

Hey Dave , really nice video! I was wondering if I could help you edit your videos and also make a highly engaging Thumbnail which will help your video to reach to a wider audience .

[@masked00000]

The video is well presented but is not clear for someone who is totally new, As a beginner, I would want to see each step by step implementation and not a high level generic on Langsmith

[@ruslansultanov7646]

Great job. How you ran you code from .py in Jupyter? I can't find hot keys for this.

[@ruslansultanov7646]

th-cam.com/video/zulGMYg0v6U/w-d-xo.html😀

[@rakeshkumar-pf6yu]

I m sorry to say..but you don't know how to teach bro...

[@daveebbelaar]

Why do you think so?

[@benzhu2438]

I wholeheartedly agree... skipped over so many basic steps so really isn't a "beginner tutorial." I wish I could get back the time I wasted listening to him

[@Haydenralph532]

Hey Dave , really nice video! I was wondering if I could help you edit your videos and also make a highly engaging Thumbnail which will help your video to reach to a wider audience .