Deploy LLM App as API Using Langserve Langchain
ฝัง
- เผยแพร่เมื่อ 5 ก.พ. 2025
- LangServe helps developers deploy LangChain runnables and chains as a REST API.This library is integrated with FastAPI and uses pydantic for data validation.
github: github.com/kri...
--------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD
Lot of efforts is required in these kind of videos. Make sure to subscribe,like and share with all your friends :)
Sir hats off to you for creating these amazing videos and sharing it with us regularly 🫡
as usual, great work sir.
how to use with a local llm ?
dont get it bro ? is this another troute into these online api or are they local ?? how do you use this without chatgpt ?
why do we need to put the openapi-key?
just a simple suggestion do not do all the imports initially import the libraries on the go ,
Krish Naik is literally the Harsha Sai for Machine Learning, Ai and Data Science Stuff. A great Salute for you sir 🙋♂
Krish Naik is just Krish Naik himself. Dont associate him with other personalities OK.
Ad at 11:52, you have asked us to mention for any mid-roll ads. Here is one ! thanks.
This is by far the best I have come across, thanks!
Great work Krish
Thank You Sir, love from gujarat.
You are Awesome Bhai. Mashallah.
really loved your explaination is just amazing
Hey thanks for the video. One question: So what benefit exactly does Langserve provide? I could have created a flask end point and inside that just accepted the message and called Langchain LLM with that message. So what is exactly the benefit of using langserve over vanilla fast/flask?
More coding will be required in flask
Amazing video, thank you soo much😀😀
Its a very informative video but can we deploy these API with help of streamlit or something else ?
Sir how to deploy Open source LLMs and use them as API? (Free)
use anything llm
Hello @krishnaik06. Do you plan to make the Gemini Pro Fine Tuning video that has been recently published by Google?
This video is amazing but here we are having dependency on openAI is there any way to deploy custom llm models as an api and eliminate dependency of openAI
Tell me best way for non tech guy , trying to outline use it in legal use
You just got a new sub!
How do i secure the api and prevent malicious attacks? I was thinking of using SSR in angular or react as a frontend but i dont know if It's the best practice, what do you think?
🎉😊
Make an video on cloud computing & which cloud mostly used by mnc
Thank you so much krish, there is one request can you make a detailed video on crew AI and autogen AI, please
I want to create a custom chatbot that utilizes multiple Gemini and GPT APIs.
Does an API remember the history of messages in a chat?
This is crucial for maintaining context within the conversation.
Recently you doing a lot of videos on langchain, cool
The only problem i face is not having access to open ai apis. Minor so I can't buy it, and parents think I am doing trash things instead of studying.
Can you provide some altermatives
What is the type of these apis, is there any way to create post method apis?? Like we could define routes and then whether the function will be of get or post type - something like this??
Hi Krish,
Can you pleaadd the usecases of lang graph and practical applications in industry
Hey, what are some prerequisites to learning this? When you say “Deploy LLM App” you’re not actually building the app in Langserve right?
Hello Krish Naik, I really like your videos tutorials about langchain, langserve. But actually, I really want to ask you if you could make a video tutorial about langchain, langserve to make an application like askyourpdf that allowed users to upload their own file.
How to do the same thing for an OSS llm model, lets say a mistral? can i do the exact thing with mistral and how?
Great content
after using openai api, making another api end point ?, most of these tricks never serve the production setup scenarios
What if we need streaming response?
LEGIT I WANTED IT
Using gradio also I can create api right ?
Love from 🇵🇰
Would be much better to use postman to test the api
How to integrate it in flutter
I tried hard but giving the 404 error, can anyone help me out into this to resolve
Good day greetings
Make sure you rotate those keys
You are cool
Deploy??
Like and love from Lahore Pakistan
Good one but you can try complex tasks instead
overrated. not a good example of using langserve. This can be achieved using Flask too.
Bro i am stuck making flask api for the model which was built with llm and vision encoder can you help me?