Deploy LLM App as API Using Langserve Langchain

LangServe helps developers deploy LangChain runnables and chains as a REST API.This library is integrated with FastAPI and uses pydantic for data validation.
github: github.com/kri...
--------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

[@krishnaik06]

Lot of efforts is required in these kind of videos. Make sure to subscribe,like and share with all your friends :)

[@AmarGuptanwd]

Sir hats off to you for creating these amazing videos and sharing it with us regularly 🫡

[@siliconberry]

as usual, great work sir.

[@xspydazx]

how to use with a local llm ?

[@xspydazx]

dont get it bro ? is this another troute into these online api or are they local ?? how do you use this without chatgpt ?
why do we need to put the openapi-key?

[@mehulpratapsingh8820]

just a simple suggestion do not do all the imports initially import the libraries on the go ,

[@ParthivShah]

Thank You Sir, love from gujarat.

[@SanjeevyDeveloper]

Krish Naik is literally the Harsha Sai for Machine Learning, Ai and Data Science Stuff. A great Salute for you sir 🙋‍♂

[@geekyprogrammer4831]

Krish Naik is just Krish Naik himself. Dont associate him with other personalities OK.

[@palashjyotiborah9888]

Ad at 11:52, you have asked us to mention for any mid-roll ads. Here is one ! thanks.

[@MahaveerTirumalasetty-b6b]

really loved your explaination is just amazing

[@samagrashrivastava8042]

Amazing video, thank you soo much😀😀

[@AasherKamal]

Sir how to deploy Open source LLMs and use them as API? (Free)

[@andaiai]

use anything llm

[@syedhussain6358]

You are Awesome Bhai. Mashallah.

[@dereckjos3513]

This video is amazing but here we are having dependency on openAI is there any way to deploy custom llm models as an api and eliminate dependency of openAI

[@Dancekeparwane]

Make an video on cloud computing & which cloud mostly used by mnc

[@MrSajjadathar]

Thank you so much krish, there is one request can you make a detailed video on crew AI and autogen AI, please

[@devloper.hs14]

Recently you doing a lot of videos on langchain, cool
The only problem i face is not having access to open ai apis. Minor so I can't buy it, and parents think I am doing trash things instead of studying.
Can you provide some altermatives

[@shashankshekhar8970]

Hey thanks for the video. One question: So what benefit exactly does Langserve provide? I could have created a flask end point and inside that just accepted the message and called Langchain LLM with that message. So what is exactly the benefit of using langserve over vanilla fast/flask?

[@krishnaik06]

More coding will be required in flask

[@braydenfulken2495]

You just got a new sub!

[@hamidraza1584]

Like and love from Lahore Pakistan

[@ds341yup]

Thank you Sir.

[@TsioritianaRyanRakotoahijohn]

Hello Krish Naik, I really like your videos tutorials about langchain, langserve. But actually, I really want to ask you if you could make a video tutorial about langchain, langserve to make an application like askyourpdf that allowed users to upload their own file.

[@GregoryPereira-mi2jy]

Make sure you rotate those keys

[@brijeshkp2000]

Great content

[@ChanduAki-ht5xv]

Hi Krish,
Can you pleaadd the usecases of lang graph and practical applications in industry

[@cricketalwys]

What is the type of these apis, is there any way to create post method apis?? Like we could define routes and then whether the function will be of get or post type - something like this??

[@taazkareem]

Hey, what are some prerequisites to learning this? When you say “Deploy LLM App” you’re not actually building the app in Langserve right?

[@akshatkant1423]

How to do the same thing for an OSS llm model, lets say a mistral? can i do the exact thing with mistral and how?

[@buzzprime93]

Deploy??

[@andaiai]

after using openai api, making another api end point ?, most of these tricks never serve the production setup scenarios

[@ShreyashMukte]

What if we need streaming response?

[@ChethanYadav]

LEGIT I WANTED IT

[@Shahbazpucit]

Love from 🇵🇰

[@AIWalaBro-Bharatbhushan]

I tried hard but giving the 404 error, can anyone help me out into this to resolve

[@nischitkr3269]

Using gradio also I can create api right ?

[@tirthvora8591]

overrated. not a good example of using langserve. This can be achieved using Flask too.

[@agahyucel4502]

Hello @krishnaik06. Do you plan to make the Gemini Pro Fine Tuning video that has been recently published by Google?

[@abhishekhingmire8972]

🎉😊

[@compsae]

Its a very informative video but can we deploy these API with help of streamlit or something else ?

[@RishiRajxtrim]

Good day greetings

[@praneethreddy8722]

You are cool