Getting Started With Nvidia NIM-Building RAG Document Q&A With Nvidia NIM And Langchain

Explore the latest community-built AI models with an API optimized and accelerated by NVIDIA, then deploy anywhere with NVIDIA NIM inference microservices.
github Code: github.com/kri...
Visit nvda.ws/44W7KZP
-------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►GenAI on AWS Cloud Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

[@krishnaik06]

Check out my udemy course on Machine learning and NLP with end to end projects
bit.ly/3V0S0jS

[@sakthi130]

Hi Krish bought your course. Please upload deployment using Azure section in your course sooner. Deployment in Azure is not there yet

[@IdPreferNot1]

Such an excellent video with 3 awesome components. A very tight Langchain RAG implementation, on Streamlit, highlighting the capabilities of Nvidia's NIM inference.
Thank you for sharing!

[@syedfarhanahmed385]

Krish Sir thank you for all the RAG videos you shared. I added one feature into this application of Roman Hindi, where user can ask in Hindi and get response in Hindi too..

[@victorakakpo8299]

I love you Krish. I always pick my phone to see if you have posted something new

[@kumargaurav2170]

How is it different from Groq api inference service where LPUs are way faster than GPUs for inferencing. NIM is more like hosting hf models inside NVIDIA ecosystem with inferencing facility alongwith.But as groq has also got pretty good models, just for inferencing using groq api will be much wiser option for speed for same kind of models.

[@yvonne2599]

Thank you for the nice overview..I somehow keep getting 400 error with respect to inference, any heads up how i could sort it out ?

[@sergeistadnik8305]

I cheer for 1M subscribers for your channel !

[@davh29]

how do we ensure that the digital humans or nims are accountable and striving for higher nps?

[@rahulpatil2472]

Try to create RAG deployment using GenerativeAIExamples repo with nvidia nim container for llm inference

[@uniqueavi91]

Hello sir, instead of Streamlit application all the time, can you do sometimes where we can just run locally through terminal?

[@JebliMohamed]

Have you compared the inference speed of GROQ CLOUD with Nvidia Nim?

[@sharashhasnine-nm4hy]

Yeah i will

[@anandasekhar7402]

Does your laptop have GPU's . How did you ensure that the code runs on GPU's and not CPU's

[@251_satyamrai4]

Sir, in this your are first creating an OpenAI object 'client' and then using Llama3 model from it. How?

[@khadarvali1621]

Chainlit authentication pe ek video karo sir

[@Compact18]

Sir when we create an embedding so obviously it stores in local directory so could you please tell , if we deploy this application so where should we save this embedding if we use nomic embedding and chroma

[@rcky5290]

does the udemy course offer anything else from his previous playlists?I mean why should i choose the course over the free playlist apart from the certification??anyone?

[@dimpleagrawal6687]

It's a request that please do add the version if libraries used in the requirements.txt document for the ease in running the application

[@amitbandyopadhyay]

I am getting "ModuleNotFoundError: No module named 'langchain_nvidia_ai_endpoints'". What am i missing?

[@bodhisattadas304]

Hi, Krish, Can we use this to extract information from the pdf? Like invoice number , invoice dates or the description which contains table?

[@harshsinha9709]

I think it should work

[@mukeshodhano4094]

do credits reset at certain time

[@pradhyumnasg1134]

Sir can u tell us about Lighting AI plz

[@sergeistadnik8305]

How do you know which libraries you are going to use?

[@harshsinha9709]

Once you create 2-3 applications of RAG you will also know which one to use

[@dipamsarkar6626]

can anyone tell me how to get rid of this pathetic error am getting everytime.
Tge error is no module altair. vegatile. v4 and i have installed the updated version

[@rishiraj2548]

👍👍🙏