Thank you for the video. I have used mistral 7b open source model with ctransformer and langchain in my project. From this video I came to know 3 more open source models I can use in my project.
@@Analyticsvidhya Glad to hear that you liked my project. No the project is not available at github yet. I will load it soon. The project is about chat with local pdf using mistral 7b model. The experience with mistral is good. To use open source llm with ctransformer is quite easy method.
@@Analyticsvidhya Hi for my project I am looking for small huggingface model that can understand both code and text. In my chatbot project I am loading github repositories and asking question on it.
@@souravbarua3991do you know how to change code so it would remember your dialogue? Today i have fould some step-by-step tutorial for colab, launched it and every answer takes 7 minutes, is it ok?
I am getting below error when running gradio sinppet cannot import name 'Doc' from 'typing_extensions'. I tried this but still not working. !pip install gradio import gradio import torch
How can you avoid needing to download the model every time? I saved the model to GDrive and transferred to cache in a new session but can't successfully load from cache
Thanks for the video. I am getting below error when running gradio sinppet cannot import name 'Doc' from 'typing_extensions' can you please help me to understand how to resolve it. Thanks.
Dear learner, drop an email to our Career Counselling team for a free mentorship session: ummed@analyticsvidhya.com Alternatively, you may call on the any of the following numbers: Line1: +91 8068342847 Line2: +91 8046107668
Book FREE 1:1 Mentorship for Gen AI / Data Science
Link 🔗 bit.ly/3wlIIGz
Thank you for the video. I have used mistral 7b open source model with ctransformer and langchain in my project. From this video I came to know 3 more open source models I can use in my project.
Hey Sourav, will be interesting to hear more on your project. Is it documented on GitHub?
Also, share your experience of Mistral-7b model with us.
@@Analyticsvidhya Glad to hear that you liked my project. No the project is not available at github yet. I will load it soon. The project is about chat with local pdf using mistral 7b model. The experience with mistral is good. To use open source llm with ctransformer is quite easy method.
@@Analyticsvidhya Hi for my project I am looking for small huggingface model that can understand both code and text.
In my chatbot project I am loading github repositories and asking question on it.
@@souravbarua3991do you know how to change code so it would remember your dialogue? Today i have fould some step-by-step tutorial for colab, launched it and every answer takes 7 minutes, is it ok?
Excellent video! Thanks for explaining the process in detailed manner. Looking forward to more videos!!
Glad it was helpful!
Thank you so much, I've been searching about hosting llms on colab and using it.
You're very welcome!
This channel is amazing!
Thanks! 😃
Thank you for sharing, one notice: transformers > 4.38 causes bug in inference for the models.
excellent explanation thank u very much
I am getting below error when running gradio sinppet
cannot import name 'Doc' from 'typing_extensions'. I tried this but still not working.
!pip install gradio
import gradio
import torch
Try restarting runtime and then executing the Gradio part
Greaatt Video!!
Glad you liked!!
thank u for good teaching
Very nice job . I subscribe in your page . Thank you very much !
How can you avoid needing to download the model every time? I saved the model to GDrive and transferred to cache in a new session but can't successfully load from cache
Refer to this discussion thread for your resolution: discuss.huggingface.co/t/saving-loading-model-in-colab-and-making-predictions/6723
Thanks for the video. I am getting below error when running gradio sinppet
cannot import name 'Doc' from 'typing_extensions'
can you please help me to understand how to resolve it. Thanks.
Can you share your query on our community platform: community.analyticsvidhya.com/
Also share screenshots. Let's discuss this there.
It's colab's issue. Try this
!pip install gradio
import gradio
import torch
(if you have already imported torch restart the kernel)
@@vassilissolachidis1199 thanks for the help. Was able to resolve the issue.
I have a question , can I make this code as an API ? because I want to make graduation project to build a Generative AI mobile app .
Dear learner, drop an email to our Career Counselling team for a free mentorship session: ummed@analyticsvidhya.com
Alternatively, you may call on the any of the following numbers:
Line1: +91 8068342847
Line2: +91 8046107668
Does it have a word limit?
Yea, look up for context window length. Generally it's 128k