How to build a Llama 2 chatbot

แชร์
ฝัง
  • เผยแพร่เมื่อ 31 ม.ค. 2025
  • In this video, ‪@DataProfessor‬ shows you how to build a Llama 2 chatbot in Python using the Streamlit framework for the frontend, while the LLM backend is handled through API calls to the Llama 2 model hosted on Replicate.
    ⭐️ Watch this simplified video on using Llama 2 in Python • How to use the Llama 2...
    🕹️ Demo app llama2.streaml...
    🕹️ Demo app (Pro) llama2-pro.str...
    🐙 GitHub repo github.com/dat...
    🛠️ Tutorial blog on building the Llama 2 chatbot blog.streamlit...
    🔗 Llama release ai.meta.com/ll...
    🔗 a16z chatbot github.com/a16...
    🔗 Replicate replicate.com/
    ☁️ Deploy your own Streamlit app streamlit.io/c...
    #streamlit #llama2 #chatgpt #chatbot #python

ความคิดเห็น • 33

  • @mohammedismail6872
    @mohammedismail6872 ปีที่แล้ว +25

    the flow chart at 1:50 is sooo cool bro, how did you make it ?

  • @learningneverends6674
    @learningneverends6674 ปีที่แล้ว +13

    Replicate api is cost since using cloud. Can we do it in local??

  • @NexTechNuggets
    @NexTechNuggets ปีที่แล้ว +6

    Can you make it read pdfs from folder and than chat with them? I am looking for something that can chat with documents but all needs to be locally tun and free.

  • @simon-ski
    @simon-ski ปีที่แล้ว

    Awesome explanation and tutorial! Thank you. By the way: It is "What questions did I ask?".
    The word 'did' is already past tense, so 'ask' shouldn't be past tense as well - it's gramatically incorrect.

  • @Nyanda_Jr
    @Nyanda_Jr ปีที่แล้ว +7

    Hello I thought llam2 is open source but you discussed about replicate kind of paying? I would like to know more about that. Sounds like am missing a point.

    • @iamvalenci4
      @iamvalenci4 ปีที่แล้ว +6

      is paying if you decide to run llama2 in the cloud (wich consume gpu), you can run in your local computer which also consume gpu but is free, llama2 is somthing that you can deploy to use with your app, other way you need to keep your local computer on 24/7, that is the reason deploying your llama2 model in the cloud need to be paid. like an API.

    • @gabrielhbueno1
      @gabrielhbueno1 ปีที่แล้ว

      Thanks for that!

    • @acrtalksmalayalam8497
      @acrtalksmalayalam8497 หลายเดือนก่อน

      Bro,here we deploy llama models in replicate ai then we use it through api,am I right

  • @GeigenAkademie
    @GeigenAkademie ปีที่แล้ว +1

    When I type in the textfield, my input gets red marked/underlined (spellcheck?). I don't see it in your video. How can I prevent it?

  • @roigazit8165
    @roigazit8165 ปีที่แล้ว +4

    Thanks!
    Can I build a saas chatbot based on llama 2 that knows read pdf and schedule treatments? How can I do that?
    Thanks again!

    • @brijsden
      @brijsden 11 หลายเดือนก่อน

      did you manage to build a bot that raeds pdf ?

  • @TJTHEFOOTBALLPROPHET
    @TJTHEFOOTBALLPROPHET ปีที่แล้ว

    A few days ago you produced a video called "how to make an app in seconds" that was Steve Jobs level of brilliant marketing!!!!

  • @mihaelacostea5783
    @mihaelacostea5783 9 หลายเดือนก่อน +1

    Can you trai Llama2 with your own data?

  • @uynguyen746
    @uynguyen746 9 หลายเดือนก่อน

    Hey, I tried to create a chatbot based on this vid, but can you tell me more about the purpose ipynb file?

  • @Ousmane-sonko
    @Ousmane-sonko 5 หลายเดือนก่อน

    Good tuto, but i want to known how to store data sent by the users. I mean the questions asked by users

  • @macharlasaimahesh18
    @macharlasaimahesh18 ปีที่แล้ว +1

    Can I Prepare a Query as output to user by using Snowflake Streamlit based on the Prompt that user sends?

    • @streamlitofficial
      @streamlitofficial  ปีที่แล้ว

      Hi, yes certainly. Check out this GitHub repo that performs what you're looking for github.com/Snowflake-Labs/sfguide-frosty-llm-chatbot-on-streamlit-snowflake

  • @idkkkkk5194
    @idkkkkk5194 4 หลายเดือนก่อน

    is it free to use ?

  • @LGseeker
    @LGseeker 11 หลายเดือนก่อน

    Streamlit sucks now, if you deploy on the community cloud you will have to give streamlit access to all your git repos including private ones.
    I am guessing they want you use your work to train their models.

  • @Nyanda_Jr
    @Nyanda_Jr ปีที่แล้ว +5

    Can I build Mental Health AI chatbot with my custom dataset finetuning with Llama2 ?

    • @iamvalenci4
      @iamvalenci4 ปีที่แล้ว +4

      yes you can, but you need frontend and a backend, your backend consume third services one of them is llama2, but to use llama2 you need to deploy to the cloud and from the backend call your llama2 model AI

    • @Nyanda_Jr
      @Nyanda_Jr ปีที่แล้ว

      Can I get your Email Address brother?

    • @bourbe
      @bourbe ปีที่แล้ว

      th-cam.com/video/kXuHxI5ZcG0/w-d-xo.html

    • @bourbe
      @bourbe ปีที่แล้ว

      th-cam.com/video/lbFmceo4D5E/w-d-xo.html

  • @triggeredeng
    @triggeredeng ปีที่แล้ว +6

    is it paid??

  • @Piotr_Sikora
    @Piotr_Sikora ปีที่แล้ว

    Can we save session?

  • @kbhange90
    @kbhange90 ปีที่แล้ว

    🎈