How to set up RAG - Retrieval Augmented Generation (demo)

แชร์
ฝัง
  • เผยแพร่เมื่อ 17 พ.ค. 2024
  • When I posted my video on Retrieval Augmented Generation (RAG), I got a lot of requests to show exactly how it worked at a technical level.
    RAG helps you create a ChatGPT-like experience that uses your own internal content. Instead of only accessing information from the internet, an LLM can access your PDFs or databases or any other internal content by using a RAG architecture.
    I know this is a little more technical than my previous videos, so I’d love to hear from you if you thought this was interesting and if I should do more! Drop a comment so I know.
    #RAG #AI #VectorDB #LLM #codetocare #artificialintelligence #machinelearning #ml #chatgpt #genai
    Also, check out our VectorDB here: www.intersystems.com/news/iri...
    Check out my LinkedIn: / donwoodlock
    Timecodes:
    00:00 - Intro
    00:35 - Demo Layout in Stages
    00:59 - Stage 1: Using a Simple Pass Through Prompt
    01:52 - Stage 1: Desktop Demo
    04:15 - Stage 2: Adding Instructions to your prompt
    05:11 - Stage 2: Desktop Demo
    07:18 - Stage 3: Setting up Retrieval Augmented Generation
    09:05 - Stage 3: Desktop Demo
    19:10 - Wrap up
    ---
    ABOUT INTERSYSTEMS
    Established in 1978, InterSystems Corporation is the leading provider of data technology for extremely critical data in healthcare, finance, and logistics. It’s cloud-first data platforms solve interoperability, speed, and scalability problems for large organizations around the globe.
    InterSystems Corporation is ranked by Gartner, KLAS, Forrester and other industry analysts as the global leader in Data Access and Interoperability. InterSystems is the global market leader in Healthcare and Financial Services.
    Website: www.intersystems.com/
    TH-cam: / @intersystemscorp
    LinkedIn: / intersystems
    Twitter: / intersystems
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 36

  • @amnguyenduyan1426
    @amnguyenduyan1426 3 วันที่ผ่านมา

    Amazing video, save me ton of days to study. Thank you very much Mr. Don

  • @asheeshmathur
    @asheeshmathur 5 วันที่ผ่านมา

    Excellent, made so simple.😃

  • @mzimmerman1988
    @mzimmerman1988 10 วันที่ผ่านมา +1

    helpful! thanks.

  • @belugaaa6649
    @belugaaa6649 26 วันที่ผ่านมา +12

    Awesome Don, please do more of these videos explaining more about AI/ML
    next topic: one on Lang chain or llama model 3 which was released recently.

    • @dwoodlock
      @dwoodlock  21 วันที่ผ่านมา +5

      Yes - I'll take a look.

    • @belugaaa6649
      @belugaaa6649 21 วันที่ผ่านมา +1

      @@dwoodlock Thank you dan you are amazing

  • @sjmediaonline
    @sjmediaonline 5 วันที่ผ่านมา

    Great video! Could you please do one video on RAG with knowledge graph? Thanks!

  • @funmitoadeyemi4647
    @funmitoadeyemi4647 24 วันที่ผ่านมา +3

    You really are a teacher, made it consumable to RAG newbies, this is how videos should be lol. Thank you very much

  • @govindarajram8553
    @govindarajram8553 15 วันที่ผ่านมา +4

    It's so good to see a good demo, please put more videos, I would specifically looking for RDMS database to vector database to store embeddings so my user can use AI

  • @starter_culture
    @starter_culture 18 วันที่ผ่านมา +1

    Best explanation I have seen to date of how RAG works.

  • @nadellaella6416
    @nadellaella6416 28 วันที่ผ่านมา +2

    The way you conveyed that information was so structured and informative.
    Your explanation made me grasp the concept quickly.
    Thank You!!!

  • @OstaNazir
    @OstaNazir 23 วันที่ผ่านมา +3

    I loved this explanation of RAG. I’ll share this with my team.

  • @MohitGupta-cz9ok
    @MohitGupta-cz9ok 17 วันที่ผ่านมา

    Thanks, after watching your video I got clear understanding how we can implement RAG.

  • @bhaskarmazumdar9478
    @bhaskarmazumdar9478 29 วันที่ผ่านมา +1

    Appreciate you taking the time to get into the weeds

  • @chetanpdeshpande3439
    @chetanpdeshpande3439 25 วันที่ผ่านมา +2

    This was fantastic! Thank you!

  • @sibims653
    @sibims653 หลายเดือนก่อน +1

    Greate Explanation

  • @sanjaysitaramsoni
    @sanjaysitaramsoni 13 วันที่ผ่านมา

    I really fall in love with RAG, I am a Master student and I want to do some research on RAG for my upcoming Thesis Project. Can I have some suggestion from you ? articles or publications ?
    Thanks for this video

  • @aanyaaryancoolgamers2013
    @aanyaaryancoolgamers2013 4 วันที่ผ่านมา

    Great video! where can I get the code used in the video?

  • @ionuta.5359
    @ionuta.5359 17 วันที่ผ่านมา

    Simple and clear! Thanks!

  • @BKNaveen
    @BKNaveen 19 วันที่ผ่านมา +1

    Great explanation! Is there a way i can get the code you show in the jupyter notebook please? Would like to play around with it using my dataset. That would be very helpful!

  • @jdcage
    @jdcage 12 วันที่ผ่านมา

    Great video! How did you get the content of the website? I am working on a similar project, and most of my effort seems to be scraping pages.

  • @peterezkka
    @peterezkka 29 วันที่ผ่านมา

    love it, thank you! I appreciate these videos.

  • @jacksonhanson154
    @jacksonhanson154 26 วันที่ผ่านมา +1

    Very thankful Don. It would be awesome to get some timestamps throughout the video, but this is incredible as is.

    • @dwoodlock
      @dwoodlock  21 วันที่ผ่านมา

      Ah. Good idea.

    • @dwoodlock
      @dwoodlock  7 วันที่ผ่านมา +1

      Done!

    • @jacksonhanson154
      @jacksonhanson154 7 วันที่ผ่านมา

      @@dwoodlock Awesome

  • @Themojii
    @Themojii 14 วันที่ผ่านมา +1

    Hi Don, thank you for the great video. It would be great if you could share the notebook codes 😊

  • @fazilkagdi3290
    @fazilkagdi3290 หลายเดือนก่อน +2

    Always wanted to understand how everyone all of a sudden made their own bots. Now I understand how simple it is.

  • @The_Reductionist
    @The_Reductionist 18 วันที่ผ่านมา +1

    How did you turn the website into a csv file? web-scraper? if so, which one?

  • @pjali1
    @pjali1 19 วันที่ผ่านมา

    Awesome Sir !!

  • @yogeshsuryamurthy5939
    @yogeshsuryamurthy5939 26 วันที่ผ่านมา

    Many thanks, Don. Your explanation was simple, clear and very helpful.
    To ensure that the top 5 answers are more relevant to the prompt questions, how can we verify and validate the model's output ? How can we test the bias in the data being prepared using the CSV, which is necessary to obtain the top answers?
    My other question is, how can we integrate these models in real-time? i.e. how to integrate these models into different HIS and CIS touchpoints (or any healthcare system, really), how to run and train these models, what additional computation (hardware requirements and increase in total cost of ownership) might be needed, and how to confirm User Acceptance Tests and seek customer sign-off before moving to production.

    • @dwoodlock
      @dwoodlock  21 วันที่ผ่านมา

      In terms of validation, you will need to do some of this by hand - meaning a human reading the answers and verifying that they are accurate, that they represent the right tone, and that your model isn't responding to things that are off topic and/or are dangerous. These 3 could be separate validation threads.

    • @yogeshsuryamurthy5939
      @yogeshsuryamurthy5939 15 วันที่ผ่านมา

      @@dwoodlock Thanks Don and very helpful.

  • @paultoensing3126
    @paultoensing3126 10 วันที่ผ่านมา

    So what is df?

    • @agusriyadi6802
      @agusriyadi6802 18 ชั่วโมงที่ผ่านมา

      Distance Formula I think

  • @paultoensing3126
    @paultoensing3126 10 วันที่ผ่านมา

    What is concatenate?