Vector Databases simply explained! (Embeddings & Indexes)

แชร์
ฝัง
  • เผยแพร่เมื่อ 25 ธ.ค. 2024

ความคิดเห็น • 160

  • @ChrisBrogan
    @ChrisBrogan 8 หลายเดือนก่อน +67

    I just watched an IBM explanation of vector databases and came away lost. Then I watched yours, and got it right away. Point goes to you. ;)

    • @dashmasterful
      @dashmasterful 6 หลายเดือนก่อน +1

      Same here!

    • @ajeffrrterererefdf
      @ajeffrrterererefdf 4 หลายเดือนก่อน +1

      Yep, Same story!.
      I will just paste this video link there so that someone may benefit.

    • @noneyahbiz6976
      @noneyahbiz6976 3 หลายเดือนก่อน +1

      Will not watch IBM LOL- we briefly went over vector searches in NN class- but professor was horrible-

    • @siddhubhai2508
      @siddhubhai2508 3 หลายเดือนก่อน +1

      Same here.

    • @punymagus
      @punymagus 3 หลายเดือนก่อน +2

      Same, that video is just clickbait

  • @nickstaresinic9933
    @nickstaresinic9933 ปีที่แล้ว +20

    The concise, high-level explainer that I needed. Thanks.

  • @jolly2002me
    @jolly2002me ปีที่แล้ว +40

    Yes please, more on this topic, I would appreciate it.

    • @HeyImAK
      @HeyImAK ปีที่แล้ว +1

      👆

  • @brunomesquitazamberlan8876
    @brunomesquitazamberlan8876 8 หลายเดือนก่อน +1

    Very useful. Now I can imagine what is a vector database. Thanks

  • @4XLibelle
    @4XLibelle 9 หลายเดือนก่อน +2

    Excellent overview. Many thanks!

  • @yubinnng
    @yubinnng 11 ชั่วโมงที่ผ่านมา

    Brief and clear!

  • @etownrule
    @etownrule 5 หลายเดือนก่อน +2

    Finally, a sensible explanation. Crystal clear, thanks

  • @leftright1606
    @leftright1606 ปีที่แล้ว +2

    Yes, looking forward to a more in-depth video.

  • @bobsavage3317
    @bobsavage3317 ปีที่แล้ว +121

    Yes, a video describing available VDBs in terms of, e.g. Open/Closed, simplicity of operation, and user interaction patterns (quality/expressiveness of API) would be great!

    • @ProSaladToss
      @ProSaladToss ปีที่แล้ว

      Seconded

    • @assethotorch2395
      @assethotorch2395 ปีที่แล้ว

      th-cam.com/video/Yo-AzVpWrRg/w-d-xo.html
      You may find it helpful to start with the time frame of the video above!!

    • @RomeoKienzler
      @RomeoKienzler ปีที่แล้ว

      Also important how to extend the vdb with custom distance functions

  • @lesegotsheole6008
    @lesegotsheole6008 7 หลายเดือนก่อน

    New to this world of machine learning I have to say job well done on explaining in simple terms. This was insightful and had pleasure watching it. Thanks!

  • @DanielTorres-gd2uf
    @DanielTorres-gd2uf ปีที่แล้ว +27

    Let's see the more in depth comparison! Also would love to know your take on where it will go? Are they able to automatically generate vectors for your multimodal data already? Are there known companies using vector databases currently? Are there lightweight alternatives to the services you offered? (ie. a numpy verision of a vector database?)

  • @matt_88
    @matt_88 ปีที่แล้ว +7

    Definitely! I'd love to see comparable benchmarks for common LLM and other tasks (i.e. transfer learning, use-cases in the context of fine-tuning, etc)

  • @rezaru2000
    @rezaru2000 10 หลายเดือนก่อน

    Thanks, this is what I needed to understand the overall idea of vector db.

  • @muhammadmursalin8915
    @muhammadmursalin8915 8 หลายเดือนก่อน

    Thanks, describe very simply what the vector database is and its uses.🥀

  • @maneeshs3876
    @maneeshs3876 ปีที่แล้ว +2

    Nice summary on Vector databases. A comparison of Graph and Vector databases with specific use cases would also help. Thank you

  • @Bloeise
    @Bloeise ปีที่แล้ว

    This was a very clear explanation. Thank you!

  • @caiyu538
    @caiyu538 ปีที่แล้ว +3

    Thank you Patrick.

  • @sidharthgovind4356
    @sidharthgovind4356 3 หลายเดือนก่อน

    Good explanation touching on essential parts of this topic. Well done!

  • @otto.bjorkland
    @otto.bjorkland ปีที่แล้ว +7

    It would be great if you explained how to use vector databases to give LLM's long term memory! 🙏

  • @sanjeevKumar-eg6hp
    @sanjeevKumar-eg6hp ปีที่แล้ว

    thanks for a such a detailed and easily understandable knowledge

  • @lowai8749
    @lowai8749 5 หลายเดือนก่อน

    Make complicated concept for easy understanding, thank you very much!

  • @kevinli3767
    @kevinli3767 10 หลายเดือนก่อน

    This is a really good explanation and visualization

  • @ksnydertube
    @ksnydertube ปีที่แล้ว

    Thank you for this video - just what I needed! If you haven't done one already, please do an explainer comparing. 🙏

  • @olivierrochon3858
    @olivierrochon3858 ปีที่แล้ว

    Perfectly clear. Thanks!

  • @PatrickSeidel-s5y
    @PatrickSeidel-s5y ปีที่แล้ว

    Thank you, nice and short overview to get an idea of what a vector db is.

  • @divakaratanjore1059
    @divakaratanjore1059 ปีที่แล้ว

    Awesome explanation! Thank you

  • @MrVliegendepater
    @MrVliegendepater 5 หลายเดือนก่อน

    Interested in a comparison video between the different types of vector databases! Really well explained and to the point!

  • @SoharabHossain
    @SoharabHossain 8 หลายเดือนก่อน

    Brief and to the point. Great video.

  • @jonmichaelgalindo
    @jonmichaelgalindo 10 หลายเดือนก่อน

    Straight forward and simple. Thanks! 😊

  • @p.j.816
    @p.j.816 ปีที่แล้ว

    This was a really good video! Thanks so much :)

  • @Dkay-gf8ft
    @Dkay-gf8ft หลายเดือนก่อน

    Thanks very easy to understand explaination

  • @saimanikanta7360
    @saimanikanta7360 ปีที่แล้ว

    yup!! looking forward to a detailed analysis and comparison

  • @08ae6013
    @08ae6013 ปีที่แล้ว

    Thank You... It's a great explanation on Vector database. Please make a in depth videos on Pinecone & Redis vector databases

  • @Naimish_RuuhaaniiAaVaaz
    @Naimish_RuuhaaniiAaVaaz 22 วันที่ผ่านมา

    Very good explanation.

  • @nsitkarana
    @nsitkarana ปีที่แล้ว

    to the point and concise explanation !!

  • @realjackofall
    @realjackofall ปีที่แล้ว

    Simply explained. Thanks!

  • @bjugdbjk
    @bjugdbjk ปีที่แล้ว

    Definitely need a comparisio video and small example code for the top 3 Vector DB's used !!
    By the way ,Fantastic walk through of the concept !!.

  • @mohamedbilal5634
    @mohamedbilal5634 7 หลายเดือนก่อน

    Explanation On point !!! Thanks

  • @ser1ification
    @ser1ification ปีที่แล้ว +2

    Thank you, more please :)

  • @soubinan
    @soubinan ปีที่แล้ว

    Great video! thank you!
    A big YES for a Vector DB dedicated video
    Btw I am happy I have found this channel, let's subscribe !

  • @talentzunlimited1398
    @talentzunlimited1398 5 หลายเดือนก่อน

    Great video !

  • @VastCNC
    @VastCNC ปีที่แล้ว +6

    Would definitely be interested in more details, especially on self hosted VDBs

  • @karthickmj6312
    @karthickmj6312 ปีที่แล้ว

    Thank you so much, Patrick. Would love to watch a video detailing and comparing all VDBs.

  • @Maisonier
    @Maisonier ปีที่แล้ว

    Yes please a video about that. Liked and subscribed

  • @ednavas8093
    @ednavas8093 ปีที่แล้ว

    Incredible video

  • @khari_baat
    @khari_baat ปีที่แล้ว

    Good informative video. Thanks!

  • @ryansteiger6960
    @ryansteiger6960 ปีที่แล้ว

    Thanks for the video 👍

  • @asifmian43
    @asifmian43 ปีที่แล้ว

    I would love to see a comparison of the different Vector Databases!

  • @beemerrox
    @beemerrox ปีที่แล้ว

    Good explanation. Thumbs up 👍

  • @Nega_Samurai
    @Nega_Samurai ปีที่แล้ว

    That was very helpful! Thank you!

  • @bindass1000
    @bindass1000 11 หลายเดือนก่อน

    Super helpful!

  • @jaylee7864
    @jaylee7864 ปีที่แล้ว

    Thanks for the Video. you are awesome and very easy to understand what they are. I think Pinecone is quite popular so if there is a video about it, it would be great. Cheers

  • @nikilragav
    @nikilragav 10 หลายเดือนก่อน

    This is a great explanation. But the indexing part is what I was looking for. Nearest neighbor search is already a hard problem in Computer Graphics and gaming (to detect collisions. E.g. if you ever play Madden and do a slow-mo replay, you'll see that the receiver never actually touches the ball. or E.g. cloth simulations for a cape often "clip" into the 3d model of the person wearing the cape).

  • @TeamUpWithAI
    @TeamUpWithAI ปีที่แล้ว

    Thanks for putting this together! :)

  • @ilikegeorgiabutiveonlybeen6705
    @ilikegeorgiabutiveonlybeen6705 7 หลายเดือนก่อน

    yeah nitty gritty indexing options overview and use cases for said options would be higlhy appreciated

  • @sailendramishra1560
    @sailendramishra1560 6 หลายเดือนก่อน

    Short video but very useful

  • @YogeshVerma-f3e
    @YogeshVerma-f3e 11 หลายเดือนก่อน

    An in-depth comparison would be great!

  • @alexfowler1683
    @alexfowler1683 ปีที่แล้ว

    Great video, thanks! Short and exactly on point -- much appreciated.
    Yeah, it'd be cool to see more in-depth comparison of the dbs.

  • @vincerocchi9083
    @vincerocchi9083 ปีที่แล้ว +2

    Love your work Patrick. Definitely would like to see more on vector databases, especially when you would use one over an array or other options and the pros and cons of some of the types you mentioned (I.e. Pinecone, Milvus, etc.)

  • @dabravo100
    @dabravo100 ปีที่แล้ว

    Great video… please go on with the next one

  • @mbrochh82
    @mbrochh82 ปีที่แล้ว

    comparison video for the mentioned VDBs at the end would indeed be awesome!

  • @anirudhgangadhar6158
    @anirudhgangadhar6158 ปีที่แล้ว

    Great intro to VD! Would love to see a more in-depth video on some real-world use cases :)

  • @jessem2176
    @jessem2176 ปีที่แล้ว

    I would love to see.. what is the Best Vector database... ease of use vs performance. and why. This way we can stop guessing which one to try to use and just know this one is by Standard the best.

  • @katsunoi
    @katsunoi ปีที่แล้ว

    nice video - thanks!

  • @ayoubthegreat
    @ayoubthegreat ปีที่แล้ว

    I love the video. One critique would be to set up further away from the background to possibly reduce the reverb you're getting

  • @OP-g7g
    @OP-g7g หลายเดือนก่อน

    Can you share the pros and cons of all the vector databases you mentioned in this video. Which one to choose and why?

  • @Anonymous-lw1zy
    @Anonymous-lw1zy ปีที่แล้ว

    Yes please, a VDB comparison would be great, and please include FAISS and other self-hosted options.

  • @hughesadam87
    @hughesadam87 ปีที่แล้ว

    Great video thank you!

  • @MyWissam
    @MyWissam 7 หลายเดือนก่อน

    Yes for a comparison video.

  • @decodingdatascience
    @decodingdatascience ปีที่แล้ว

    🎯 Key Takeaways for quick navigation:
    00:41 📊 Vector databases store Vector embeddings for fast retrieval and similarity search.
    01:07 📝 Unstructured data like images, text, and audio can be challenging to store in relational databases, making vector databases valuable.
    02:02 🔍 Vector embeddings allow for finding similar items by calculating distances and performing nearest neighbor searches.
    03:10 🗂️ Vector databases have various use cases, including equipping language models with long-term memory, semantic search, similarity search, and recommendation engines.
    03:50 💽 Examples of vector database options include Pinecone, Chroma, Redis, Cool, Trans, Milvus, and Vespa AI, each with its strengths and capabilities.

  • @satyamvishuu
    @satyamvishuu 6 หลายเดือนก่อน

    Thanks man

  • @nickmhc
    @nickmhc ปีที่แล้ว

    A breakdown of differences between vector databases would be nice. But also a comparison to graph databases like neo4j and TitanDB et al would help this n00b

  • @RanitDA
    @RanitDA ปีที่แล้ว

    Good topic 🎉

  • @SubirSengupta1
    @SubirSengupta1 ปีที่แล้ว +6

    I would love to see a comparison of the different VDB's and perhaps your thoughts on which one or two are the best. Thanks for a great video.

  • @davidlepold
    @davidlepold ปีที่แล้ว +2

    It could be interesting to see a case of adding a vector dbase to an existing sql database, if it can replace it, or if a parallel approach might be interesting, using them side by side, each taking advantage of strenghts. etc.

  • @fnmby
    @fnmby 9 หลายเดือนก่อน

    Please continue..)

  • @SonGoku-pc7jl
    @SonGoku-pc7jl ปีที่แล้ว

    thanks, you have a video for the comparate diferences quality between?

  • @WmSadler
    @WmSadler ปีที่แล้ว

    woud love to see detailed comparison of the vector databases

  • @VaibhavPatil-rx7pc
    @VaibhavPatil-rx7pc ปีที่แล้ว

    Cool, please explain more details about each vector db thanks

  • @lancerkind
    @lancerkind 10 หลายเดือนก่อน

    I would enjoy seeing a comparison among these different vector databases. Today I just picked the one that’s most convenient. But there’s probably a better rationale for choosing among them. The other topic I’d like to see is sustainability. For example, if I’m adding a new vector to the database once a week what will happen after 10 years? Is that a sustainable growth when I have a 1016 element vector everyweek of the year or do I need to do something to re-index the database so that my performance doesn’t drop after a number of years?
    The data I’m creating now would be relevant for many decades.

  • @DineshSharma-ch1hi
    @DineshSharma-ch1hi 5 หลายเดือนก่อน

    Thanks for the video. I have a combination of structured and unstructured data like a set of PDFs and Excel files, and I want to index this data and query from this data source. Any recommendations on what is the suitable vector database for me?

  • @hughster657
    @hughster657 ปีที่แล้ว +2

    Why isn't KX mentioned in this overview? They have a very strong vector database and support time-series data as well. Formula 1, manufacturing, utilities, and all the banks use them.

  • @hammanadamafarukabubakar8365
    @hammanadamafarukabubakar8365 ปีที่แล้ว

    Great one

  • @MartinQLynx
    @MartinQLynx ปีที่แล้ว

    Supabase also joined the vector DB club a while ago.

  • @MatthewShang
    @MatthewShang ปีที่แล้ว

    It would be great to see a comparison of the vector database companies

  • @vamc256
    @vamc256 ปีที่แล้ว

    Please explain further, any one of the vector databases with an example for each Weaviate, Pinecone..

  • @pascalmartin1891
    @pascalmartin1891 ปีที่แล้ว

    I remember working on a vector database in the mid 1980s. That was a Pick system, mostly used for accounting, warehouse management and the like. Re-innovation. 😁

  • @darrylcatay2295
    @darrylcatay2295 ปีที่แล้ว

    I say what Bob says. Thanks Bob.

  • @PaperTigerLive
    @PaperTigerLive ปีที่แล้ว +1

    Very helpful animations:)
    How did you do them with exalidraw, if I may ask?

  • @slawikus1982
    @slawikus1982 ปีที่แล้ว

    Thanks for a nice video!
    Would be great to learn more on how one could use Redis and PostgreSQL as vector databases.
    Additionally, more examples and use cases for vector databases would be cool.

  • @ilikegeorgiabutiveonlybeen6705
    @ilikegeorgiabutiveonlybeen6705 7 หลายเดือนก่อน

    good video

  • @PrashantKataria-g7t
    @PrashantKataria-g7t ปีที่แล้ว

    Could you provide an overview on the comparison of different Vector Database providers and how to decide which is better?

  • @angeloinvestor
    @angeloinvestor ปีที่แล้ว

    You would need to upload ur own embeddings to these db though? Or do they calculate it for you in a multimodal way? Pinecone seems like the former? If so, why not just host locally in your Postgres?

  • @harshjain3122
    @harshjain3122 ปีที่แล้ว +2

    This is like that scene from the Matrix where Neo stops the bullets and he sees the Matrix(humans, objects alike) as lines of code.
    We are now converting objects like banana and apples into a bunch of numbers which even we can no longer understand looking at them via the vector embedding.

  • @soujanya1993
    @soujanya1993 6 หลายเดือนก่อน

    Please create a video comparing the vector databases

  • @smartfusion8799
    @smartfusion8799 ปีที่แล้ว

    Yes please, i habe to decide soon which database, redisearch is cloud only, pinecone too i think

  • @DanielNiklaus
    @DanielNiklaus ปีที่แล้ว

    Yes, please.

  • @pavlotriantafyllides5687
    @pavlotriantafyllides5687 ปีที่แล้ว

    Would love an explanation of indexing and how to use this with an LLM

  • @SonGoku-pc7jl
    @SonGoku-pc7jl ปีที่แล้ว

    you can make a mor explication of diferences and optimitzacions cases :) thanks!

  • @UDAY-pv5il
    @UDAY-pv5il ปีที่แล้ว

    Great content.I noticed the Elastic name is missing from the list of vector databases. Could you please include it in the list?