Great stuff Volo! Really liked the last part "query RAG tips / limitations". Often overlooked but super valuable to mention all the traps and limitations. Nicely Done!
I might not have noticed if it is mentioned in the video, but adding a 'do not generate any SQL script for deleting or truncating' statement would be safer. Thanks for this good video.
This is actually a very important topic but I only touched on it when mentioning security in general - so I'm glad you brought it up. It's *not* enough to ask the LLM to avoid those statements. You should make sure the db user you are using for this has *only* read access to the data. Otherwise, you run the risk of someone prompt injecting and forcing a table drop anyway (even if you prompt the AI not to do it).
Thanks, Jason! Yeah this is a fairly advanced topic but I figured I could share some knowledge with those who are trying to implement such systems. Will try to make something more for beginner/intermediate next!
could you build an app that uses RAG with PDF uploads? And perhaps incorporate a workflow system like Inngest and an eval tool like Langsmith. Would be awesome to see!
I do want to make a document-based RAG tutorial at some point. I got turned off from these frameworks after trying langchain a while back because it just felt like overcomplicating and adding arbitrary abstractions on top of simple APIs. Not sure about the newer generation of them though. Might be a good time to check it out. Thanks for the suggestion!
I have created the standard vector database but not this type and I am not a database person so I am confused about the database these tables are getting added to. Did already have an empty database with no tables and each csv file adds a custom table into the database?
Yep, you got it! I have postgres (a relational SQL database) installed on my computer and I am connecting to it in my code. For demo purposes, I wrote code to load data from uploaded csvs into tables within that database.
Great stuff Volo! Really liked the last part "query RAG tips / limitations". Often overlooked but super valuable to mention all the traps and limitations. Nicely Done!
Thanks KeMis! Glad it was helpful :)
Exactly what I was looking for! Thanks a lot, great video!
That's awesome! Glad it was helpful!
I might not have noticed if it is mentioned in the video, but adding a 'do not generate any SQL script for deleting or truncating' statement would be safer. Thanks for this good video.
This is actually a very important topic but I only touched on it when mentioning security in general - so I'm glad you brought it up. It's *not* enough to ask the LLM to avoid those statements. You should make sure the db user you are using for this has *only* read access to the data. Otherwise, you run the risk of someone prompt injecting and forcing a table drop anyway (even if you prompt the AI not to do it).
You are absuletly right. @@VoloBuilds
Very informative!!
Thank you!
Thanks for the video! A little advanced for my skill set but definitely packed with excellent information! Thanks!! Jason
Thanks, Jason! Yeah this is a fairly advanced topic but I figured I could share some knowledge with those who are trying to implement such systems. Will try to make something more for beginner/intermediate next!
@ Awesome thank you! 🙏
@ I’m actually trying to recreate your discord bot using cursor. Just started this morning.
@@SouthbayCreations That's awesome! Good luck!
@ Thank you
Amazing Video. Super useful. Very well explained. Thanks ..!!
Thanks, Amar!
Great video 👌
Thank you!
Thank you sir
Very welcome!
Thanks :)
You got it! :)
could you build an app that uses RAG with PDF uploads? And perhaps incorporate a workflow system like Inngest and an eval tool like Langsmith. Would be awesome to see!
I do want to make a document-based RAG tutorial at some point. I got turned off from these frameworks after trying langchain a while back because it just felt like overcomplicating and adding arbitrary abstractions on top of simple APIs. Not sure about the newer generation of them though. Might be a good time to check it out. Thanks for the suggestion!
Hey Volo, I’d love to hear your thoughts on that new Windsurf IDE. Wonder if it’s a better option than Cursor. Thanks! Jason
Hadn't heard of it - thanks for letting me know, will check it out at some point!
@ It’s just barely breaking into the scene. Definitely jump on it, seems to be the hot topic. It’s from Codeium
Hey Jason, I checked it out and it was very good! Here's my video on it: th-cam.com/video/ouT8ItvJla8/w-d-xo.html
@ I’m actually watching it right now, thank you!! Jason
I have created the standard vector database but not this type and I am not a database person so I am confused about the database these tables are getting added to. Did already have an empty database with no tables and each csv file adds a custom table into the database?
Yep, you got it! I have postgres (a relational SQL database) installed on my computer and I am connecting to it in my code. For demo purposes, I wrote code to load data from uploaded csvs into tables within that database.