Yes.....understanding more AI integration with sequel databases as a component of an AI app would be great. n00b to sql so ability to work with SQL using NLP through AI is great. Need to understand examples of some of the stuff you automated at the beginning of the video and then also working more with the DB either programmatically or agenticly. Thx!
You're welcome! Thanks for the suggestion! I am actually planning on creating a video in the near future where I fork Swarm and make it possible to use local (open source) LLMs!
Thank you for easy understanding of swarm framework. So it's basically langchain but it's radically simple and easy to use. I don't like it makes many OpenAI API calls on every step but oh well, that's their business I guess. I think it'll be matter of time until someone makes it compatible with other LLM services and local models.
I'm glad you found it easy to understand! Yes, that's a great way to think about it. Since Swarm is open source, you can make your own version to use local LLMs so you aren't paying for every step of the way. That is something I am going to do myself and make a video on!
Consider these actionable insights from the video: 1. Explore OpenAI's Swarm framework as a new way to manage and interact with your SQL databases. 2. Understand the concept of specialized AI agents and how they collaborate within the Swarm framework. 3. Identify areas within your data management workflow where specialized AI agents could improve efficiency and accuracy. 4. Visit the provided resource links to learn more about Swarm, explore examples, and access documentation. 5. Experiment with building your own network of specialized AI agents using Swarm's Python library.
Thank you for the nice video. Is the any solution for asking complex questions which should trigger several agents and combine the answers back. For example asking about count of users and popular categories in one prompt?
My pleasure! And fantastic question! You could certainly extend this application to handle that sort of thing. You could change up the prompt to the router by telling it that some requests will need to be handled by more than one agent. Then you instruct each agent to pass control back to the router after it provides its part of the answer so the router can route to the next agent to continue/finish the answer. I hope that makes sense! Definitely a more complex implementation but it is certainly possible.
Great content! Could we mix Swarm with Langchain and create Agents that execute many tools? I mean by having one main agent to not overwhelm the LLM and others with specific tools? (Actually, isn’t it similar to Crew ai?)
Thank you and I love your thoughts here, Arthur! Swarm does a lot of what LangChain would typically do to help you with a multi-agent setup. But you could still certainly integrate the two together to create something really robust using more complex chains made possible by LangChain! This is pretty similar to Crew AI, though I like LangChain and Swarm more because I find it easier to use and customize than Crew AI.
Hi Colin, I really appreciated your video, which explains much better than others that specific retrieval needs can be encapsulated within a dedicated agent acting as a domain expert. By the way, it comes to mind that classical LLM-RAG could be implemented by delegating the retrieval part to a Retrieval Agent that could search not only in relational databases but also in various types of documents. It would be interesting to see how a complex user query (say, involving multiple source searches) could be resolved by a multi-agent system that also shares data among agents using context variables. I’d stay with SWARM because it’s so nice and simple. Additionally, I wrote an article titled "SWARMing Conversational AI: Integrating No-Code and Code in Agent-Based Workflows," which you can find online. I would love to hear your feedback on my perspective. Thanks again! Giorgio
Love your thoughts here Giorgio, thank you!! I'm actually working on more complex agents similar to what you are describing right now! Could you send a link to that article you wrote?
@@ColeMedinunfortunately is not possible to insert links here, but I already sent the link of my article on your other social net contacts. Could you double-check? Thanks
Thank you for such wonderful content! I got a similar video today. They don't explain it as well as you do. I have a high opinion of you. Look forward to sharing the next AI platform
@Cole - I’m struggling to understand how the sql statements that are generated get passed around between the agents and functions. I see references to context_variables in some of the examples…but this seems to be generally glossed over. I’m working on an agent that will collect HelpDesk ticket info in order to then call a function that will make an API call to the HelpDesk platform. Can’t quite figure out how to set and then pass along the specific fields I need to set on the API call.
So the agents don't actually pass the SQL statements to agents, per say. The router agent just takes the request and decides which agent to then get to generate the SQL statement. But the entire conversation is all in one place so whatever agent currently has control does get to see what decisions the other agents have made if that makes sense?
I really like the way Swarm lets you compose groups of agents like this. It feels a lot easier than LangGraph/Chain. Is there an easy way to use this with a local LLM like ollama?
Yeah I agree! I think LangChain/LangGraph is more customizable but Swarm definitely gets you up and running faster. Swarm only lets you use GPT right now, but since the library is open source, you can easily make your own version to use Ollama under the hood for the LLM instead! I am actually probably going to do this myself and make a video on it.
i was wondering if you would ever make a tutorial on how to create a custom node for n8n? since i want to create a playwright node and improved node for anthropic claud that allows me to input images - like chatgpt vision. i havent found anything good on the internet to showcase the how to make a custom node everything seems outdated or overly too complicated.
I appreciate you asking! I haven't actually made a custom node in n8n yet, but I have spent a good amount of time researching how to do it since that level of customizability in a platform is important to me. Once I have a need to make a custom node, I will 10000% make a video on how I did it!!
Great question! What VRSEN has built with Agency Swarm is awesome. I would say that Swarm is comparable in performance but I found Swarm easier to use. Granted I haven't set up the exact same set of agents on both, but that's just my general experience!
Swarm and LangGraph are similar in the sense that they can both be used to orchestrate different AI agents! Swarm is easier to use but LangGraph is more flexible and can be used to orchestrate entire workflows with AI agents as just a part of them, so you can do a lot more!
@@ColeMedin The '/' key on Turkish keyboard is combined to Shift and 7 keys together. So it did not work for me. Then I've switched to ENG US keyboard layout and now it is working. Thanks. This small information would be helpful to other people!:)
You just forked Bolt can you add this to it? But using obviously OpenAI, but also Claude, Mistral through API. Then Ollama to run with this also Swarm is opensource. Then you will be the most Best Architect Coder ever. I am already using Swarm and it is damn good. But I want to see it work with other models...
So I actually am looking into developing an agent platform behind the scenes with my Bolt.new fork to get better results, especially for those smaller local models that don't always open up the webcontainer as many people have noticed! And I could certainly use Swarm for that to use something already out there that is open source. Thanks for the suggestion - I seriously love it!
@@ColeMedin Please do it. I will donate 500 USD to your channel. I want to use your bolt so that online models talk to offline models and the both communicate in the SWARM framework, through an API.
yeah PayPal or patreon which ever you prefer. I will send you the interface if you want. I am doing all this for the I am AuRa Foundation. Online model API + Offline model + Swarm framework to work with both. That is basically 01 + Sonnet. Llama 405B and its variants truly are amazing.
Sounds fantastic!! My PayPal is @ColeMedin, and I certainly don't expect anything, especially before I put out content on this! But I am at this point confident I'll be implementing this within the next month and making content around it, especially with your support!
GREAT question, I appreciate you asking! It doesn't out of the box, BUT since Swarm is open source, you can easily change it to work with Ollama as well. I am considering making a video on this!
Yeah you're right it's not truly a complex query! But it's more than a simple SELECT so it worked for my demonstration. I will certainly be testing it out with more complex database structures in the future, just had to start with something reasonably simple!
Hi, about my previous comment, unfortunately it is not possible here, but I already sent on other your public contacts. Or please search on the web the title? Thanks
Good question! CrewAI is a similar tool but from my experience (and it's limited because Swarm is new!) Swarm is easier for me to use. Performance is similar but the developer experience is really important to me too.
There are some similarities! But LangGraph does less out of the box. It's more customizable for creating agentic workloads but you have to do a lot more of the work yourself with agents you set up with LangChain (or a similar/custom framework).
Interesting! kyegomezb's Swarms looks quite different than OpenAI's Swarm, and agentic orchestration tools are such an obvious and important idea that it doesn't seem clear to me it is a copy. Maybe there is more to it though!
@@ColeMedin yep i can't find which part is the copy... well I'm not coder... however if this doesn't end well... in my opinion big companies should and maybe must be able to nurture open source developers... without that kind of support open source will be felt like nasty bottom tier of stepping stones where every developers hitting each other's just to survive sad
@@ColeMedin actually what i mean is AI learning and growing on these logical structures itself INSTEAD of us taking that ability from it...its counter-intuitive.
Oh I see what you mean! I think there is a time and place for both. Because sometimes having it write SQL instead of ingesting the documents is necessary since it can't always take in enough context to answer the question but a SQL query can get the answer. Let me know if I'm still misunderstanding you!
for me, just trying to understand swarm alone is already a challenge but then to be overwhelmed with sql is too much for one tutorial. i think a simpler example to just illustrate swarm would have been better, especially for an introduction. but thanks though.
I totally understand, thank you for being honest with your feedback here! I was debating what kind of solution I wanted to make with Swarm and I did consider going with something much simpler, but I'm also thinking people want to see Swarm do something more than the basics because they already have for other agent frameworks. Considering what you're saying though, I am planning more content in the future that keeps things to a true introductory level just to lay the foundation really well for topics I cover on my channel!
Thanks for the great video with links and no ebook or course selling. You will grow fast.
My pleasure - thank you man!!
I have been using this for days. It is so powerful. I have built so many AI agents.
That's fantastic - I'm glad to hear!!
Please can we connect?!
I'm begginer in learning ai agent.
I will be glad if you can accept offer.
Thank you for such great content mate! There’s so much fluff out there, I’m so grateful for you sharing your knowledge.
You're welcome - it's my pleasure! 😀
Well done creator... Indeed the custodian of the data! When I grow up, I wanna be just like you! ❤
I appreciate it a lot Christian! Thank you!
Yes.....understanding more AI integration with sequel databases as a component of an AI app would be great. n00b to sql so ability to work with SQL using NLP through AI is great. Need to understand examples of some of the stuff you automated at the beginning of the video and then also working more with the DB either programmatically or agenticly. Thx!
Hey Cole, discovered your channel a couple of days ago and I love i. Keep up the good work.
Thank you very much - I sure will!
Thanks for this. I've been creating my own sql db's for the past few months. I think I'm gonna try sqllite, and pstgresql as the next stepping stones.
You bet! Sounds great man! 😄
Have a sub for doing sponsorship right and staying open with your code.
Thank you very much! :D
Thanks for this overview. Can you make a similar product with Open Source model so we can compare version?
You're welcome! Thanks for the suggestion!
I am actually planning on creating a video in the near future where I fork Swarm and make it possible to use local (open source) LLMs!
Thanks, a very good intro into swarm. Directly useable 😊
That's certainly the goal - thank you!
Thank you for easy understanding of swarm framework. So it's basically langchain but it's radically simple and easy to use.
I don't like it makes many OpenAI API calls on every step but oh well, that's their business I guess.
I think it'll be matter of time until someone makes it compatible with other LLM services and local models.
I'm glad you found it easy to understand! Yes, that's a great way to think about it.
Since Swarm is open source, you can make your own version to use local LLMs so you aren't paying for every step of the way. That is something I am going to do myself and make a video on!
@@ColeMedinPlug this into bolt? 🎉
Haha I have thought about it for sure!! Either Swarm or another agent framework I will for sure.
Consider these actionable insights from the video:
1. Explore OpenAI's Swarm framework as a new way to manage and interact with your SQL databases.
2. Understand the concept of specialized AI agents and how they collaborate within the Swarm framework.
3. Identify areas within your data management workflow where specialized AI agents could improve efficiency and accuracy.
4. Visit the provided resource links to learn more about Swarm, explore examples, and access documentation.
5. Experiment with building your own network of specialized AI agents using Swarm's Python library.
I love it, thanks for calling all of these out!
Thank you for the nice video.
Is the any solution for asking complex questions which should trigger several agents and combine the answers back. For example asking about count of users and popular categories in one prompt?
My pleasure! And fantastic question!
You could certainly extend this application to handle that sort of thing. You could change up the prompt to the router by telling it that some requests will need to be handled by more than one agent. Then you instruct each agent to pass control back to the router after it provides its part of the answer so the router can route to the next agent to continue/finish the answer.
I hope that makes sense! Definitely a more complex implementation but it is certainly possible.
Great content! Could we mix Swarm with Langchain and create Agents that execute many tools? I mean by having one main agent to not overwhelm the LLM and others with specific tools? (Actually, isn’t it similar to Crew ai?)
Thank you and I love your thoughts here, Arthur!
Swarm does a lot of what LangChain would typically do to help you with a multi-agent setup. But you could still certainly integrate the two together to create something really robust using more complex chains made possible by LangChain!
This is pretty similar to Crew AI, though I like LangChain and Swarm more because I find it easier to use and customize than Crew AI.
Hi Colin,
I really appreciated your video, which explains much better than others that specific retrieval needs can be encapsulated within a dedicated agent acting as a domain expert. By the way, it comes to mind that classical LLM-RAG could be implemented by delegating the retrieval part to a Retrieval Agent that could search not only in relational databases but also in various types of documents.
It would be interesting to see how a complex user query (say, involving multiple source searches) could be resolved by a multi-agent system that also shares data among agents using context variables. I’d stay with SWARM because it’s so nice and simple.
Additionally, I wrote an article titled "SWARMing Conversational AI: Integrating No-Code and Code in Agent-Based Workflows," which you can find online. I would love to hear your feedback on my perspective.
Thanks again!
Giorgio
Love your thoughts here Giorgio, thank you!! I'm actually working on more complex agents similar to what you are describing right now!
Could you send a link to that article you wrote?
@@ColeMedinunfortunately is not possible to insert links here, but I already sent the link of my article on your other social net contacts. Could you double-check? Thanks
@@ColeMedin unfortunately it is not possible here, but I already sent on other your public contacts. Or please search on the web the title. Thanks
Will do!
FYI I took a look - I love it Giorgio!
Awesome video Cole!
Thank you Pascal!
Thank you for such wonderful content! I got a similar video today. They don't explain it as well as you do. I have a high opinion of you. Look forward to sharing the next AI platform
Thank you so much for the kind words, that means a lot to me! 😃
@Cole - I’m struggling to understand how the sql statements that are generated get passed around between the agents and functions. I see references to context_variables in some of the examples…but this seems to be generally glossed over. I’m working on an agent that will collect HelpDesk ticket info in order to then call a function that will make an API call to the HelpDesk platform. Can’t quite figure out how to set and then pass along the specific fields I need to set on the API call.
So the agents don't actually pass the SQL statements to agents, per say. The router agent just takes the request and decides which agent to then get to generate the SQL statement. But the entire conversation is all in one place so whatever agent currently has control does get to see what decisions the other agents have made if that makes sense?
I really like the way Swarm lets you compose groups of agents like this. It feels a lot easier than LangGraph/Chain. Is there an easy way to use this with a local LLM like ollama?
Yeah I agree! I think LangChain/LangGraph is more customizable but Swarm definitely gets you up and running faster.
Swarm only lets you use GPT right now, but since the library is open source, you can easily make your own version to use Ollama under the hood for the LLM instead! I am actually probably going to do this myself and make a video on it.
Do you do custom work for clients?
Indeed I do! If you're interested, feel free to reach out to me at cole@dynamous.ai
Greate effort and content. Thank you very Much.
Thank you very much - my pleasure! :D
Good Information
Thanks!
My pleasure - thank you so so much for your support!! 😀
Thank you for not doing the bare minimum of just reviewing code, instead doing a proper demo.
You bet man!! Thanks for the kind words!
i was wondering if you would ever make a tutorial on how to create a custom node for n8n? since i want to create a playwright node and improved node for anthropic claud that allows me to input images - like chatgpt vision. i havent found anything good on the internet to showcase the how to make a custom node everything seems outdated or overly too complicated.
I appreciate you asking! I haven't actually made a custom node in n8n yet, but I have spent a good amount of time researching how to do it since that level of customizability in a platform is important to me.
Once I have a need to make a custom node, I will 10000% make a video on how I did it!!
Better than agency swarm from vrsen?
Great question! What VRSEN has built with Agency Swarm is awesome. I would say that Swarm is comparable in performance but I found Swarm easier to use. Granted I haven't set up the exact same set of agents on both, but that's just my general experience!
great concise content!
Glad you enjoyed it - thank you! :)
can you tell me about the difference between langgraph and swarm both are looking similar i think it is a combination of crewai and langgraph
Swarm and LangGraph are similar in the sense that they can both be used to orchestrate different AI agents! Swarm is easier to use but LangGraph is more flexible and can be used to orchestrate entire workflows with AI agents as just a part of them, so you can do a lot more!
Great video
Thanks Austin - I appreciate it man!
08:10 Chat2DB AI invoke... I've pressed to '/' for open NLM but it does not work. Which keys do you press ?
The slash key to the left of the shift key! Make sure you are within the scripting window on the right side before you press it!
@@ColeMedin The '/' key on Turkish keyboard is combined to Shift and 7 keys together. So it did not work for me. Then I've switched to ENG US keyboard layout and now it is working. Thanks. This small information would be helpful to other people!:)
You just forked Bolt can you add this to it? But using obviously OpenAI, but also Claude, Mistral through API. Then Ollama to run with this also Swarm is opensource. Then you will be the most Best Architect Coder ever. I am already using Swarm and it is damn good. But I want to see it work with other models...
So I actually am looking into developing an agent platform behind the scenes with my Bolt.new fork to get better results, especially for those smaller local models that don't always open up the webcontainer as many people have noticed! And I could certainly use Swarm for that to use something already out there that is open source. Thanks for the suggestion - I seriously love it!
@@ColeMedin Please do it. I will donate 500 USD to your channel. I want to use your bolt so that online models talk to offline models and the both communicate in the SWARM framework, through an API.
Wow that's very generous of you, thank you so much! It'll take some time to develop it but I do have it in the pipeline because yeah it'll be huge!
yeah PayPal or patreon which ever you prefer. I will send you the interface if you want. I am doing all this for the I am AuRa Foundation. Online model API + Offline model + Swarm framework to work with both. That is basically 01 + Sonnet. Llama 405B and its variants truly are amazing.
Sounds fantastic!! My PayPal is @ColeMedin, and I certainly don't expect anything, especially before I put out content on this! But I am at this point confident I'll be implementing this within the next month and making content around it, especially with your support!
We were getting some errors when transferring back to the master agent. Did you experience this?
I didn't actually - I'm sorry you're running into that! What are the errors exactly?
does swarm work with ollama too?
GREAT question, I appreciate you asking!
It doesn't out of the box, BUT since Swarm is open source, you can easily change it to work with Ollama as well. I am considering making a video on this!
Single join isn't complex query, feed it proper monolith faked database and see if it works then.
Yeah you're right it's not truly a complex query! But it's more than a simple SELECT so it worked for my demonstration. I will certainly be testing it out with more complex database structures in the future, just had to start with something reasonably simple!
Good content
Thank you man!
This is so good!
Thank you!! :D
Hi, about my previous comment, unfortunately it is not possible here, but I already sent on other your public contacts. Or please search on the web the title? Thanks
I'll give it a search! Thanks!
What about crew AI?
Good question! CrewAI is a similar tool but from my experience (and it's limited because Swarm is new!) Swarm is easier for me to use. Performance is similar but the developer experience is really important to me too.
Looks a lot like LangGraph
There are some similarities! But LangGraph does less out of the box. It's more customizable for creating agentic workloads but you have to do a lot more of the work yourself with agents you set up with LangChain (or a similar/custom framework).
OMG RSS is still alive
Haha maybe not for everyone but it is for me!
any one heard kyegomezB said openai swarm use his idea? x post kyegomezb swarms
Interesting! kyegomezb's Swarms looks quite different than OpenAI's Swarm, and agentic orchestration tools are such an obvious and important idea that it doesn't seem clear to me it is a copy. Maybe there is more to it though!
@@ColeMedin yep i can't find which part is the copy... well I'm not coder... however if this doesn't end well... in my opinion big companies should and maybe must be able to nurture open source developers... without that kind of support open source will be felt like nasty bottom tier of stepping stones where every developers hitting each other's just to survive sad
Yeah very true!
this is not that productive vs training seperate ai's directly.
Could you expand on what you're saying here? I'm curious :)
@@ColeMedin actually what i mean is AI learning and growing on these logical structures itself INSTEAD of us taking that ability from it...its counter-intuitive.
Oh I see what you mean! I think there is a time and place for both. Because sometimes having it write SQL instead of ingesting the documents is necessary since it can't always take in enough context to answer the question but a SQL query can get the answer. Let me know if I'm still misunderstanding you!
for me, just trying to understand swarm alone is already a challenge but then to be overwhelmed with sql is too much for one tutorial. i think a simpler example to just illustrate swarm would have been better, especially for an introduction. but thanks though.
I totally understand, thank you for being honest with your feedback here!
I was debating what kind of solution I wanted to make with Swarm and I did consider going with something much simpler, but I'm also thinking people want to see Swarm do something more than the basics because they already have for other agent frameworks.
Considering what you're saying though, I am planning more content in the future that keeps things to a true introductory level just to lay the foundation really well for topics I cover on my channel!