CrewAI + Exa: Generate a Newsletter with Research Agents (Part 1)
ฝัง
- เผยแพร่เมื่อ 31 ก.ค. 2024
- In this tutorial, we will guide you through the process of creating an automation using CrewAI that uses a team of AI autonomous research agents. These agents will search the internet for the most recent news about any topic you desire, curate and summarize them, and then generate a newsletter with the latest news for your subscribers. The application will also feature a graphical user interface, allowing you and others to easily use it.
------------------------------------
LINKS
- Check out Exa: exa.ai/
- Check out CrewAI: crewai.com
- Github Repository: github.com/alejandro-ao/exa-c...
- Install conda: conda.io/projects/conda/en/la...
☎️ Get something like this for your company: link.alejandro-ao.com/consult...
👉 Check out the second part of this tutorial (build the GUI): • Build a Web App (GUI) ...
👉 Check out the article with the links to GitHub and other: alejandro-ao.com/crewai-with-...
👉 Buy me a coffee... or a beer (thanks): buymeacoffee.com/alejandro.ao
👉 Become a member of the channel for early access. Alternatively, you can become a Patreon here: / alejandro_ao
------------------------------------
The video will cover the following topics, with the corresponding timestamps:
00:00 - Introduction
2:36 - Installing CrewAI
4:55 - Project Structure
6:59 - How to plan a Crew
14:52 - Prompt Engineering
24:46 - Your main Crew class
33:18 - What is Exa?
37:46 - Create Research Tools
53:45 - Add inputs
58:56 -Debugging
1:03:54 - Run any LLM
1:14:20 - Store each Step Output
1:21:16 - Conclusion
In this automation, we will be using the following keywords and technologies: CrewAI, Automation, ChatGPT, OpenAI, LangChain, Multi-Agent Systems, AI Agents, Autonomous Agents, Streamlit, and Graphical User Interface (GUI) for AI.
By the end of the video, you will have a solid understanding of how to create and run an automation using CrewAI that leverages the power of multiple AI agents. You will also learn how to write effective prompts for the agents' tasks, how to implement the agents and tasks in the project's code, and how to create and use tools that the agents can utilize to accomplish their tasks.
📌You are all great. Let me know what you want to see next!
- Check out the second part of this tutorial (build the GUI): th-cam.com/video/vhbfs38XmKk/w-d-xo.html
- Check out the article with the links to GitHub and other: alejandro-ao.com/crewai-with-exa-research-agent-newsletter/
- Check out Exa: exa.ai/
- Check out CrewAI: crewai.com
Hey great video. Could you make a tutorial about langgraph too? I have been looking for a good tutorial but most are either way too basic or way too advanced. I love the way you teach so would love to see a tutorial from you
SUCH A DETAILED WALKTHROGH ...NEVER SEEN SUCH A CLARITY VIDEO.. THANKS LOTTT
it's my pleasure!
Awesome!
muito bom, 👏👏👏👏👏👏👏👏👏
muito obrigado!
Thanks!
You are amazing, thank you!
Hey alejandro I really love this tutorial and I was wondering what would you change or add such that I get daily newsletters at 8AM for instance for a specific topic like LLMs? This is something I'd like to add but not sure whats the approach to do so
Cool.
you are
Thank you Alejandro for this truly remarkable presentation that you give us every time! One question: does your knowledge extend to knowing how to code in python and make 'EXA RESEARCH' work in a language other than English?
Hello there! I appreciate it :) I have tried to use Exa in French by tweaking the search prompt. but so far it has not been very consistent. in english it works great, but yeah, i hope they implement support for other languages soon!
Do you have any videos of feeding an llm data like books and you can search for related subjects in any of the books in any context and it reurns you the result
Thanks for the detailed walk-through. Is part 2: "Build a Web App (GUI) for your CrewAI Automation (Easy with Python)"?
that's correct
Great content once again. You are really driving this space, mate, so kudos on that.
I am thinking how this can be used in the testing and automation space. Can these agents be used to browse websites by self authenticating and writing test cases based on other agents?
More looking at thw authentication part as opposed to test case tasks itself, am unsure how web scrapping or browsing would work when it is protected content and needs authentication.
Thanks again for all your effort and time in educating the masses.
hey there, i appreciate it. yeah that's not an easy thing to do. in practice, i would probably use the siteplan for that if the website makes it available. have you tried that?
This was cool. Could you share the tool you use to generate the captions in your video? Please.
that's descript. but i'm dropping it soon as the subtitles don't seem to be getting a very warm reception :P
it's great to edit videos as though they were a word document, though, even if you're not adding subtitles: www.descript.com/
Could you please share sessions using langgraph?
rate limit exceeded on groq bro, which is the best free llm to use here?
yeah, that's the problem with groq rn. they have very narrow rate limits. you can use ollama instead to run the models locally instead! python.langchain.com/v0.2/docs/concepts/#chat-models
Hi. I ran this app twice and for 2 different topics but it is always coming up with fake news and resource links that take me to 404 pages. What could be the problem? It is finishing perfectly with the HTML design though.
that's odd, what model did you use? try to check out the step outputs to see where the information got lost. let me know how this goes!
Fire the editor haha.. I mean, try using chatgpt api or some of the strong llm to test out.
@@gerrcassytb lol. I am using Ollama with Lama3 8b. You think thats the problem?
Thanks a ton for sharing.
Would be great if you do not include subtitles in the video, I think it distracts the focus (youtube anyways gives CC button if anyone needs it).
Thanks once again.
noted! i was trying this out for these couple of videos, but indeed i won't be using them anymore!
Is anyone else running into 'ModuleNotFoundError: No module named 'crewai_tools'?
I've tried uninstalling crewai and reinstalling it, creating a new conda environment with Python 3.11, creating a new conda environment with Python 3.10, running 'pip install crewai[tools]' and nothing works, I still run into that error.
that's very strange. maybe this is a problem with poetry.
in this video i did create a conda environment to install crew.
but then i used the CLI that comes with crew to create the project.
this new project actually uses poetry (python package manager) on top of whichever python installation you already have. so, since you already have python running on conda, this will use poetry on top of your conda. which means that you have to install the dependencies with poetry after you initialize your env.
so maybe you have to do `poetry lock && poetry install`
@@alejandro_ao Thank you! Interesting, I'll give that a shot. I discovered while working on a different project that no packages I installed via pip within a conda environment actually worked.
I had to use virtualenv instead.
However, I tried virtualenv for this and it still didn't work. I'll try running 'poetry lock && poetry install' as you suggested, hopefully that works.
@@alejandro_ao YES! Using poetry worked. Thanks so much!
How to Generate Automatic report
what do you mean?