Scrape ANY WEBSITE With This AI Agent
ฝัง
- เผยแพร่เมื่อ 24 พ.ค. 2024
- Hey👋 if You Enjoyed This Video and are interested in more content about AI, Agents and Business Automation -- please Subscribe🙂
---------
In this video I'm checking out the Firecrawl project which is a tool that Turns entire websites into LLM-ready markdown or structured data.
🎞️Chapters
00:00
▶️Other Videos You Might Like
Autogen Just Got Better - Controlling The Agents With Validation and State Transitions:
• Autogen Just Got Bette...
Self Reflecting Agents - Autogen Producing Amazing Production Level Results (Real Business Use Case)
• Self Reflecting Agents...
Autogen Agents with RAG - Upgrading Agents with a Knowledge Base
• Autogen Agents with RA...
🌐Links
docs.firecrawl.dev/learn/data...
github.com/mendableai/firecrawl
✅Come say 'Hi' over Linkedin:
/ yaronbeen
✅Book a Consultation:
ecomxf.com/book-a-call/
✅My Website:
ecomxf.com/
#️#️#️
#Firecrawl
#WebScraping
#DataExtraction
#Markdown
#StructuredData
#WebCrawling
#NLP
#Python
#API
#DataMining - วิทยาศาสตร์และเทคโนโลยี
I would be very interested in a video to get around protection from websites! That would be great!!
Look up Selenium base here in youtube.
Let me know if you're unable to find it
Very cool! Thanks for showing this didnt know Firecrawl
My pleasure :)
With selfhosting without api is it possible to scrape and do all stuff? If yes then please research and make video on it as it will be very helpful
What is the use case?
In most cases I'd just suggest scraping with Power Automate Desktop.
@@ecomxfactor-YaronBeen just that I want open source free of cost flexible solution,I know power automate is free easy gui etc etc but what I want is open source self hostable flexible solution for smart scraping of websites and then more usecases can be think out of it
I solve most of my scraping with Power Automate, Apify and if needed Beautiful soup.
I don't know of any 'smart scraping' solutions that really work on production level