Crawl4AI is awesome! I've been using the crap out of it for a while now. One of the best AI tools I've come across in over 2 years in this space. Glad to see that its getting noticed.
You made this video right after I literally implemented the same thing in my tool I’m building haha, the only big difference is that I pop that scraped markdown into Gemini flash to summarize it into the condensed endpoints before pushing it over to Claude or something to save context. Love it!
I laughed so hard when I heard, "Let's spend three hours implementing this." That's just what I did with the Fire-crawler API in my dashboard hobby project. Now I need to spend some more hours swapping to Crawl4AI...😅
dude I find this so much easier to crawl full documentations for real, maybe your tutorial will help me achieve the same with crawl4ai. But gpt-crawler works so much better to get all suburls in 1 go and get the full documentation in 1 file
I am exited to get access to the members only detailed video on how to implement this in my ide. Are you still planning on loading the Details on the member only site?
Crawl4AI is awesome! I've been using the crap out of it for a while now. One of the best AI tools I've come across in over 2 years in this space. Glad to see that its getting noticed.
It took 2 years for it to get NOTICED....how did you find it, originally?
You made this video right after I literally implemented the same thing in my tool I’m building haha, the only big difference is that I pop that scraped markdown into Gemini flash to summarize it into the condensed endpoints before pushing it over to Claude or something to save context. Love it!
I laughed so hard when I heard, "Let's spend three hours implementing this." That's just what I did with the Fire-crawler API in my dashboard hobby project. Now I need to spend some more hours swapping to Crawl4AI...😅
You're the king! Made this a script to add to my project knowledge directory... Which I add to whatever assistant I'm using.
This is an amazing tool! Thanks so much for always being the best in creating intelligent workflows!
Can't wait to learn more about Crawl4AI!
My thoughts:
It's pretty cool.
Awesome tutorial. Thank you!
I enjoyed the humor and the content of course.
Your videos are great 🎉 and also please do more videos related to combination of ai tools & tips and tricks
You're a savior, thanks!
What about Zed? Have you tried the markdown instructions approach with it?
dude I find this so much easier to crawl full documentations for real, maybe your tutorial will help me achieve the same with crawl4ai. But gpt-crawler works so much better to get all suburls in 1 go and get the full documentation in 1 file
How can I crawl inner pages. The documentation is a short documentary with next button at the bottom. Thanks
there's also a crawlee. Can compare both and see which is better.
Thanks!
I am exited to get access to the members only detailed video on how to implement this in my ide. Are you still planning on loading the Details on the member only site?
Yes, I'll be releasing that soon in 2-3days.
@ I need this. Thank you.
Hi, we're a huge fan of your content and would love to discuss sponsorship. Could you please provide more details? Many thanks!
You can contact me on discord: @aicodeking
What if the page is secured with username and password but i know these credentials?
Can it go over pagination, crawl multiple pages and collect data ?
Yes
@@AICodeKing I tried this with Godot's documentation but it just gathered all the links and no actual documentation. Am I missing something?
Bruh 😂 everyday we getting new ai thing
is there any gui for aider ?
there is, use aider with --gui flag
It’s not that great but there is a vscode extension that works pretty well by a guy named Matt. I think it’s linked in the aider docs.
@@stonedoubt thanks but i need a locally one
Why markdown if models understand json too? The json format should be more understandable
Great ❤🎉 tip, can make video about Cofounder project coding with ai looking amazing project please check out for this
I just texted it says that API key is not valid for anthropic. Not sure if it's my own error but tried few times
@@ContentVibeio Hmm, may be something on your end. I successfully got cofounder up and running with my keys.