Web Scraping With ChatGPT Code Interpreter: Mind-Blowing !!

แชร์
ฝัง
  • เผยแพร่เมื่อ 29 ก.ย. 2024

ความคิดเห็น • 44

  • @TheAIAndy
    @TheAIAndy  ปีที่แล้ว +2

    Your Most Powerful, All-In-One AI Writing Copilot:
    hix.ai/?utm=aiandy
    Thanks to Hix AI For sponsoring this video. Our sponsors help us grow the channel and keep making better videos for you. Thanks for your support!

    • @PubgSpeed-wl8yo
      @PubgSpeed-wl8yo 9 หลายเดือนก่อน

      How can I get the full article? There is a lot more data inside the article, why do I need this superficial information? Do you know anyone who parses like this? Why not show how everything you need comes from inside?

  • @VeVeVerse
    @VeVeVerse ปีที่แล้ว +9

    It's cool but I want to automate the process to where I can set everything up once, and it auto scrapes new information as it comes in.

    • @matheusbraga2909
      @matheusbraga2909 3 หลายเดือนก่อน

      Perfect! Did you already get to do it on chatgpt?

    • @danityvanityinsanity
      @danityvanityinsanity 3 หลายเดือนก่อน

      Can you create an ai agent to automate it or custom gpt?

  • @ClimbHighWithAI
    @ClimbHighWithAI 7 หลายเดือนก่อน

    I need to do it with more than 5000+ products and also need description and price and etc how can I do it

  • @Web.Scraping
    @Web.Scraping หลายเดือนก่อน

    This is ok for small amounts of data, but for sites that have hundreds of pages of pagination this way is too laborious. In any case, this video will be useful to someone 👍

  • @npane171
    @npane171 5 หลายเดือนก่อน +1

    This doesn't work with webpages that have information that is dynamically loaded, like zoominfo.

  • @RenatinhoLicioniFilho
    @RenatinhoLicioniFilho 2 หลายเดือนก่อน

    I'm trying to setup a web scraper for facebook marketplace, can you help me with that?

    • @japhethmutuku8508
      @japhethmutuku8508 2 หลายเดือนก่อน

      I can help you get with that. Let me know if you’d like more details or if you have any questions!

  • @ILONA-DAVID-lifelong-learning
    @ILONA-DAVID-lifelong-learning 9 หลายเดือนก่อน +1

    Hi, I have a plus subscribtion , but the Advanced Data Analysis is not visible for me (before I could see the Code interpreter, now nope)

  • @olieducationalvideos6203
    @olieducationalvideos6203 ปีที่แล้ว +1

    I think Bardeen ai can do this all with just a prompt

  • @MisterSkraetsch
    @MisterSkraetsch ปีที่แล้ว +1

    Thanks Andy. Keep up the great work. :) I would be interessed in web scrapping for sites where you first need to LOGIN :) Cheers

  • @mcombatti
    @mcombatti ปีที่แล้ว +5

    Even faster, you could just copy paste the site data using select all & copy, then ask GPT to create a CSV for the items found in the unorganized data(not page source) 🤫 take me all but 10 seconds to do the same as code interpreter can do within minutes, with less effort. Code interpreter is great, it's like a really big hammer... but thumbtacks don't require a hammer 😉

    • @SamuelNickolas-yf7wh
      @SamuelNickolas-yf7wh 10 หลายเดือนก่อน

      @mcombatti If it is not the page source then what did you copy?

    • @kenzabel5394
      @kenzabel5394 19 วันที่ผ่านมา

      yeah but copy and paste inside chatgpt will make the prompt so long it will make it hard to read what you wrote in chatgpt

    • @mcombatti
      @mcombatti 19 วันที่ผ่านมา

      @kenzabel5394 the context length of GPT-4o is 120,000 tokens - or about 300 pages of text. I haven't hit the ceiling yet. 🙏

    • @mcombatti
      @mcombatti 19 วันที่ผ่านมา

      @@SamuelNickolas-yf7wh open the page and hit copy and paste... page source would just be silly. 🤭

    • @mcombatti
      @mcombatti 19 วันที่ผ่านมา

      @@kenzabel5394 I typically am more concerned with the response as I know what the input was 🙏

  • @IrlymMylros
    @IrlymMylros ปีที่แล้ว

    It will amazing if you can show how to generate complete scripts for Cloud based operstions like complete company infrastructure setup in Microsoft Azure, scripts like Powershell or CLI. Or Microsoft 365 setup. Many thanks for your great videos.

  • @EricaTroni
    @EricaTroni 5 หลายเดือนก่อน

    Thank you for this video! Is there a way to scrape product images as well as all info you’ve mentioned?

  • @DanielTheCunningham
    @DanielTheCunningham 8 หลายเดือนก่อน

    QQ: In the second example, you glossed over how you corrected the error. Can you elaborate on how you modified your prompt to solve the issue?

  • @CyberMacs
    @CyberMacs ปีที่แล้ว +1

    Great idea, thank you! :)

  • @oliverli9630
    @oliverli9630 ปีที่แล้ว +1

    that's an interesting method. a normie can do that at home if they only want the first few pages. if they need multi pages, python coding still is a must

    • @aarong9327
      @aarong9327 ปีที่แล้ว

      So you're saying I'd need python if I wanted more in depth data on each of those headphones?

    • @oliverli9630
      @oliverli9630 ปีที่แล้ว +1

      @@aarong9327 yup. programming skill still gives an edge

    • @PubgSpeed-wl8yo
      @PubgSpeed-wl8yo 9 หลายเดือนก่อน +2

      @@oliverli9630 the conclusion is why this video was created, which does not carry complete instructions, which 99% of people need, why this video is needed, what is useful in it. You surprise me in the West, you don’t criticize anyone who sees the problem, you keep saying, bro, you’re handsome, this is useful. But in fact, this is of zero benefit, because it did not show how to take full content from inside the article. What he showed was just for the video and not for training.

  • @training7574
    @training7574 2 หลายเดือนก่อน

    Very useful and simple, thanks.

  • @beautytips911
    @beautytips911 ปีที่แล้ว

    Awsome examples, can do one with Google my businesses

  • @erikmeier3681
    @erikmeier3681 6 หลายเดือนก่อน

    why you are so fast?

  • @AdamBechtol
    @AdamBechtol 2 หลายเดือนก่อน

    Neat, thanks.

  • @JeremyJullien-ry1pz
    @JeremyJullien-ry1pz 3 หลายเดือนก่อน

    This was really helpfull ! thx

  • @gyangting
    @gyangting ปีที่แล้ว

    Is there a way to webscrape without downloading an html file, i.e. just providing a page link

  • @rocketgrowthstrategiesdigi4535
    @rocketgrowthstrategiesdigi4535 ปีที่แล้ว

    On the tech crunch you could do a rewrite

  • @JJBoi8708
    @JJBoi8708 ปีที่แล้ว

    Do a video on open interpreter!!!

  • @tanvirahmed1959
    @tanvirahmed1959 ปีที่แล้ว

    awsome really

  • @ajithbaburaj2547
    @ajithbaburaj2547 8 หลายเดือนก่อน

    Awesome🎉... Shorter video👌🏼

  • @celestialresearch
    @celestialresearch 10 หลายเดือนก่อน

    Pretty cool!

  • @torarinvik4920
    @torarinvik4920 ปีที่แล้ว +1

    Kudos to you for diving into coding! Scraping is imo a huge pain in the ass, so it's good to have tools to simplify it!

    • @PubgSpeed-wl8yo
      @PubgSpeed-wl8yo 9 หลายเดือนก่อน

      Do you understand how to get a full article from parsing?

    • @vladimirxack
      @vladimirxack 6 หลายเดือนก่อน

      ​@@PubgSpeed-wl8yo The same way bro used inspect element, you can do that too.