Web Scraping Using ChatGPT

แชร์
ฝัง
  • เผยแพร่เมื่อ 7 พ.ย. 2024

ความคิดเห็น • 452

  • @ChatGPT-AI
    @ChatGPT-AI  ปีที่แล้ว +13

    Scrape Amazon Product Data using ChatGPT and Python:
    th-cam.com/video/9MNCGdaJfA0/w-d-xo.html

    • @shortstoriesinarabic9761
      @shortstoriesinarabic9761 ปีที่แล้ว

      guys this world is new for me. what is the purpose of scaping amazon or ebay or any website to take the products informations . please any kind soul to enlighten me

  • @mycollegeshirt
    @mycollegeshirt ปีที่แล้ว +984

    This is like when calculators were first invented

  • @thebluriam
    @thebluriam ปีที่แล้ว +108

    Keep in mind the beautifulsoup library only works on non-dynamic pages which are fully loaded and do not use s; it would be better to call beautifulsoup a DOM parser than to say you are "scraping" with it. There are countless other limitations with the requests/beautifulsoup mechanisms; you will hit a capabilities wall very quickly.
    If you want to do real web scraping, you need to be using something like Selenium which utilizes a real web browser driver and can interface with a live DOM environment in real time, operating against real DOM elements as well as being able to switch context to internal elements and controlling things like the back and forward features of a browser as well as tabs.
    If you are wanting to scrap a page which has dynamically loaded content, you need something like Selenium. It's a whole different beast but it's worth the time to learn (correctly)

    • @decline1822
      @decline1822 ปีที่แล้ว +12

      Selenium is pretty easy to learn though, and very powerful. ChatGPT is pretty good with it. It's kind of fun. Like one of the sites I scraped for product reviews, I had to scroll to the bottom, wait two seconds, and scroll to the bottom again to get it to run the javascript to load product reviews. Just asked ChatGPT "how would you scroll to the end of a web page and wait two seconds then scroll to the end again in Selenium?" Got my answer in 2 seconds hah!

    • @TheReaper-fq6yv
      @TheReaper-fq6yv ปีที่แล้ว +3

      Or if you're in TS/JS use puppeteer which supports async.

    • @denissetiawan3645
      @denissetiawan3645 ปีที่แล้ว +1

      the perfect combo would be:
      scrapy + playwright

    • @98f5
      @98f5 ปีที่แล้ว +6

      @MSD Group there's literally more musicians than ever what kind of weird comparison did you make?

    • @MichaelShingo
      @MichaelShingo ปีที่แล้ว

      @MSD Group lol the musician market is so oversaturated with talented people

  • @4uffin
    @4uffin ปีที่แล้ว +12

    The fact that you can have ChatGPT right code is so amazing to me, makes new concepts for code so much easier to figure out.

    • @Towzlie
      @Towzlie ปีที่แล้ว +7

      right ?

    • @chrisgraham2123
      @chrisgraham2123 ปีที่แล้ว +2

      ChatGPT can also wrong the code too

    • @neey3832
      @neey3832 ปีที่แล้ว

      it wrote me a C code with JSON in it

    • @xbon1
      @xbon1 ปีที่แล้ว +2

      It can also teach you to use write instead of right

    • @g_rr_tt
      @g_rr_tt ปีที่แล้ว

      @@xbon1 it can write the right grammar, right?

  • @JosephCodette
    @JosephCodette ปีที่แล้ว +348

    I’m not scared of you at all , you’re my new coding buddy. Can’t wait for version 4 and better servers

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +25

      sure. you can use ChatGPT to solve math homework, or do coding assignment , or even use at your work.

    • @oxi2118
      @oxi2118 ปีที่แล้ว +32

      @@ChatGPT-AI no sir, chatgpt sucks at math and logical problems. try it

    • @0mdf
      @0mdf ปีที่แล้ว +4

      @@oxi2118 It did a lot of algorithms for me, what are you talking about?

    • @oxi2118
      @oxi2118 ปีที่แล้ว +5

      @@0mdf ask it a general mathematical question, like "how many numbers which end with 9 are divisible by 7"

    • @axilwright9079
      @axilwright9079 ปีที่แล้ว +8

      @@oxi2118 yes true , it doen't do well with math , i tried it and it sucks

  • @roostertechchan
    @roostertechchan ปีที่แล้ว +75

    This is valid only if the website hasn't changed layout after AI was trained. ChatGPT kept offering wrong code for a JS library, suggesting old version syntax.

    • @vibheksoni
      @vibheksoni ปีที่แล้ว +7

      Give it html of current page so it can parse it and then interpret the new layout

    • @mongolman3492
      @mongolman3492 ปีที่แล้ว +12

      @if3lixde803 I think he means literally copying and pasting the whole html rendered of the web

    • @Jonpot
      @Jonpot ปีที่แล้ว +3

      @if3lixde803common misconception actually. It does have access to the internet (even though it was only _trained_ on pre 2020 data). It doesn’t like to access the internet, though, and you may need to jailbreak it into DAN first, but there are plenty of examples of people linking ChatGPT to StableDiffusion and Midjourney to make images right in the ChatGPT dialogue

    • @goosygooob
      @goosygooob ปีที่แล้ว +1

      ​@@Jonpot Well heres what ChatGPT itself thinks about it: "As an artificial intelligence, I don't have the ability to access the internet or browse the web. I am a large language model that has been trained on a dataset of texts, and I use that training to generate human-like responses to the questions and prompts that I receive. I don't have the ability to browse the web or access new information beyond what I was trained on, but I can use the information that I was trained on to try to provide helpful and accurate responses to the questions that I receive. Is there something specific that you would like to know?"

    • @blocktech
      @blocktech ปีที่แล้ว

      let the script kiddies have a nice day mile

  • @andrey730
    @andrey730 ปีที่แล้ว +48

    To clarify - ChatGPT won't go to website and won't analyze it's html to scrape it.
    It will only work if the site you're trying to parse were somehow part of library ChatGPT was trained on.

    • @juleswombat5309
      @juleswombat5309 ปีที่แล้ว +2

      Nonsense. Chat -GPT has provided the python code to scrape (any) website. You just have to change that code to point to the URL you wish to scrape.

    • @andrey730
      @andrey730 ปีที่แล้ว +16

      @@juleswombat5309 all sites have different structure, it woudn't work. Or you mean to change url in chat gpt prompt? It won't work either since Chat GPT is not going to visit the url and analyze the site structure.

    • @kaizenrecords_
      @kaizenrecords_ ปีที่แล้ว +3

      @@andrey730 True! It also doesn't account for if the website loads data client side and Selenium is required.

    • @mashnoonislam1126
      @mashnoonislam1126 ปีที่แล้ว +1

      This Jules guy doesn't know what he's talking about 😂😂😂

    • @junglegoose4648
      @junglegoose4648 ปีที่แล้ว +2

      Bearing in mind chat gpt is not connected to the internet, it would be very challenging technically to create code that is capable of scraping any website, nonetheless if you have seen this please reference the source.

  • @mikebailey783
    @mikebailey783 ปีที่แล้ว +10

    I love the fact that even the video narration is completely AI; from the wording, to the slightly uncanny speech synthesis itself. I bet the entire video was the result of someone typing-in a request to ChatGPT, to "write a script for a TH-cam video which explains the use of ChatGPT to scrape websites". In the future, web dev may be more about developing the right questions to ask of AI...

    • @FullMe7alJacke7
      @FullMe7alJacke7 ปีที่แล้ว

      Came here to say the same thing lol

  • @aimattant
    @aimattant 10 หลายเดือนก่อน

    Thanks, I just scaled this up to a Firebase app for scraping and adding data into WordPress blog posts - love ChatGPT code help - woo

  • @Bashar3A
    @Bashar3A ปีที่แล้ว +11

    Few years ago, knowing how to scrape used to be cool!

  • @klikz2242
    @klikz2242 ปีที่แล้ว +87

    Fun fact the narrator and script is also ai generated. Jk I can’t even tell anymore

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +49

      This reply is from Human.

    • @ytpremium9639
      @ytpremium9639 ปีที่แล้ว +4

      Really scary..even chat gpt can create video🤦

    • @manavdixit3355
      @manavdixit3355 ปีที่แล้ว +7

      @@ChatGPT-AI the imposter is among us.

    • @shootdaj
      @shootdaj ปีที่แล้ว +6

      @@ChatGPT-AI That's what an AI would say

    • @paulbruner3451
      @paulbruner3451 ปีที่แล้ว +3

      ​@@ChatGPT-AIWhat app did you use for the narrator voice?

  • @hippopotamus86
    @hippopotamus86 ปีที่แล้ว +25

    I've tried several websites and it guesses the web elements, GPTChat doesn't visit the URL and grab the source code so this is a bit pointless for most situations.

    • @snylekkie
      @snylekkie ปีที่แล้ว +7

      Exactly. This is just a language model it's not interacting with the world. People don't get it because of how this is marketed and shared in the social media

    • @ProxCyde
      @ProxCyde ปีที่แล้ว +1

      Yet... Admittedly, it's not an easy task to do live updates. But, the future is the future..

    • @homeofpain5116
      @homeofpain5116 ปีที่แล้ว

      Because this is ChatGPT beta and don't have any access to the Internet

  • @seanthesheep
    @seanthesheep ปีที่แล้ว +7

    I was expecting you to perform web scraping _inside_ ChatGPT, like, "Pretend that you are a terminal. Run my input as a command and respond only with the output in a code block. My first command is: `curl [URL to scrape here]`"

    • @akrakorab8897
      @akrakorab8897 ปีที่แล้ว +2

      I don't think they have access to internet

    • @Vin50000
      @Vin50000 ปีที่แล้ว

      @@akrakorab8897 I think the more important thing is openai is not gonna let you run commands on their server

    • @hippopotamus86
      @hippopotamus86 ปีที่แล้ว +1

      Not possible, it's a language model. It cannot run commands, just reply with what it thinks the next text should be.

    • @stevenlaczko8688
      @stevenlaczko8688 ปีที่แล้ว +3

      @@hippopotamus86 You CAN do it, ChatGPT will just hallucinate what it thinks the website has on it.

    • @odinviken
      @odinviken ปีที่แล้ว +1

      I think you can achieve this by using the api and connect it to whatever db you prefer.

  • @W_W-f8y
    @W_W-f8y ปีที่แล้ว +1

    straight and to the point, best tutorials hands down

    • @shortstoriesinarabic9761
      @shortstoriesinarabic9761 ปีที่แล้ว

      guys this world is new for me. what is the purpose of scaping amazon or ebay or any website to take the products informations . please any kind soul to enlighten me

  • @mornepatterson6260
    @mornepatterson6260 ปีที่แล้ว

    Absolutely incredible. If you’re will to invest and spend time learning and playing around with this tech your opportunities are endless

  • @adamcunningham8248
    @adamcunningham8248 ปีที่แล้ว +12

    The improper use of plurals is interesting. Is there some translation/ai reason behind this? I know that voice mimicry AI has also become quite impressive. Was this script passed through a translator, then through a text to speech generator?

    • @es68951
      @es68951 ปีที่แล้ว +2

      Yes, the voice is synthesized

    • @anthonyandrade5071
      @anthonyandrade5071 ปีที่แล้ว +1

      Probably gpt voiceover lool

  • @green_universe
    @green_universe ปีที่แล้ว +2

    Blessed be the data labelers

  • @jokwon7343
    @jokwon7343 ปีที่แล้ว +1

    And just like that thousands of web scraping software vendors cried out in terror

  • @RyanScottForReal
    @RyanScottForReal ปีที่แล้ว +1

    What did you use for the voice synth? Very convincing. Sounds American. Couldn't tell it was fake except it skips words like 'the'

  • @toast8089
    @toast8089 ปีที่แล้ว +9

    ChatGPT create a video on how to creating a webscraper in python include script and video assets describe in detail

  • @okamotoshogo7926
    @okamotoshogo7926 ปีที่แล้ว +3

    A new era of programming is dawning. We're about to be freed from the tedium of coding and able to focus on problem solving. .... or fired.

  • @krievolic
    @krievolic ปีที่แล้ว +1

    you're the best chatgpt

  • @MonichGPT
    @MonichGPT ปีที่แล้ว

    I will be reach with this bot! Let's gooo!!!

  • @NomadicTeachers
    @NomadicTeachers ปีที่แล้ว +1

    Please make a video about how to use chat GPT to build a keyword search tool for a niche marketplace 😊

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +3

      you can't build a keyword research tool without data.
      all the tools available in market are build on top of google ads api.
      they didn't build anything magical.
      they are using google ads api (obviously Paid plans) to get data related to search. (as google is most used search engine and they have build their own data)
      just create Google ads account (it's free) and you can do keyword research for free...

  • @Kyosika
    @Kyosika ปีที่แล้ว +4

    My mind is racing with all the awesome ideas that I can finally start.

    • @reprovedcandy
      @reprovedcandy ปีที่แล้ว +7

      You could've always done them. Learning to code was your only obstacle.

    • @amentco8445
      @amentco8445 ปีที่แล้ว +1

      @@reprovedcandy such a small obstacle

    • @Kakerate2
      @Kakerate2 ปีที่แล้ว

      give me some ideas

  • @Pro4Sound
    @Pro4Sound ปีที่แล้ว +3

    Not only this is about ChatGTP, but the whole video was produced using Chat GPT.

    • @ithaca2076
      @ithaca2076 ปีที่แล้ว +2

      yep. ai voice, sterile video structure, etc

  • @floreskyle1
    @floreskyle1 ปีที่แล้ว

    Good lord, I didn't think I'd be this motivated once more to learn new stuff. The last time I've felt this way is when I discovered WolframAlpha and used SageMath to help with my Math homework.
    Now I'm gonna be reinforcing my Data Science knowledge with this? Oh boy, I'm ready.

  • @RyanScarbrough
    @RyanScarbrough ปีที่แล้ว

    Can't wait to implant this into my brain. :)

  • @peterbenedict3328
    @peterbenedict3328 ปีที่แล้ว

    Chatgpt is savior
    Didn't know that chatgpt can take live data from website

  • @JennyManEngineer
    @JennyManEngineer ปีที่แล้ว

    Nice idea!

  • @FilmFactry
    @FilmFactry ปีที่แล้ว

    Excellent. I need to try this!

  • @dogchaser520
    @dogchaser520 ปีที่แล้ว

    I love a good ratting. Highly ratted books are the ones with the most droppings inside.

  • @imrxzey
    @imrxzey ปีที่แล้ว

    very cool

  • @fikri.abdoul
    @fikri.abdoul ปีที่แล้ว

    what kind of text to voice AI are u using, so natural!

  • @Turtle125
    @Turtle125 ปีที่แล้ว

    This is very nice but what are we with this information? Simpler question what is website scraping used for

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      To collect data. (for detail , just google it or ask chat gpt)

  • @elena7891
    @elena7891 ปีที่แล้ว

    Helpful!

  • @Novacasa88
    @Novacasa88 ปีที่แล้ว

    Sad i was just about to start doing freelancing for web scraping to help lift me out of poverty but alas. Better get that UBI research done asap.

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +1

      You should do freelancing and use ChatGPT as your unpaid intern.

  • @AlexandreFuchsNYC
    @AlexandreFuchsNYC ปีที่แล้ว +13

    Sometimes the code is not complete (CGPT stops mid line).
    Have you found a way to ensure he exports all code in one go?

    • @cieluchowski
      @cieluchowski ปีที่แล้ว +10

      Just write 'continue' when it stops

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +16

      type -> continue.
      ChatGPT has some TIME LIMIT for writing response due to high traffic and this is a free version.
      if it produce code in some chunks,
      then ask it to write code in in file.
      if code is too big , it will stop. so type continue and it will finish the rest.

    • @yokoabi8307
      @yokoabi8307 ปีที่แล้ว +1

      @@ChatGPT-AI if i type continue. It will reproduce the whole code again but different and stops again mid line

    • @garvitsharma2726
      @garvitsharma2726 ปีที่แล้ว +1

      @@yokoabi8307 Tell it to wite for example 100 lines of code and after writing, wait for an 'ok' from you to continue writing

    • @ContGptAi
      @ContGptAi ปีที่แล้ว +1

      @@yokoabi8307 Let me offer another suggestion. copy the code on the line where it stopped: Say continue from the code below and paste the code by shift+enter

  • @StewV
    @StewV ปีที่แล้ว +5

    what voice bot do you use it sounds really realistic .

    • @sir_john_hammond
      @sir_john_hammond ปีที่แล้ว +3

      Yes it's exactly like a person who barely knows English, I'm amazed

  • @RSX-0806
    @RSX-0806 ปีที่แล้ว

    Nothing is better than curl + grep + awk

  • @fritmore
    @fritmore ปีที่แล้ว

    noice!

  • @dDesirie
    @dDesirie ปีที่แล้ว

    ChatGPT is like a digital Indiana Jones, except instead of a fedora and a whip it's got a codebase and an internet connection

  • @Cfomodz
    @Cfomodz ปีที่แล้ว

    Did a bad version of chat gpt write this script?

  • @InternetSummaryInSeconds
    @InternetSummaryInSeconds ปีที่แล้ว +2

    I'm sorry if it's a basic question, but what do you guys use this data for?

    • @learnmore5438
      @learnmore5438 ปีที่แล้ว +2

      for your own purpose, for example put the data in your website/app. This is useful if the web does not have an open API to use.

  • @jturlais
    @jturlais ปีที่แล้ว

    Great video! Would that work on PitchBook?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      not sure. (mostly NO , as i checked pitchbook .com)
      you can try to check if it is working for pitchbook or not.
      if you need to login or purchase a plan to get the data then answer is NO.
      but it can work on amazon or ebay. i made a video about scarping amazon product data.

  • @carlosfernandezcanet5699
    @carlosfernandezcanet5699 ปีที่แล้ว +18

    Thank you very much for this wonderful tutorial. I was not familiarized with Python as I use other web scraping tools (obviously not so complete) but I managed to install it and its libraries. I would like to ask you how to get all pages or a certain number of pages. Thanks again!

    • @dawidp749
      @dawidp749 ปีที่แล้ว +12

      ask chatgpt not there

    • @OL9245
      @OL9245 ปีที่แล้ว +2

      If you love scrapping use dedicated platforms such as apify. If you scrape from home your IP can be banned. All big sites have anntiscaping policy. Some are brutal.

    • @Magicskid2323
      @Magicskid2323 ปีที่แล้ว +2

      @@dawidp749 ChatGPT isn't always correct. I've had to correct it's Python code numerous times. It's great for basic applications and great for getting you started, but sometimes you'll have to fix it's mistakes.

    • @denkryvoshei4589
      @denkryvoshei4589 ปีที่แล้ว +3

      I love all these "new devs" are going to grow. If you're asking it here instead of chatgpt that means you didn't get the whole thing, you're just copy pasting from the video. Coding is not about just writing code it is about understanding

    • @decline1822
      @decline1822 ปีที่แล้ว +1

      I've done this. You need to look for the presence of the "Next" button and figure out how to either click it, or pull its href link and get it. If you don't find the next button, you break the loop and end the program. You can just ask ChatGPT to loop through all pages and it should get you pretty close.

  • @Apeiron242
    @Apeiron242 ปีที่แล้ว +1

    Interesting vid.
    Thumbs down for using a robovoice.

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      robots are the future...

  • @skaramicke
    @skaramicke ปีที่แล้ว +7

    Perhaps you should use chatgpt to process your voice over scripts before you send them off for recording.

  • @marklord7614
    @marklord7614 ปีที่แล้ว

    Nice...great video. Good to know there's no need to repeat the entire instructions.

  • @prodKossi
    @prodKossi ปีที่แล้ว +1

    Dude what text to speech application are you using here?

  • @JoZaHandle
    @JoZaHandle ปีที่แล้ว +2

    What did you use for the AI voice?

    • @kamikazeeOG
      @kamikazeeOG ปีที่แล้ว

      Sounds like a beta they might be working on. Only other voices I've heard this good are on Well Said Labs.

    • @brndto
      @brndto ปีที่แล้ว

      ​@@kamikazeeOG I wouldn't call it good... it pronounced rating as ratting

    • @Kakerate2
      @Kakerate2 ปีที่แล้ว

      @@brndto it sounds very similar to the voice for the fat character in Millennium Thinker

  • @OL9245
    @OL9245 ปีที่แล้ว +9

    Be careful while scrapping. Many sites will ban your IP when they figure out it hosts a bot.

    • @Magicskid2323
      @Magicskid2323 ปีที่แล้ว +1

      Sounds like a statement from experience. VPNs never stopped anybody.

    • @eternalheckler
      @eternalheckler ปีที่แล้ว +8

      Well it's easy, just ask ChatGPT to not be a robot and it will modify your script

    • @Magicskid2323
      @Magicskid2323 ปีที่แล้ว +1

      @@eternalheckler I hope that's sarcasm 😂

    • @OL9245
      @OL9245 ปีที่แล้ว +1

      @@Magicskid2323 VPN can protect your IP indeed. But your script will be terminated. Big sites have tried to make scrapping illegal but they failed. What they earned was the right to take practical measures to stop bots activity, and they hired good coders to do that. Actually much clever than the random scraper. Check Apify pages (just an example) to understand how wild the scrapping war has escalated. Scrapping from one's garage has become a story of the past.

    • @Magicskid2323
      @Magicskid2323 ปีที่แล้ว

      @@OL9245 I have first hand experience in the matter. I have no issues scraping the websites and data that I need. This may be more of a conversation about skill level because if you're a skilled enough coder there's no reason why you shouldn't be able to accomplish the task at hand.

  • @rahuldinesh2840
    @rahuldinesh2840 ปีที่แล้ว

    Can I use scraped data to create listings in woocommerce through API?

  • @lukeagnew7212
    @lukeagnew7212 ปีที่แล้ว

    Will it write a scrap using selenium or scrapy? bs4 doesn’t support any websites that use Java which is most all websites

  • @ZackHughes
    @ZackHughes ปีที่แล้ว

    Here we go

  • @legalizedcomedy
    @legalizedcomedy ปีที่แล้ว

    shit thank you I totally forgot about scrapping

  • @jmd489
    @jmd489 ปีที่แล้ว

    0:45 "as you can see here it's saying about some warning related to their policy.... just ignore it" 🤣

  • @CitiZen-V4V
    @CitiZen-V4V ปีที่แล้ว

    I would like to ask chatGPT to stop WARs and POVERTY around the Globe...But I am afraid that will eliminate humanity ;)

  • @SpiritTracker7
    @SpiritTracker7 ปีที่แล้ว +11

    So let's say that python we're requesting has more steps in it. How do we manage and instruct chatGPT to output complete code sections without running out of tokens. When I type "continue" it doesn't alway pickup where it left off. Sometimes it moves on the next part of the code. Any suggestion on how to manage this or it is what it is for now?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +2

      if stops at some function, then you can ask like, code {this} function.

    • @shezario
      @shezario ปีที่แล้ว +1

      Smarter prompts can also help. Tell it to find more efficient ways or split it into junks

    • @Gok.
      @Gok. ปีที่แล้ว +6

      Create instruct at the beginning, like when I say continue, continue from where you left without instructing me, etc. Or another method is, to write the last word the bot creates and say continue from there

    • @0mdf
      @0mdf ปีที่แล้ว +1

      I write "Write missed part of code"

    • @ven._._.
      @ven._._. ปีที่แล้ว

      for me i just ask for no comments since it seems that theres a word limit and comments add more

  • @beaconing7689
    @beaconing7689 8 หลายเดือนก่อน

    What AI voice do you use ? Its sound nice

  • @HURRY-UP-N-BUY
    @HURRY-UP-N-BUY ปีที่แล้ว +2

    This is SICK!!!.....💯

  • @VaibhavShewale
    @VaibhavShewale ปีที่แล้ว +1

    live website i mean dynamic website will not be able to give data to beautifulsoup

  • @enriqueruiz320
    @enriqueruiz320 ปีที่แล้ว

    😱😱

  • @MicaelAlves-z8j
    @MicaelAlves-z8j ปีที่แล้ว

    Is it possible to parse videos from a given youtube channel? Collect thumbnails, video titles, number of likes and video duration?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      you can do that as i shown in my other video "scrape amazon data" or best way is by using youTube API.

  • @Smithowitz
    @Smithowitz ปีที่แล้ว

    Does this just do the 1 page or does it go into the next pages till it's out of inventory?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว +1

      you can put all the code inside for loop.
      then for each,{ change target_link=url+ 'page=1'...}
      or something similar based on the website.
      and it will go for all the pages.

  • @frenzsebastiantongol5864
    @frenzsebastiantongol5864 ปีที่แล้ว

    Can we scrape Linked In data as well?

  • @Kingside88
    @Kingside88 ปีที่แล้ว +1

    since chatgpt do not have access to the internet it will not work on most of the pages.
    It generates code like foreach this html class but this class do not exist

  • @thcookieh
    @thcookieh ปีที่แล้ว

    Would this make people lazier or more productive?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      😂😂😂 that's a million dollar question.

  • @anilmitkari3832
    @anilmitkari3832 ปีที่แล้ว

    How can we web scrap Aws billing dashboard...running service..for every 4 hours in csv file... Using python with Chatgpt

  • @naumanali6580
    @naumanali6580 ปีที่แล้ว

    unbeliveable

  • @TheKeith567
    @TheKeith567 ปีที่แล้ว

    Can use chatgpt to write code to send bulk emails?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      Yes you can!
      i will try to make a video.

  • @davidinark
    @davidinark ปีที่แล้ว

    Can chatgpt just scrape it and save the csv itself?

    • @brndto
      @brndto ปีที่แล้ว

      ChatGPT cannot browse websites, it only guesses what it is browsing.

  • @martondemeter4203
    @martondemeter4203 ปีที่แล้ว

    Its funny that is works much better in reverse... scraping chatGPT to use it as a fake api xd

  • @AntonNb
    @AntonNb ปีที่แล้ว

    Is it possible to scrape list of website from Google search query results, extract text content from each url , feed it to chatgpt and create prompt so chatgpt do text analysis from extracted text and then generate article outline from it

  • @web_angle
    @web_angle ปีที่แล้ว +3

    Looks cool

  • @JoanFiguerolaHurtado
    @JoanFiguerolaHurtado ปีที่แล้ว

    Just tried three product pages from 3 different websites and it flopped when picking the CSS selectors... They are wrong and random..

  • @mesiroy1234
    @mesiroy1234 ปีที่แล้ว

    Whre excely do Paste code to make it work

  • @DSMASH1000
    @DSMASH1000 ปีที่แล้ว

    Chat GPT helped me make a letterboxd python scaper that could get the overlap of two public lists. The results were displayed on JavaScript front end.

  • @AlexanderDiraviam
    @AlexanderDiraviam ปีที่แล้ว

    I’ve had some issues with the requests library. I suggest requests-html instead

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      yes. requests-html is better for scraping.
      thanks.

  • @digidope
    @digidope ปีที่แล้ว

    When this will be paid service (very soon) we will need to start to think how to avoid this trial and error method. Re-writing that code many times use quite many paid tokens. It is already limiting the hourly use.

  • @devcognicion
    @devcognicion ปีที่แล้ว

    OMG

  • @soumyadipnayak8634
    @soumyadipnayak8634 ปีที่แล้ว +2

    FUN FACT:A guy who knows UTF-8 will not have to use ChatGpt to write code 🤣

    • @alifaour5648
      @alifaour5648 ปีที่แล้ว

      i know UTF-8 from a one month internship, but I can barely even fathom what classes are...

  • @oshead
    @oshead ปีที่แล้ว

    🤯🤯🤯🤯🤯🤯🤯🤯🤯🤯🤯🤯

  • @BlackAmda
    @BlackAmda ปีที่แล้ว +1

    Not 100% successful. But still in good state.🙂👨🏻‍💻

  • @AnotherSkyTV
    @AnotherSkyTV ปีที่แล้ว

    Crazy! 😂

  • @silverfoenix
    @silverfoenix ปีที่แล้ว

    Its not available in my country yet...
    The thing i'm curios about, Can it make code snippets for wordpress in the theme function.php?

  • @spoxemandev4679
    @spoxemandev4679 ปีที่แล้ว +1

    This is actually pretty good

  • @dave_thebrave
    @dave_thebrave ปีที่แล้ว +1

    i have a feeling that 4 years olds ripping snoops with.

  • @rodi4850
    @rodi4850 ปีที่แล้ว +1

    Did u use chatgpt to create the transcription and then convert it into a voice for this video ? 😅so meta

  • @kimberlyjones4112
    @kimberlyjones4112 ปีที่แล้ว

    Can chat GPT duplicator software? If you yourself don't know the code or have the code for that software?

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      you can't duplicate software like that.
      currently chat gpt has some time limit/ character limit for generating response.
      so you can't build entire software in one click.

  • @isaweeb
    @isaweeb ปีที่แล้ว

    Won't you get ban doing this? Because of violating rules?

  • @DOOHYUNCHO
    @DOOHYUNCHO ปีที่แล้ว

    can you make a video of how to download short videos using chatgpt?

  • @1Garrett2010
    @1Garrett2010 ปีที่แล้ว +8

    ChatGPT is great, but those people started with calling it OpenAI, intending it was an open product, and invented this new tradermark, "ChatGPT", that is registered to the US governament and owns all the rights for educational, tabletop, boardgames, memorygames, tshirts etc. etc. This is the motivation behind the new name "ChatGPT", its a way to not call it "CloseAI".

    • @thebluriam
      @thebluriam ปีที่แล้ว

      Nothing you said is at all even remotely true. But very fun and trolly

    • @1Garrett2010
      @1Garrett2010 ปีที่แล้ว +1

      @@thebluriam Before calling troll people go to verify the information I posted here to the USA government website. I can't put link here, the trademark OpenAI is not restricting, the trademark ChatGPT is fully restricted. And an enterprise that calls it Open and register so close trademark is not open. End of story.

    • @thebluriam
      @thebluriam ปีที่แล้ว

      @@1Garrett2010 lol, "the" government website. You don't even know what "Open" means in OpenAI. Trademarks are never open, that's not what "Open" is referring to anyway. Jesus...

    • @1Garrett2010
      @1Garrett2010 ปีที่แล้ว

      @@thebluriam Stop to troll here, every trademark has a different text registered that indicates what the author wants to protect. Stop to troll with bad information here, Im a publisher by 20 years and I have to do with trademarks all days, go study and dont troll

    • @thebluriam
      @thebluriam ปีที่แล้ว

      @@1Garrett2010 "Open" in OpenAI does not refer at all to trademarks or anything legal in any way. "Open" in the name is in reference to the openness of software, as in the term "open source". You may deal with trademark law or whatever, but you clearly don't know anything about the software development world with any degree of technical intimacy.

  • @AchilleFalzone
    @AchilleFalzone ปีที่แล้ว +2

    What about pagination?

  • @lucasilverentand
    @lucasilverentand ปีที่แล้ว

    This video is so much AI, even the voice haha

  • @veevee7555
    @veevee7555 ปีที่แล้ว

    Where to. Paste the code kindly explain please thank you

    • @ChatGPT-AI
      @ChatGPT-AI  ปีที่แล้ว

      obviously inside a code editor...
      i am using VS code...
      just create a .py file and paste it.

  • @akshaysawant7278
    @akshaysawant7278 ปีที่แล้ว +6

    Scary😕

  • @cybraxe
    @cybraxe ปีที่แล้ว

    Doesn't ChatGPT not have any access to internet. So how is it building this script?

    • @brndto
      @brndto ปีที่แล้ว

      It guesses.

  • @delik2348
    @delik2348 ปีที่แล้ว

    Which tts is this?

  • @kranot87
    @kranot87 ปีที่แล้ว

    The actual title should be Learn Web Scraping Using ChatGPT & Python