Estou maratonando seu canal e feliz por ter encontrado ele. Você ensina mto melhor q varios professores de curso q eu paguei pra ter, parabéns pela didática e pelo conteúdo q você vem trazendo.
You don't need that weird function syntax Pedro? you can just create an async arrow function and then put everything inside that and make sure to call that function outside of it to initialize it once you finished your scraping.
I wounder what the legality is if you plan to offer a scraping service on fiverr and one of your clients ask to scrape data on a website that doesn't allow scraping? how can you find if a website doesn't or allows web scraping? i looked on some terms of uses and privacy policies but can't find any hits when using find and searching keywords like scraping, web scraping ect.
Please make a video on apollo server express backend and nextjs ssr with authentication with cookies apollo client. It will be a good one. And thanks for quality contents
how do u deal with pagination. For example I want to scrape Amazon books and there's 50 pages each with books and I want to grab all books across 50 pages
The tutorial is good but the only thing that I didn't like is that you didn't use ".quote > span.text" to get the quotes themselves directly yet instead, you wrote extra lines of code to get that. Also to get the author info, ".quote > span > .author" or ".quote .author" could have been used.
great tutorial only problem was I couldn't get it to work on edge browser cause I refuse to get chrome, I used puppeteer-core, and edge-paths which is recommend for edge and imported my executablePath property to the browser await function and still nothing, looked all over could't find a solution.
I am trying very hard to learn mern by my own but i got struck while storing jwt auth token on cookie... It is not storing any cookie while making post rqst in node js.... Plss pedro if u can help me anyhow Thank You
in last example I tried to logout after the login using await page.click('a[href="/logout"]'); but it didn't work, it worked when I copy pasted it 2 times. why is it not working with only a single line??
May I suggest something that might be stupid? Try to give it a few moments before performing the action. Set a timeout of a few seconds and check if it works that way. I might be completely wrong but I think it has something to do with the action being asychronous. Again, this might be wrong, but it's worth a try if you have time.
Estou maratonando seu canal e feliz por ter encontrado ele. Você ensina mto melhor q varios professores de curso q eu paguei pra ter, parabéns pela didática e pelo conteúdo q você vem trazendo.
Muito obrigado Luiz! Fico feliz :)
Awesome explanation man... After looking to more than 10 videos about web scraping i can definitely say your is the best
One of the best tutorials on this, well done!
Awesome videos man, congratulations and thanks for your so clear explanation on all of them!
Always the best place to start learning something new
You don't need that weird function syntax Pedro? you can just create an async arrow function and then put everything inside that and make sure to call that function outside of it to initialize it once you finished your scraping.
Thanks for this, bro! I've been trying to find a decent course on web scraping with nodejs but most suck!
Very concise and easy to follow. Great video.
I wounder what the legality is if you plan to offer a scraping service on fiverr and one of your clients ask to scrape data on a website that doesn't allow scraping? how can you find if a website doesn't or allows web scraping? i looked on some terms of uses and privacy policies but can't find any hits when using find and searching keywords like scraping, web scraping ect.
Thanks
Nice Video 👍🏼 I was looking for such type of content from long time. Thanks you're Amazing 🤗. Please continue the series on puppeteer.
Thank you Rahul! I really appreciate the support!
Best video for puppeteer.. Great Video! Thank you
Thank you so much dude. Amazingly explained and well structured video. Keep it up 🎉
Thanks for this one as well, Pedro!
Pretty simple to understand, good job!
Great explanation, subscribed!
Thanks , very concise way of teaching and fun to follow
Hey Pedro, amazing tutorial. How to add realtime notifications to this scraping.Is is possible
At last I found a reason of why your 2 puppeteer tutorial is missing .. :D
Yeah, i felt really bad cause i really liked that series hahaha
Maybe you can upload it as private and share the link to it in this videos description
What about using js path of xpath to find specific button?
very insightful dude
Please make a video on apollo server express backend and nextjs ssr with authentication with cookies apollo client. It will be a good one. And thanks for quality contents
awesome tutorial man! Can you do one where you crawl and scrape? I am new to all of this and with you learned the scraping part thanks.
THIS IS SO SICK THANK YOU🚀
I love this video, thank you so much for all the informations.
nice explanation , thnx from INDIA
How would you cycle through and click all of the buttons on a page that all have the same class?
Thx so much, you've got new subscriber!
enjoyed it ,great work
I rececived an error:failed to launche the browser process.PLease help me
great ! how can I copy the data obtained, inside a html div, instead of viewing it, in console. thanks
how do u deal with pagination. For example I want to scrape Amazon books and there's 50 pages each with books and I want to grab all books across 50 pages
Thanks man, this was very helpfull
thank you for a such good videos you publish
I wonder if TH-cam allows webscraping it
how to click checkbox hCaptchs and select images ?? can you make it a video???
Great stuff. Thank you
Very nice video, can you maybe make one on how to scrape SPA's?
Great Video, broh, but I come to think "hell, what a brazilian name you've got" hahaha
Eu sou brasileiro kkkkkkkk
@@PedroTechnologies imaginei KKKKKKK
Awesome tutorial …can you explain how to access HTML elements style lik font family,size,color,width,…etc
How to grab the data using its custom attribute?
Is your website down?
Hello sir Please help me building product comparison website using web scraping in javascript please make video on it
Can u do with captcha
Awesome !
some websites disable document object as a result it is impossible to scrap data from that, could show us how to resolve it ?
You can easily add a user agent to puppeteer which fixes this. I go over it in my other puppeteer series. I should have mentioned it in this video :)
@@PedroTechnologies waiting for that
Thanks for video really good
can you make next video on MERN stack
Super cooool
Can be solve epub to html
The tutorial is good but the only thing that I didn't like is that you didn't use ".quote > span.text" to get the quotes themselves directly yet instead, you wrote extra lines of code to get that. Also to get the author info, ".quote > span > .author" or ".quote .author" could have been used.
thank you for this
i love you man
Thank You
Your website is down :(
Goat
awesome
great tutorial only problem was I couldn't get it to work on edge browser cause I refuse to get chrome, I used puppeteer-core, and edge-paths which is recommend for edge and imported my executablePath property to the browser await function and still nothing, looked all over could't find a solution.
simple solution, sto refusing to get chrome
nice
I am trying very hard to learn mern by my own but i got struck while storing jwt auth token on cookie... It is not storing any cookie while making post rqst in node js....
Plss pedro if u can help me anyhow
Thank You
Are you portuguese?
Instead of series bring a full length crash course
in last example I tried to logout after the login using
await page.click('a[href="/logout"]');
but it didn't work, it worked when I copy pasted it 2 times. why is it not working with only a single line??
May I suggest something that might be stupid? Try to give it a few moments before performing the action. Set a timeout of a few seconds and check if it works that way. I might be completely wrong but I think it has something to do with the action being asychronous. Again, this might be wrong, but it's worth a try if you have time.