- 28
- 131 376
Amin Boutarfi
Algeria
เข้าร่วมเมื่อ 10 พ.ค. 2022
This channel is all about python automation.
I constantly share content on web scraping, data extraction, python tips and tricks, API calls, work with Databases such as PostgreSQL, Use Unix, automate Files related stuff and more!
If you like what you read, subscribe! :)
I constantly share content on web scraping, data extraction, python tips and tricks, API calls, work with Databases such as PostgreSQL, Use Unix, automate Files related stuff and more!
If you like what you read, subscribe! :)
Scrape Products from Amazon and send them to Discord using Python - part 2
Part 1: th-cam.com/video/ynWs_uWMrsk/w-d-xo.html
This tutorial is about making a Python Bot That scrapers products data from amazon and send them as messages to discord. Note that this is a just an example, and not a production ready code.
This example use the Python + Discord.py + Playwright Package. You can make a similar bot using multiple other technologies as well!
Scraper API services (Affiliate):
www.scraperapi.com/?fpr=amin13 Or use amin10 at checkout to Get Free trial + 10% off when you buy from them.
Code Link: github.com/amineboutarfi/amazon_to_discord
This tutorial is a Python Data Scraping Project made for educational purposes only.
Like & Subscribe!
Into: (00:00)
Create Discord Webhook: (00:34)
Coding: (01:15)
Run the Code: (04:02)
Outro: (04:45)
#python #amazonproducts #subscribe #playwright #scrapeamazon #pythonbot #discordbot #amazonbot
This tutorial is about making a Python Bot That scrapers products data from amazon and send them as messages to discord. Note that this is a just an example, and not a production ready code.
This example use the Python + Discord.py + Playwright Package. You can make a similar bot using multiple other technologies as well!
Scraper API services (Affiliate):
www.scraperapi.com/?fpr=amin13 Or use amin10 at checkout to Get Free trial + 10% off when you buy from them.
Code Link: github.com/amineboutarfi/amazon_to_discord
This tutorial is a Python Data Scraping Project made for educational purposes only.
Like & Subscribe!
Into: (00:00)
Create Discord Webhook: (00:34)
Coding: (01:15)
Run the Code: (04:02)
Outro: (04:45)
#python #amazonproducts #subscribe #playwright #scrapeamazon #pythonbot #discordbot #amazonbot
มุมมอง: 1 478
วีดีโอ
Scrape Products from Amazon and send them to Discord using Python - part 1
มุมมอง 1.7Kปีที่แล้ว
Part 2: th-cam.com/video/8_ijqfMLWhU/w-d-xo.html This tutorial is about making a Python Bot That scrapers products data from amazon and send them as messages to discord. Note that this is a just an example, and not a production ready code. This example use the Python Playwright framework. You can make a similar bot using multiple other technologies as well! Scraper API services (Affiliate): www...
Python & CSV for Beginners Series: Different ways to WRITE DATA to CSV
มุมมอง 177ปีที่แล้ว
This tutorial is all about the different main ways to write Data to a CSV file using Python with examples. Will use a standard python file reading method, the CSV module, and the pandas package. Into: (00:00) File Write: (01:32) CSV Writer: (06:21) Pandas to_csv: (08:56) CSV DictWriter: (11:04) #csv #subscribe #python #pythonprogramming #pythoncsv #writecsv #data #pythonforbeginners
Python & CSV for Beginners Series: Different ways to READ DATA from CSV
มุมมอง 208ปีที่แล้ว
This tutorial is all about the different main ways to read Data from a CSV file using Python with examples. Will use a standard python file reading method, the CSV module, and the pandas package. Into: (00:00) CSV File: (00:21) File readlines: (01:51) CSV reader: (06:00) CSV DictReader: (08:57) Pandas read_csv: (10:30) Outro: (12:13) #csv #subscribe #python #pythonprogramming #pythoncsv #readcs...
Python Tutorial - all, any, and their use cases
มุมมอง 101ปีที่แล้ว
This tutorial is about the builtin all and any python functions, their use cases, and some examples! All and Any can be very handy in some specific cases like when dealing with conditions. Into: (00:00) Truth Values: (00:10) All: (01:44) Any: (07:32) #learnpython #subscribe #python #pythonprogramming #coding #pythontricks #pythontips #pythonfunctions
Google Maps Data Scraper/ Extractor Part 2 - Scrape Reviews + Scrolling Feature w/ Python
มุมมอง 6Kปีที่แล้ว
This is part 2 of the Google Maps Scraper. In this tutorial, we fix bugs, scrape reviews, and code the scrolling feature using Python. Part 1: th-cam.com/video/tp_B5tpJS3c/w-d-xo.html Code Link: github.com/amineboutarfi/google_maps_scraper Proxy Service I use (Affiliate): www.scraperapi.com/?fpr=amin13 Or use amin10 at checkout for 10% off Get free trial! Into: (00:00) Show Case The Project: (0...
Scrape Data from Booking.com using Python - HTML to Excel & CSV
มุมมอง 22Kปีที่แล้ว
This tutorial teaches how to extract hotels data from Booking.com using Python, Playwright, and Pandas. This is a step by step tutorial for beginners. Find the code here: github.com/amineboutarfi/booking_scraper Proxy Service I use (Affiliate): www.scraperapi.com/?fpr=amin13 Or use amin10 at checkout for 10% off Get free trial! Along the way I explain why I used each package and the methodology...
Google Maps Data Scraper/ Extractor using Python and Playwright (Free no external service) - Part 1
มุมมอง 38Kปีที่แล้ว
Part 2: th-cam.com/video/S49-lxlDqJk/w-d-xo.html Github link: github.com/amineboutarfi/google_maps_scraper Proxy Service I use (Affiliate): www.scraperapi.com/?fpr=amin13 Or use amin10 at checkout for 10% off Get free trial! Tutorial is a #pythonprojects on how scrape/extract data from Google Maps using #python, #playwright, #pandas and #argparse . For free, It requires no additional services W...
PDF Scraper/ Downloader using Python & Selenium - Automation Tutorial (Free require no service)
มุมมอง 12K2 ปีที่แล้ว
PDF Scraper/ Downloader using Python & Selenium - Automation Tutorial (Free require no service)
Images Scraper/ Downloader using Python & Selenium - Automation Projects
มุมมอง 1.8K2 ปีที่แล้ว
Images Scraper/ Downloader using Python & Selenium - Automation Projects
Export Queries Results Data From PostgreSQL To CSV Using pgAdmin, PSQL, and Python
มุมมอง 3.6K2 ปีที่แล้ว
Export Queries Results Data From PostgreSQL To CSV Using pgAdmin, PSQL, and Python
Save Pandas Dataframes and CSVs directly to PostgreSQL Database (Must Know Skill in Data Fields)
มุมมอง 10K2 ปีที่แล้ว
Save Pandas Dataframes and CSVs directly to PostgreSQL Database (Must Know Skill in Data Fields)
Cryptocurrency Data Scraper/ Extractor using Python Playwright and save it to PostgreSQL
มุมมอง 2.1K2 ปีที่แล้ว
Cryptocurrency Data Scraper/ Extractor using Python Playwright and save it to PostgreSQL
Python Project - Scrape Countries Population Data From an HTML Table into CSV and Excel Using Python
มุมมอง 20K2 ปีที่แล้ว
Python Project - Scrape Countries Population Data From an HTML Table into CSV and Excel Using Python
good job! Thanks
Would be to have part three both to cover any google page structure update and including searching email address via initially scraped name. Also, user agent and proxy will be great add on top.
Thanks for the suggestion! new part coming soon
nadi canadi
I'm also getting the error: Error occured: object of type 'NoneType' has no len() and I can't solve it.
Working on the new update!
Are you an Arab? Your voice says that.
In coordinates all the longitudes and latitudes are same in every lead why?
there's a bug, fixing soon!
hi , if i want to rename after download ,how could i do that
What if theres no pdf but it shows a print window
brillant one
Can we use multiple url pages here?
Could you do it to search rental cars ?
How to update the xpaths?? please
Total reviews are not scraped whole csv file column is empty any solution?
Working on an update!
Loved this tutorial, really enjoy the way you explain from scratch. But when i try to append the data, i get this error: "UnicodeDecodeError: 'utf-8' codec can't decode byte 0xfa in position 192: invalid start byte", I've been trying to automate the proccess of saving CSVs on a postgres database, specifically a Supabase hosted database, but cant manage to get over this error no matter what i do. I was wondering if maybe you went through this error at some point, if so I'd be gratefull if you helped me with this. For context, I am in colombia rn if that affects the encoding somehow
Such a great tutorial and very easy to follow, thank you!
thnx for the video, but do u have a tutorial about scrolling down to the end of page in order to get all what we can ?
Hello. I'm getting the error: Error occured: object of type 'NoneType' has no len() and I can't solve it. Any tips?
hey have you found any solution? I cannot solve it also
@@nonamme_8888 i made my own scrapper using google api.
Same problem here please help Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len()
@@raymondshin3958 I had to make my own script. This one didn't work for me.
Working on an update that would fix all bugs and add new features!
This is great a tutorial & intuitive explanation. Thank you for sharing, subscribed!! Any future thoughts for scraping the reviews as well? :D
Thanks for the support and suggestion, adding new features soon!
Thank you for the video. By the way, on my computer it has different xpath because I use the exact same code with your video, the listings result 0 lists, is it possible?
Great video and great code, I just have 1 problem for some reason the data doesn't get passed onto the excel or csv file any suggestions ? I get this as error Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len() Error occured: object of type 'NoneType' has no len()
name_xpath = '//div[contains(@class, "fontHeadlineSmall")]' if page.locator(name_xpath).count() > 0: business.name = page.locator(name_xpath).all()[0].inner_text() else: business.name = "" The above only gets only one name and duplicates it in the rest of the name fields. All other output is fine. What could be the issue?
Best Video I can say the most easy to scrap data from a table thank you
great video!! thank you for sharing. can you please add code for grabbing 24h change as well. I was able to grab the value but it doesn't say + or -, it just gives the value of change.
Salam brother can make cod for this website thanks apostille.mofa.gov.pk/book-appointment
Thank you so much for sharing such valuable information. You are Genius.👏👏
Sir Can the same thing be done with selenium,Bs4 and requests? If not then why? I am a beginner and I want to improve my skills. And I am gonna watch this full playlist from Tomorrow
i think there's a new update recently? you will have to initialize a duckdb connection now
Thank you. I tried follow your video, but it does not recognize the requests
Bro which websites you using
Reviews or comments scraping for each business for the next video part 3? Please explain how to scrape Google maps reviews for each listed business in one go.
This series will be more useful if you teach how to crawl the comments for each business from Google maps, as well as the ratings, or filter by rating stars
Thanks man
How we can earn money from this data?
can you help on the xpath part , i am doing everything you said but the table is not getting returned.
Your videos are very interesting, so I followed you. It’s a shame that your last video was uploaded 11 months ago. This channel has potential to grow a lot more!
Thanks a lot @rrvbin6354 will be back very soon 🙏
Hi admin, thanks for you video. It help me so much. But I have a issue and I can't fix it. Can u help me? When I search for a specific address (Currently Scraped: 1), it won't continue and has an error in page.hover. Is there any way to fix it?
Maybe because this is older and they have changed somethings but I'm getting an error trying to scrape with the price. When I comment out the code for the line of price it works just fine.. but of course that is a very important piece. How can I work around this?
how to implement all results, not just 5?
bro facing difficulty the xpath does not work fine the path does not work difficulty in copy it correctly even written the same code as yours but no content in trslist
Absolutely Awesome. Each Explanation is Crystal clear.
would be nice to have a sample of the python script to play with but good video thank you
PS C:\Users\003\Downloads> python main.py -s="medicals in nashik" -t="20" ----- 0 - medicals in nashik Currently Scraped: 16 Total Scraped: 20 Error occured: object of type 'NoneType' has no len()
you didn't tell how to get xpaths. It is very different now
This video may have been released one year ago, but it’s still no longer relevant but his github code is still relevant
Sir, it does not open the chrome but it prints zero as I change -l and -s values. what should I do?
Can you tell us how to scrape the Stars rating? So the number of stars a hotel has?
Everything works fine. But "name" column is blank. Something wrong in XPATH I think
The booking page asks me to log in everytime so the script doesn't work. Any solutions ? Thank you!
is this possible to configure the file path dynamic instead of hardcoding the path in main code.Please reply
Can we scrappe the reviews?