ฝัง
- เผยแพร่เมื่อ 16 มิ.ย. 2024
- Web Scrape in Google Sheets: IMPORTXML Function (Part 2)
Part 1: • Web Scrape in Google S...
In this video, we scrape Yelp, Craigslist, and TechCrunch using the importxml function in Google Sheets.
W3 Schools Tutorial: www.w3schools.com/xml/xpath_i...
----------------
Datase
----------------
Craigslist: philadelphia.craigslist.org/d...
TechCrunch: techcrunch.com/
Yelp: www.yelp.com/search?find_desc...
----------------
Timeline
----------------
0:00 Intro
0:40 Scraping Craigslist
4:42 Scraping TechCrunch
5:28 Scraping Yelp
5:8:26 Summary
Thank you for this video! I was trying to scrape data from a website and couldn't figure it out until I came across this video.
That tutorial is so useful and simplicit, contain no bs and full of content. You are a champ.
I HAVE NEVER SEEN ANYTHING LIKE THIS IN MY LIFE. Sure, I have see screen scraping back in the old CRT days, but this is UNREAL and it's easy ONCE you know the language!! Excellent Video!
More google sheet tutorial please. Thanks a bunch! 😍
this channel is gold. Amazing tutorials
Thank you, I appreciate it!
Simply Amazing. Thanks for such a wonderful video tutorials
Pure gold, great and on point! Thanks for the content.
Glad you enjoyed it!
finally I found it, absolutely amazing, thank you a lot!
Wow! You' re a MASTER of scraping and Google Sheets! Just learned so much with 2 of your videos
Thanks! I’m glad to hear it!
@@dataslice Thank is to you! Only problem is scraping Image URL from Craiglist in your example, I added /@src but it doesn't work
wow, what an extension! Killer! Love it
Thanks man you really helped me out here!
best tutorial ive seen, thank you
Earned a subscriber great info, clear and concise!
Thank you!
Thanks, great help for any webside :D
thumbs up for the video, really useful and well explained.
Super useful. You safe my day!
Thanks so much for the value! For your yelp example, how would you go about trying to keep a well managed and orderly scrape of all the items across all page numbers over time? Including trying to remove duplicates as each item moves across the different pages?
Thanks!
Excellent video. Great content!!
U solved my very unsolved problem - thanks alot!!
top-notch tutorial, Thanks alot :D
Absolutely amazing !!!!
Great info, earned a sub 🙌
Thank you mr for these useful tricks
Thanks for watching!
Excellent Content!
Really good video :D
Superb
Excellent video. Curious if you could help explain if this is exclusive for text or if numerical data can be extracted as well? If so, could you help coach on how to do that? I keep struggling to get anything but the text headers in a numerical data table that is non HTML tables. Thank you!
This video is so good it's basically a cheatsheet.
Amazing content
is it possible to get the sector from google finance / yahoo finance page for a stock, i tried but its showing me an error..
You da real mvp
Thanks! :-)
nicely done...
Thank you for your help
You're a beast.
amazing..thanks
thank you , useful
would love to hear how you would go ahead scraping dynamic pages that loads the content through java / api? I have some different solutions available: Scrapy, Octoparse, Selenium(Python), Java, or somehow retrieving it directly from the API. Could i do it with GraphQL? I need the data to get fed into a cell in a google sheets, i prefer not having to manually load it from a csv. i'm okay at sheets but not python/java
Hello thanks for the awesome tutorial, however, how do you do this with a webpage you have to log in to get table info?
This is AWESOME! Do you know if this is possible to do with a site that requires a login?
this is so helpful! is it possible to use this method to get the links in the page?
I'm encountering an issue at 4:09 for the //p[@class='result-info'] , as I got a #N/A as a result.
The class name on CraigList is not changed yet, so can't figure out why this isn't working as you.
Thanks for your help and your videos.
EDIT :
#2 On TechCrunch website, I'm not able to click on "XPath" Button. It's not working at all. Otherswebsite are fine tho. Do you have any idea why ?
#3 On Yelp website , the result for the first example in Sheets is CSS code. Far from what you get even if I'm doing the exact same thing.
Your video isn't so old, I really can't figure out why thinks works so differently , I tried to re-watch many times your video to see if I'm missing something but no.... ;(
Great content!!
I'm trying to scrape an Amazon list of Item Names & Prices but it will only return a list of 10 of the items... 🤷♂️
thank you for the quality tutorial. i'm looking for a way to scrape data from SSRS to google sheet. is this possible? thanks
Thanks for the awesome video! But how to find the right xpath from youtube? I try SelectGaghets extention, but he gives me a Error:
Imported Xml content can not be parsed. Or Error
"Imported content is empty" only "//a" xpath works for me...
I'm having a hard time scraping data from skybox. hopefully this helps
Can we use importxml function directly without using or downloading application or software to scrape data from any website?
Is it possible to have google sheets pull information from Search Engine results? For example, enter a business name, and it searches Google and pulls info for that company?
If the page gets updated. The info on the Sheet will get updated as well?
Great tutorial! When I scraped data from a website the data was only scraped until a certain point, even though more yellow containers were highlighted. What is the issue here, does the scraping stop after a certain number of lines?
Victor. Same problem I am having. @dataslice can you comment?
Hi, how many data row is it limited for importxml function?
How would this work (if at all) in youtube trying to scrape video data? Especially when it comes to tracking down the actual video ID and not the vanity URL? THANKS IN ADVANCE
Thank you so much for these tutorials! I think i'll use them in future. Not now, because.. i need to import comments from instagram, and...is there any way to do that? I guess insta won't let google sheet take data from it because it's not "logged in", and..yea.. i would love to hear any answers for it, even if that's a no :")
is there a way to automatically change the url. lets say like a item id at the end or the url to make a database?
Thanks for a great video on this subject! But this does not work for me. I get an "error" when try to input the second field in this example!
Can we use importxml to extract photos to Google Sheets? If so, what is the process?
Tell me the extension that is using for select all links in one time
Do you know if it's possible to tell Google sheet to scrap data from a specific location? I tried using those commands, but it was sending me data from United States whilst the page update automatically depending on the country you're accessing it from, though the URL remains the same.
importxml function is not working in google sheets. It is showing NA when trying import the data
Can you suggest a solution
How to make it auto update/refresh result? Can i just Reload the google sheet tab
How is scrape pictures from Craigslist? Is there a way to scrape desired data from balance sheet from yahoo finance into google sheets?
hi there can you help me how to collect data from 'BURSA'?. such as stock price and so on. i already tried all the methods but it did not work
Hello
Thank you very very much for this excellent video that is very very helpful
Just a question : if I need to scrap the image URL of the product, is there a way to do it ?
Thank you
hey, i am having the same question. have you found out the solution?
Hello I am an Amazon seller, do you think I could use this technique to retrieve my sales history directly in a Google sheet?
How do you use this function to scrape hyperlinks in the website?
Love it thanks for sharing! Do you have one on python by chance? I saw the one on R but am curious if you do anything with python.
I’m working on a python one now - thanks for watching!
@@dataslice Can't wait! These are awesome!!
Can i do the same on password protected site
how to extract data from multiple pages on yelp ? not just the first one
thanks
can you please guide me how to scrape skyscanner and kayak Best price in google sheet.
Hey mate! Great tute. Any idea how to get the info beyond a "More" button using these methods?
Taking the Craig's List one for example, If you wanted to see the top 300 results, if they were beyond a more button that loaded onto the current page and not on a "page=2" type thing.
Hey Brad, unfortunately if you want to do any kind of UI interaction on the page, you'll need to use a different web scraping method--something like the Chrome web scraper extension or the Selenium library in R or python.
How to import the tables that filled with api data?
Tried doing this for rental units to find but just kept getting an error sadly
I tried exactly the same workflow as you but mine is giving me error. it's craiglist with home rental site.
Hey Thank you for the video!
Do you know to get the updated data.
Example if i am importing a stock price.
and i would like to import the updated data after 30 mins.
I can't think of a way other than manually refreshing the formula and cells, however, I do know that Excel supports getting data from stock tickers. You can write a ticker name in a cell, like $AAPL, and then go to the 'data' to format it as a stock ticker, and then fetch a lot of different data points about the stock -- it might be easier than scraping it!
How come this only works for certain website? Eg. When I try to do this on a real estate website or supermarket website i always get the error #N/A?
Will this update daily?
How if we collect data from website with basic auth to spreadsheet
Clear Explanation 👍
Questions
Will the important HTML Is up-to-date data from the source website? If no then please tell us a way to keep a live data
2- I want to scrap ecommerce website product data, how to auto scrap Next page ?
3- How about import data via json file url most e-commerce website uses it eg Shopify
I'll be thankful if you please create an ecommerce website data scraping vidoe or share your tips so ill give it a try 🙂
Can you import the images?
The =IMPORTXML(B2,B3) isent working for me, the numbers just go grey . Anyway to fix this??
How do you scrape data from a website that is behind a paywall?
SelectorGadget doesn't have an icon to click to activate after i Installed on chrome. Is there a Firefox equivalent?
Also, how would you recommend scrapping home data from Redfin/Zillow? I would like to paste in links and automatically fill in home data row by row for different homes. For the SF for example, i tried used //div[@class='info-block sqft'] but it doesn't work (shows N/A)
Mine worked fine..
what did you do to show the xpath??? you did not teach how to show this xpath in your video
I just tried this trying to scrape google play store and failed. is this possible to scrape google play store reviews? please help
I was trying to export data from scopus.com webpage
Great video, I apply the importxml function to Google Sheets and other times it works and other times (without changing anything) it gives me #N/A into cell. What can I do? Thank you very much
If nothing is changing, I’m not sure what the issue would be unless there’s an error getting data from the site. What site is it?
@@dataslice I did it through a script and it works. I was told that it was probably the speed of the network. Thanks a lot again
Is this data updated automatically?
What if I want to scrape all of the images and their respective alt text or all of the h tags in order of their appearance on the page?
hey, i am having the same question. have you found out the solution?
hey man, having trouble scraping yahoo finance onto a spreadsheet, can you help?
Thanks for this great tuto. when i'm trying to use on a realtor listing, google sheet result is "N/A", what did i make wrong ? thanks
Which site are you trying to scrape? Websites where the data is loaded dynamically sometimes don't cooperate with Google Sheets / other webscrapers and you may need a different approach
Same problem... I'm trying to scrape youtube.com. I'm watched this video th-cam.com/video/pwZ44kAeiOo/w-d-xo.html&t where he scrape youtube with no effort, but right know it's seems it no working any more...
Does this work with Microsoft Edge? Do you have discord server? I wanna ask something. :)
I still get #N/A ??? It worked for Craigslist but not for other sites i tried like Supermarkets?????
same, for prices like walmart
How would you do this with links
How can I get the URL link?
Great content! How can i convert the info from text to numbers? (e.g. prices list)
Thanks! Maybe try the Format > Number tab for formatting an entire column
@@dataslice I tried, but it's impossible
@@juanmaguevara That's very odd, I'm able to format my scraped columns and am trying to think of why it wouldn't work for you. Maybe the scraped text data contains non numeric values and Sheets is unable to format it? I'm not too sure
Maybe I'm too late, and maybe it's a dumb answer, but in some cases works for me adding 0 to the text to convert it into numbers, if the text is just numeric
@@victorruiz804 thanks Victor!
How to get data in Google Sheet from a website after login?
Señor, usted SAPE.
Can you make a video about importing data from fb messenger into R ? I tried selector gadget but it didnt work . Thank you for those amazing tricks
Facebook actually lets you export and download your messenger data, I’d recommend trying that!
@@dataslice yes but the file is in json or html format, and i dont know how to tràner them into csv
Is there a way to import the anchor tag instead of the URL when using //a/@href?
Are you trying to import the text between the ... tag?
@@dataslice Yes. Here is the element:
Aldersgate United Methodist Church
When using @href to import, it imports the hyperlink. Is there a way to import the anchor tag? Thanks
@@dataslice Figured it out, was using the wrong element. Thanks
@@peterhansen1351 how did you do it. I have been trying to import a similar text too
Regular devtools has right click on element > copy > copy xpath