How to Get Zillow Property Data in Python 2022 | Easy Tutorial
ฝัง
- เผยแพร่เมื่อ 4 ก.ค. 2024
- Want to analyze real estate properties, but not sure on how to get the data? Check out this video, for a step-by-step tutorial on how to get Zillow data in Python for on market and off market properties.
Timestamps for your convenience:
0:00 Intro
1:07 Problem Statement
4:18 Zillow.com API
7:57 Python Tutorial
References:
Medium Blog - bit.ly/3x4xcvS
Python Notebook - github.com/analyticsariel/pro...
Rapid API Zillow API - rapidapi.com/apimaker/api/zil...
PropStream (7 Day Trial) - trial.propstreampro.com/analy...
~-~~-~~~-~~-~-
Resources & Services:
Facebook group: / 263033709360071
AnalyticsAriel Courses and Coaching - analyticsariel.teachable.com/...
PropStream (7 Day Trial) - trial.propstreampro.com/analy...
Apify (Web Scraping Tool) - www.apify.com?fpr=cy7vq
Medium - / membership
Jasper AI - jasper.ai?fpr=analyticsariel
~-~~-~~~-~~-~-
Subscribe to this TH-cam channel:
/ @techinrealestate
~-~~-~~~-~~-~
Want to learn more about how to apply analytics to your small real estate business? So that you can get back to the front-end work (building relationships and finding deals), why you started up in the first place. Then make sure to visit AnalyticsAriel for a free consultation on the page below:
www.analyticsariel.com/
~-~~-~~~-~~-~-~
![Zillow For Sale Real Estate Data Python 2021 [UPDATED] | Easy Tutorial](http://i.ytimg.com/vi/ZSZ1hio-YNA/mqdefault.jpg)
Have real estate data analytics questions? Join the private Facebook Group to ask questions and learn from peers - facebook.com/groups/techinrealestate
Ariel, I've been watching your videos all week. I had the thought of scraping for real estate a long, long time ago and never thought it would be worth executing as well and I assumed I was late to the party. You completely inspired me to give it another shot. Thank you!
Thank you Joseph, I really appreciate your comment and so happy the information I share can help! 🙂 feel free to reach out for any questions I have
I just utilized this to pull data for a list of properties I had in excel. Thank you so much for this content Ariel!
Awesome, thanks for watching Edmundo!
I have probably watched 50k TH-cam videos without ever commenting but wow this was so good I had to. This was so helpful and clearly explained. Thanks!
Thanks so much for watching Adam, I appreciate it 🙂
Great video Ariel! Thank you!
Thanks Tom!
I just saw your channel and I am loving it. I am studying AI and plans to apply it into a property tech startup
Awesome! Thanks for watching, if you have any future projects you’d like to share over the channel let me know 👍
Love your work. thanks for this. Inspire me !!! You are the bomb
Thank you for watching!
Wow I have been learning a lot being a neophyte data analyst😊. You are awesome! Just subscribed too. Thank you! I’ve been wanting to get into a real state analytics or land a job as a real state data analyst.
Thank you for watching and happy to hear you are progressing towards learning real estate analytics! Keep up the great work!
Great video! Helps me a lot~ Love you🥰🥰🥰
Glad it helped, thanks for watching!
Amazing content, thank you so much!
Thank you for watching Marcus!
Great video! I have many questions about real estate data analytics.
Thanks for watching Terry! I’d be happy to help answer questions you may have or feel free to ask them in the Tech in Real Estate group 😃
Thanks for the Tremendous video !
Thank you!!
This is awesome!
Thank you Gary!
Hi! Great video, I have just subscribed to the channel!
QQ: Is it possible to retrieve the data for all the houses in an specific zip code? or do you always need the "zpid" ? thank you!
Hi Carlos thanks for watching! Retrieving property addresses by zip code is not available via the API. However, you can use PropStream, BatchLeads, or ListSource to get a list of all addresses. You can export them to a CSV file and then use the API to get the Zillow property data detail.
Yes, it is possible. I used propertyExtendedSearch for this. Then with the list of zpid I retrive data about houses.
@@johndegson9231 Thanks! Yes that will work for on-market properties. The solution I provided would be for "all houses" both on and off-market
Hi Ariel, thank you so mucho for the detailed explanation and the walk through. For beginners lime myself this is very important. Quick question. How can I automate the retrieval of lets say a thousand properties ID in order to be able to get the info for these 1000 properties. I would like to make a search of 1000 properties in a specific area of Houston, TX. Thanks!
Hey Oscar apologies for the delayed response hope you had a nice holiday weekend! You would need to implement a FOR LOOP for Python. For example, if you retrieve 1,000 properties and have them in a pandas data frame (rows, columns) you can then loop through each row to call the API for the details. Here’s a good resource for it - www.geeksforgeeks.org/different-ways-to-iterate-over-rows-in-pandas-dataframe/amp/
@@TechInRealEstate thanks a lot, I did it!
Thank you so much!!
Thank you for watching!
Great content. Lots of old videos on how to do this that no longer work.
Thanks for watching! Agreed the methods to get the data change. I’ll continue to post updated solutions as previous ones become stale 👍
Ariel, THIS VIDEO IS AMAZING, THANK YOU!! Do you know if its possible to use this platform to not only access curent rental zestimates, but historical data for previous years? I am a researcher trying to understand historical rental prices for a particular set of apartments in Texas and haven't been able to find an easy to use source for this.
Thank you for watching! I am not sure that this API has historical Zillow prices. @scrapeak - does your Zillow API provide historical prices? Or have you been able to scrape them in the past?
I used "Zestimate History" endpoint, also the response from the "property" endpoint has a price history.
@@johndegson9231 oh my god thank you!!
@analyticsAriel I didn't see comparable values in the output in the github file. Is there a way to get comps for a long list of properties?
Hi Matt you’ll find it in the 2023 Zillow Data which points towards a different API - How to Get Zillow Property Details with Python 2023
th-cam.com/video/Mvkrm5g6fFg/w-d-xo.html. @scrapeak is the creator and very helpful
Hi Ariel - I have a list of ~1000 addresses. I am on the RapidAPI Basic plan. When I ran my list of addresses, it stopped after around 10 and said "You have exceeded the rate limit per minute for your plan, BASIC, by the API provider." Do you know if there is a way around this, or will it require me to upgrade? Also - is it correct that running 1000 addresses will be counted as 1000 calls? Thank you!
Great question, from the Zillow RapidAPI “pricing page” you should be able to continue to query the API on a basic plan and incur an $0.08 charge per property without having to upgrade to pro. I think RapidAPI automatically stops queries when it hits the limit incase you only want to stay within the free tier.
If you re-run your query it should continue without pause. You can then monitor costs within your RapidAPI account.
Yes, 1,000 addresses should be counted as 1,000 API calls = $80. It may be more cost effective to upgrade to Pro since you get 9,000 calls for $30. You can cancel the plan at anytime too.
@@TechInRealEstate Thanks for such a quick response!
Hi Ariel, great video! Like you, I'm very interested in real estate and data. Is there any chance you can create a similar video to download the room images from Zillow (i.e. kitchen, bedrooms, etc)? If not, do you know of a resource I can reference? Thanks in advance!
Thanks for watching Paul, from the same api there is an images endpoint you can reference. If you are looking to build a repository of images by room for a CNN model for example, then a good approach would be to target a city, get all listings, get images for all listings, then manually label the type of room until you have enough labeled data to classify the unlabeled images and also add them to a training dataset. Hope this helps!
@AnalyticsAriel you read my mind! I'm curious to see how different classifiers would work on the images. Thanks for the insight!
@@paulkordik1251 welcome! Also the bing image api is useful for training data too 👍
Hello, thanks! Are you able to extract the phone numbers as well??
Thanks for watching! Are you looking for the seller's agent phone number or home owner's phone number?
This is awesome, is it possible to integrate some type of API into a website I build ? I dont want to pay for IDX I want to do this for 3 cities. This would save me so much money.
Thanks for watching! I’m not an expert on front-end integration but I’m sure there’s a way to use the API instead. Looks like it’s possible with Wordpress - rapidapi.com/blog/integrate-external-api-wordpress/
Hi Ariel, I'm new to using API's and I have a question about call limits. If I iterate through a list of properties that is longer than 30, will I begin to be charged by rapidAPI? Or, can I pass a list of ZPID's to the api at once and that counts as one call? Thanks!
Hey Mike, thanks for watching! I believe the call is by property so if you have a list of properties each one will count as a call. From the pricing page it looks like there is not a hard limit which would you mean you would get charged extra for additional api calls. You should be able to track your api call usage by api subscription on rapid APIs platform. Hope this helps!
@@TechInRealEstate Thanks for the speedy reply! This is super helpful. My project involves thousands of requests. I'll have to do some math to see if it will be worth it! It's mostly a personal database building project for SQL & python and maybe some of my real estate friends will find it helpful. We'll see!
@@Mjp1010 awesome best of luck! you can also check out my new product I co-founded called Coffee Clozers that finds the best deal in minutes for buy-and-hold investors too
Thanks
Thanks for watching!
Is there a way to get photos of a property from the API? Seems like all you get back is numerical data.
Thanks for watching Ollie, there’s an images endpoint here - rapidapi.com/apimaker/api/zillow-com1
hI Ariel. i keep on getting "Unable to retrieve data for" for all my addresses. :( am i entering the address, city, state, zip wrong? please help
Thanks for watching! If I had to assume you are likely not subscribed to the API. You can check by going to the API page. You should be able to "test" the API directly on the web page. If you do not see the "test" option then you likely will see "subscribe to test". This would mean you need to subscribe to use the API. For more questions feel free to ask directly in the Tech in Real Estate FB group
how to get information on garage and pool ?
Thanks for watching! It should be within one of the columns, @scrapeak could you confirm?
I tried to open the colab document without any luck. Not seeing it in GitHub. Am I doing something wrong? Not able to clone notebook.
Hey Kurt thanks for watching! Here is the link from within the show notes, please let me know if you have issues accessing - github.com/analyticsariel/projects/blob/master/property_data/zillow_property_data_api.ipynb
I see what you mean the link is broken. I cleaned up Github recently to be more organized, and it seems when I changed notebook names it didn't link back to colab appropriately. Thanks for bringing this to my attention, I will look to fix this soon - as a temp workaround you can manually download the file and upload it to Google drive to work with it in colab
If you can, it would be helpful to show where and how you add an API key (10:26) for a newbie like myself.
Hi Joshua thanks for watching! You can add in your API key directly as a string to the rapid_api_key variable. If you are a beginner to Python, then I suggest checking out my Intro to Real Estate Data Analytics playlist on TH-cam. We cover Python for beginners including data types, data frames, and visualizations 👍
@@TechInRealEstate I entered my Key at "rapid_api_key", but now I am getting a "name error." - 'file_dir' is not defined.
@@freddierex5036 Thanks for watching! The purpose of the file_dir variable is to point towards your API key from within a file. It looks like you are not using that functionality. In Python you can comment out code that is not in use by entering # before the line. Here's a resource - www.freecodecamp.org/news/python-multiline-comment-how-to-comment-out-multiple-lines-in-python/
how can I do this in podio?
Hi Deonte thanks for watching! If you join the Tech In Real Estate Facebook group then you can network with those who have added APIs to their Podio - facebook.com/groups/techinrealestate/?ref=share&mibextid=S66gvF
When running the section for List of properties in Colab I am getting a Key Error for "City" Column
# create empty list to store api response for property details
df_list = []
zpid_list = []
# iterate through dataframe
for index, row in df_upload.iterrows():
# get property address attributes by column name
street = row['Address']
city = row['City']
state = row['State']
zip_code = "0" + str(row['Zip Code']) # fix issue with zip code
my csv is
1 to 2 of 2 entries
Filter
index Address City State Zip Code. First Name Last Name Estimate Rent Estimate
0 71 Boundary Dr Stafford VA 22556 Greg Nosar NaN NaN
1 136 Joshua Rd Stafford va 22556 Wayne Kestner NaN NaN
Any Suggestions?
Thanks for watching! For errors the best way to troubleshoot is to view specific examples. After you upload the CSV file you can look at the specific values you have in the "City" field to see if there are issues with the string (perhaps it's loading with extra spaces). Here's a resource on pulling single values form a DataFrame - stackoverflow.com/questions/16729574/how-can-i-get-a-value-from-a-cell-of-a-dataframe
In addition, you can try inputting the city and state in the search directly for the API on Rapid's API website to confirm it has data for that area
@@TechInRealEstate thanks was able to fix that issue and ran however it's coming back
Unable to retrieve data for : 71 Boundary Dr, Stafford, VA, 22556
Unable to retrieve data for : 136 Joshua Rd , Stafford, Va, 22556
I know the rapidapi is working, it passed and collected the data on the single property search. Sorry to bother you, but really want this to work, could be VERY helpful to me. Thanks
Is this API still available?
Thanks for watching! Yes here is the link - rapidapi.com/apimaker/api/zillow-com1/
phone numbers?
Thanks for watching, you can reference how to get phone numbers, such as FSBO, from this video - How to Get Zillow Property Details with Python 2023
th-cam.com/video/Mvkrm5g6fFg/w-d-xo.html
@@TechInRealEstate Where can I go to hire someone that I can trust for a python that does specific automated things for me?
@@Knowledgedad Try our Tech in Real Estate Facebook group first, there you'd find a mix of investors and those that are real estate data analytics & web scraping focused. If not then you can try Fiverr as well
or just get the license and get access to everything with one click
Thanks for watching! Yes, direct access is always preferred. However for research projects, like grad students looking to gather property information for their thesis, they may need a faster solution for MVP'ing and testing their assumptions before going for a prod solution