Thank you for the video Learning Orbis, the layout and settings have changed considerably since you created this video. I think a large percentage of people would struggle to follow along to be honest, it might be worth you doing a quick refresher video for the people who aren't quite as familiar with api's etc.
Dude you're the best! I've tried these Data Scientists blog posts and nothing works! They have complicated code and some even required me to install external plugins. Yours is simple and makes use of what's already available within Google suite. Thanks a lot!
I just want to thank you so very much!!!! I am a new PhD stuent and I need these comments to start my pilot study. I wanted to rip these comments but having zero R or Python knowledge has made it so hard which has been driving me crazy for 2 days. Thank you for your super clear video.
There is a time limit of Google App Script to complete execution within 6 minutes. Even if one video has around 100 thousands comments the time limit will end the script so scrapping all comments of a channel is not a good idea. However this can be achieved using Python Programming Language without any time limit.
@@LearningOrbis do you know any paid apps to do that? due to my research even if we are ready to pay they give us option only to upload comments per video
Omg. This actually works. You saved me from reading over 20000 comment's, just to find the name of a song. One note, first i'v tried on Opera and didn't worked. But on Chrome, worked perfectly. I was sceptical to be honest, but there it is the new sheet. Now i hope I'll find what i wanted in those 20k comments, lol
Thanks so much for your useful tutorial! But when i got to the step of run the script (around 3:26) and it shows error at the code 8, saying "TH-cam not defined". Could you pls help me out on this? Will appreciate it!
Hi, thanks a lot for sharing! I encounter one problem when trying to follow your approach. I can't find Script Editor under TOOLS in the google spreadsheet. So I use the Apps Script to copy the code. When I run the code, I receive an error report which says "ReferenceError: TH-cam is not defined". I think it is because the Apps Script is unrelated to the google spreadsheet where I specified the TH-cam video. Could you please help me to solve this problem? Thank you in advance!
WAAAAAAAAAAAAAAAAAAA FINALLY I found some useful tutorial video that's not expired (I mean this is really helpfull) I've been looking to a lot of video how to get youtube data comment + reply comment. but lot of the video are kinda error(because it's an old video over a year. so the tutorial are kinda outdated) . and I was mad 🤣😂. But this. thank kou. really helpful
it would be perfect if we can make it for entering multiple id at once. adding link and name of the video to the last line can be good. is there any chance to update accordingly.
hello and thank you very much for this video, what I would like to do is a little different since I would like to download google sheet comments from 50 public TH-cam videos I use the import function of Google sheet but I don't understand why it doesn't work I don't understand since it works on other sites but not public videos? do I need to create an API for this? and I use apscript? but I don't know anything about the code, is it possible to do it in the API connector extension?
Note that the channel will be my own. Its another channel. It has timestamps in the description which i want to forward via WhatsApp message. When someone hit the time timestamp in WhatsApp message, it will play the video from that timestamp onwards
Thanks for the information you shared here! i have a question, if there is a on every 'enter' on the comment entries how do we convert it to an actual enter? have a good day!
You can convert that to actual enter using the excel formula. The first comment is in Cell B2, so in any cell e.g. F2 you can write this formula: =SUBSTITUTE(B2, "", CHAR(10)) Then it will also be better to wrap text by clicking 'Wrap Text' button. I hope you know how to drag a formula down to each each row. Let me know if issue gets resolved.
@@LearningOrbis hi thank you for this answer, I came upon new problem... this time, where I run the code the notice goes ReferenceError: TH-cam is not defined @code.gs:9 is there is something I can do with this error?
Hello, the video is very on and clear. However, I found a problem. I've tried according to the steps that have been described, but my sheet doesn't change at all (no comment list from the video in question). What should I do? Thank you
Thank you so much for uploading this video! I really appreciate your work. I'm wondering if we can set certain dates when crawling these TH-cam comments because I've realized that TH-cam video with significantly large number of comments do not work with this code :( For example, is there a way for me to collect comments from dates between Jan 21 2021 ~August 21 2021? Thank You!
hi, thank you for video, but I have a problem. First time all was ok, I scraped comments with replies, but after I restarted notebook and re-ran this code nothing happened, so I have tried to repeat all step by step from begin and have got next error "TypeError. Cannot read property 'get sheets' of null (line 4, file code) And now i dont know how to solve it. Could you help me please
Hi. This seems strange. I would recommend creating a new sheet and do all steps again. If you still have the issue, you can share the sheet with me and I will have a look!
Dear sir, pls upload the fresh video as the script interface has changed a lot now. The code is also giving the error 9:21:22 PM Error ReferenceError: TH-cam is not defined scrapeCommentsWithoutReplies @ Code.gs:8
The interface is little changes. Now it is under Extensions. But there is no problem with code. You need to turn on TH-cam services as mentioned in the video.
Thank you for your hard work! This is really helpful!! You're amazing One question, though. If there are new comments on the TH-cam video after we ran this script. Will they be automatically added onto the google sheet? Or do we have to re-run the script? Cheers!
What an amazing content. Searching for this kind of tool and always ended up with paid software's. You have done the job very efficiently. Appreciate your work. Keep it up :) -Team Fintaxpro
GoogleJsonResponseException: API call to youtube.comments.list failed with error: No filter selected. Expected one of: id, parentId why it is showing this error?
Thank you so much for this very helpful tutorial. You saved my day!!! But I have a project on Excel and I'm searching with no sucess something like this to scrap directly on it. Do you have on how to do that?
@@LearningOrbis I am still stuck here. With the new changes, I am unable to find a way out. Can't find resources either. :(. People like me who look for answers in the comment section can be helped here. Thanks
Selam Brother. Wonder if there might be a code to scrape YT channel and all video of that channel searching for specific word? ex. I would like to see a list of videos from a specific channel only where a specified word is found in video description and/or comments
Thank you for the nice thing.....can you post a video showing that how can we get the contact details of the person making comments on videos in any channel.
Hi, I'm trying to run this on a video that has hundreds of thousands of comments, and it keeps on bugging out. is there any way to edit the code to get the 300 most liked comments?
Hi, Instead of 300 most liked comments, we can scrape first 300 or first few thousand comments. For that see this code: github.com/MAN1986/LearningOrbis/blob/master/scrapeFewComments.gs See line number 6 of above code: var total=1000 You may change that 1000 to any number but as multiple of 100. Above code will scrape comments without replies. If you want to scrape with comments, you can use this code: github.com/MAN1986/LearningOrbis/blob/master/scrapeFewCommentsWithReplies.gs Let me know if this solves your issue.
It can be done but not feasible. Google Sheet Scripts have a time limit of 6 minutes. If the script is not completely executed in 6 minutes, it will abort. Even if a single video has many many comments, this script can fail.
Hello! I am having a problem when running the script. When running the first code, I receive this message : ReferenceError: TH-cam is not defined (line 8, file "Code"). I have looked for solutions online but could not find any. Any help would be greatly appreciated! Thank you
nevermind, I found the solution! If anybody else encounters this problem, all you have to do is to go to resources, Advanced Google Services, TH-cam Data API v3, And turn it on. Turn on TH-cam Data API v3 then it will work. For some reason mine was turned off, even though I had it on a few hours ago. Great video.
brother, just want to know can we reply to comments using the same technique? Like add the comments to Google Spreadsheet and then run a code and automatically youtube comments will be posted?
Thanks, but I got an issue with more than 25K - 30K comments for download by this way. Apps Script can execute up to 6 minutes the code with replies. So what can I do for skipping this current limit? - I still need download all comments & repplies. Thanks again!
@@LearningOrbis Yes, I noticed too in the current platform limits section. Now I'm interested if there's an extra code for avoid the 6 minutes limit on App Script or doing in microsoft excel software with any extension by some way. Anyway, cool instructions and simple explanations for such useful tool. Thanks for the answer!
Thank you so much for this and great taste of music there. I'm wondering if there's way to do the same thing with like facebook reactions and comments.
I noticed that HTML code is displayed instead of actual readable character in cells of Google Sheets. For example for line break, and ' for apostrophe ( ' ). Is there any solution to display actual characters?
Hello, do in need to activate Google Cloud Platform to use this Script, i also get the Error (ReferenceError: TH-cam is not defined scrapeCommentsWithoutReplies @ Code.gs:8) when i run the script, but i have the permision mentioned in your Video. Thx for your great work.
Thanks. I've followed your video and tried it but didn't work... It shows the message ; ReferenceError: TH-cam is not defined scrapeCommentsWithoutReplies @ Code.gs:8. How can I fix it?
Thanks. A really nice video. I particularly liked you checking the numbers as you went along. I did wonder about the quota system operated by the api. I know it works seamlessly in the background when the api is accessed from apps scripts but believe it still counts. Did you find problems of processing too much data in a period of time? Does each piece of data count towards the quota or is it per user or other grouping (i.e. should one only retrieve the exact data they want from a comment, like the user's name or does it use no more quota to get all the data for a given comment)?. Again, thanks and good luck.
Thanks a lot. Actually there is limit on script execution time (5 min) and the script will stop after that. The limit is on time and not exactly on the volume of data. A good script can process large data in this time compared to a poorly written script. There can be a way to handle this time limit by using the script trigger. This is a fault at my end that I could not add that despite a few people requesting that. Actually I am quite busy in my teaching assignments and I wish I get some time to add this feature too.
@@LearningOrbis Hey man, thank you soo much for this! Can't you still work on it's time limitation? We can suport and contribute with you, or you can give your price to that. It's really something needed
thank you very much for your tutorial. He will help me a lot, even though I am not an IT specialist. I will try to follow your instructions step by step to get to download the comments of a video that I am studying at university. However, if I understood correctly, once you have made your first page, you have to create a second to add it to the first? Thanks for the code page links. Do I have to paste them on a new google doc page?
Welcome to my channel! You need to add the video ID on first sheet and then run the code. The code will create a new sheet by itself and scrape the comments in that new sheet. The present layout is a little bit changed and may be you are facing problem because of that. The best I can do for you is that you can share you Gmail id here and tell me the video. Also tell me, if you need just the comments or comments with replies. I will create a google sheet, will do all setting and will share that with you. And you will be able to use that for any other video as well.
I have an error when running the code, it says: GoogleJsonResponseException: API call to youtube.commentThreads.list failed with error: No filter selected. Expected one of: videoId, channelId, allThreadsRelatedToChannelId, id (line 8, file "Code")
You should add TH-cam services. For that on the left side you will see a pallet having Files, Libraries, Services. Click the plus symbol of Services. A new window will open, from there select, TH-cam Data API v3 and click Add button.
This works so well for downloading comments and replies from videos. Is there a way it can be modified to scrape comments and replies from the community page of a channel as well? Thank you!
If you have a comment in Cell B3, you can use this formula in any excel cell: =SUBSTITUTE(B3,"'","'") It will substitute ' by ' Let me know if it worked :)
Hi , i have a problem when im using your code in some videos. I have this error : GoogleJsonResponseException: Échec de l'appel d'API vers youtube.commentThreads.list awith this error : The video identified by the videoId parameter has disabled comments. (ligne 8, fichier "Code"). Have u any tips to resolve this ?
@@LearningOrbis Very good. I successfully ran the script once. The first run was beautiful, pulled in 1500 comments and allowed me to do my research quicker than before. However, now I tried a second video and it was unsuccessful using the same spreadsheet. Even though I used a different video code, the script repeated the scrape on the first video. I deleted the first scrape and tried, getting an error. Then, I opened a new spreadsheet and added the new video code, then tried to run the script. I got: "ReferenceError: TH-cam is not defined (line 9, file "Code")" I started from scratch with another new spreadsheet and the results are the same with another video, so I can't get beyond this issue. Hope you can help. Thanks.
Actually there should not be any issue when you use a new video ID. The code creates a new sheet and scrape the comments there. Regarding the ReferenceError on new spreadsheet, Make sure to turn on the TH-cam services as shown from 02:02 to 02:43 Let me know if the issue is resolved.
This is a really great tutorial and my first time using app script. Does the API allow us to scrape comments from multiple videos at once. And if yes, how do I modify the script?
I got this error when I ran the code without the replies and I guess it will be the same for the one with the replies. It doesn't allow me to move on. What can I do?: "GoogleJsonResponseException: API call to youtube.commentThreads.list failed with error: The video identified by the videoId parameter could not be found. (line 8, file "Code") "
Apparently it looks like you are not copying the video id correctly (from the youtube video link). So please share the video link here and I will check.
Yes, I have two videos actually. 1. th-cam.com/video/Ie_mnxsY2Yw/w-d-xo.html&ab_channel=KonstantinaAdamaki and 2. th-cam.com/video/ZUVzB6Kn-0k/w-d-xo.html&ab_channel=Neocleous
Hi. Thanks for this tutorial- very helpful. Do you have one on how to scrape comments on a public FB page on Google sheet (similar to what you have here but for FB)?
Welcome! For that I will have to explore FB API in detail and at present it looks hard to spare time for that. Many people have asked this in comment section but trust me I am not getting time to explore that. Really sorry for that.
Guys need a quick help. 1. How to modify it to write the video link or title in the sheet 2. How to make it run for multiple videos at a time. And to mention very useful video. Thanks in advance for help.
Regarding the comma query use this info: If you have a comment in Cell B3, you can use this formula in any excel cell: =SUBSTITUTE(B3,"'","'") It will substitute ' by ' Then regarding the multiple videos scrapping, it is not a good idea. The time limit for google sheet script is 5 min and after that it will stop. So even if one video has like million comments, it will fail to scrape. And so we should not try it on multiple videos.
@@LearningOrbis yes just appending the video id with the standard prefix should give the url so it should not be tough. As I have no good experience with excel i cannot do it i cannot modify the script. Just writing the url in the first line and start writing data from second line will not be difficult for someone like you with good experience with app scripts.
Yes you are right but there is a catch. Sometime there is detail of current time and the playlist of the youtube video in url. In that case the video id is not at the end of the url. So, that will generate error with the code and hence I decided to place the video id directly in the cell. Anyways, if you want to get the video id part from the url (without having the time and playlist info) then I can write a excel formula for you. But be careful that if there will be time or playlist info in the url, that will generate error.
Brother, I scrapped your video's comments and there is no issue. I have added you in that Google Sheet. You must have received that email for sheet with name "For Shakil Azam". I don't know where you did the mistake in following the tutorial but now you can use the sheet I shared to scrape any video's comments. Hope it helps!
I have made you the owner of the sheet and removed myself. You can use the sheet and if you get ant safety warning like mentioned at 2:46 , just allow that as shown in the video. Thanks
@@LearningOrbis I am currently studying Media and Communications and I am participating in a course called "Digital Media Analysis" where we utilize a multitude of programs such as SNScrape to gather data and ConText and Graphi to process it and visualize it. Sadly, SNScrape is now unable to scrape Twitter data due to legal matters, thus I was forced (for an assignment) to gather youtube comments instead and assign sentiment analysis through ConText. Thanks to your video, I was able to gather the data which I am now processing through context. For these reasons, I am extremely greatful of your video. Thank you again for your awesome work
Hey, how can I limit the amount of comments to be scrapped? For example, I only want to scrap 1000 comments from the video because it has too many. Thank you
Here we go. Use this code: github.com/MAN1986/LearningOrbis/blob/master/scrapeFewComments.gs On line number 6, you can see the value is 1000. You can change to to any value and it will scrape those many comments. Note two things: 1- The number of comments should be multiple of 100. 2- It will always be the newest comments. Let me know if it worked for you!
Thank you for the video Learning Orbis, the layout and settings have changed considerably since you created this video. I think a large percentage of people would struggle to follow along to be honest, it might be worth you doing a quick refresher video for the people who aren't quite as familiar with api's etc.
Dude you're the best! I've tried these Data Scientists blog posts and nothing works! They have complicated code and some even required me to install external plugins. Yours is simple and makes use of what's already available within Google suite. Thanks a lot!
Glad I could help!
very nicely explained and useful video.. please note that the script editor is now changed to "App Script" under extensions menu.
I was able to change it to classic. It changed to the screen he used.
I just want to thank you so very much!!!! I am a new PhD stuent and I need these comments to start my pilot study. I wanted to rip these comments but having zero R or Python knowledge has made it so hard which has been driving me crazy for 2 days. Thank you for your super clear video.
You are so welcome!
1:28 "script editor" n macros isn't showing in my google sheet, what should I do?
Now the option is under Extensions --> Apps Script
Thank you! Can you create script to download comments of all videos from channel ? Otherwise have to make every video separately
There is a time limit of Google App Script to complete execution within 6 minutes. Even if one video has around 100 thousands comments the time limit will end the script so scrapping all comments of a channel is not a good idea.
However this can be achieved using Python Programming Language without any time limit.
@@LearningOrbis do you know any paid apps to do that? due to my research even if we are ready to pay they give us option only to upload comments per video
You can contact me to discus this further at mahsan.naeem@gmail.com
there is no option of script editor inside tools bar in my google sheets. where it will be?
The layout keeps changing. Now it is under "Extensions"
THIS IS THE MOST POWERFUL, MINDFUL, EASY WAY TO LEARN THAN A VIDEO THAT I WATCHED BEFORE :)
THANK YOU SO MUCH.. SO HAPPY :)
GOOD JOB.
Thanks for the kind words! 😊
Omg. This actually works. You saved me from reading over 20000 comment's, just to find the name of a song.
One note, first i'v tried on Opera and didn't worked. But on Chrome, worked perfectly.
I was sceptical to be honest, but there it is the new sheet. Now i hope I'll find what i wanted in those 20k comments, lol
Glad to know that you liked it... :)
@@LearningOrbis subscribed already. Even im nub, lol. Very well explained video
Thank you :)
Thank you so much this worked great! I'd been using another website to download my YT comments but the site stopped working and this worked perfectly
Very straightforward and well explained, especially the scary Google warnings! Exactly what I was looking for :) I hope 2021 is being good for you.
Thanks a lot 🙂
@@LearningOrbis Thanks a lot
@@subhashiniramanathan9321 You are Welcome!
Rich content...saves time from actually building a scrapper...now I can go straight to feeding the NDL for my neural project....Thanks a bunch.🎉👏
All the best for your project.
Have you deployed your app successfully ? Like I'm getting driver exceptions everytime I run
Thank you for this video. Just wondering if we can apply the same process for TH-cam shorts?
Thanks so much for your useful tutorial! But when i got to the step of run the script (around 3:26) and it shows error at the code 8, saying "TH-cam not defined". Could you pls help me out on this? Will appreciate it!
Nvm, I solved the problem, thank you so much for the awesome code!
Hi, thanks a lot for sharing! I encounter one problem when trying to follow your approach. I can't find Script Editor under TOOLS in the google spreadsheet. So I use the Apps Script to copy the code. When I run the code, I receive an error report which says "ReferenceError: TH-cam is not defined". I think it is because the Apps Script is unrelated to the google spreadsheet where I specified the TH-cam video. Could you please help me to solve this problem? Thank you in advance!
Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if issue gets resolved!
@@LearningOrbis Thanks for your reply. Yes, it is working now with the permission!
@learningorbis - can you also how to extract for multiple videos with just URLs and not videos. Example - if I have 10 videos, how do it for all?
One by one :)
WAAAAAAAAAAAAAAAAAAA
FINALLY
I found some useful tutorial video that's not expired (I mean this is really helpfull)
I've been looking to a lot of video how to get youtube data comment + reply comment.
but lot of the video are kinda error(because it's an old video over a year. so the tutorial are kinda outdated)
. and I was mad 🤣😂.
But this. thank kou. really helpful
Glad to hear that 🙂
Thanks! How can we also get Comment_ID?
it would be perfect if we can make it for entering multiple id at once. adding link and name of the video to the last line can be good. is there any chance to update accordingly.
You are an absolute legend! Thank you!!!!
Subscribed 😍
Thanks for the sub!
hello and thank you very much for this video, what I would like to do is a little different since I would like to download google sheet comments from 50 public TH-cam videos
I use the import function of Google sheet but I don't understand why it doesn't work
I don't understand since it works on other sites but not public videos?
do I need to create an API for this? and I use apscript?
but I don't know anything about the code, is it possible to do it in the API connector extension?
I want to copy the description of a TH-cam video WITH Hyperlinks in it. How to do it?
Will have to explore TH-cam Data API for that. Don't have the ready solution as yet.
Will have to explore TH-cam Data API for that. Don't have the ready solution as yet.
Thanks for the reply. Eagerly awaiting
Note that the channel will be my own. Its another channel. It has timestamps in the description which i want to forward via WhatsApp message. When someone hit the time timestamp in WhatsApp message, it will play the video from that timestamp onwards
In my google sheet,tools option doesn't showing the option of script editor?
The layout keeps changing. Now it is under "Extensions"
@@LearningOrbis ok.. It showing an error. TH-cam is not defined..
@@LearningOrbis i have an emergency.. I want to copy 5 youtube video comments in a google sheet.. Can you help me🥺.
Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if issue gets resolved!
@@LearningOrbis Thank you.
Now its worked
Thanks for the information you shared here! i have a question, if there is a on every 'enter' on the comment entries how do we convert it to an actual enter? have a good day!
You can convert that to actual enter using the excel formula. The first comment is in Cell B2, so in any cell e.g. F2 you can write this formula:
=SUBSTITUTE(B2, "", CHAR(10))
Then it will also be better to wrap text by clicking 'Wrap Text' button.
I hope you know how to drag a formula down to each each row.
Let me know if issue gets resolved.
@@LearningOrbis hi thank you for this answer, I came upon new problem... this time, where I run the code the notice goes ReferenceError: TH-cam is not defined @code.gs:9 is there is something I can do with this error?
@@louisianafebe7951 Make sure you turned on the TH-cam services as shown at 2:33
This was a life-saver for a research project I am working on. Thank you for the very informative video and useful code!
Glad it was helpful!
What type of project is it if you dont mind me asking and how does scraping comments provide value for you. Thanks for your time.
Hello, the video is very on and clear. However, I found a problem. I've tried according to the steps that have been described, but my sheet doesn't change at all (no comment list from the video in question). What should I do? Thank you
You can share the Google Sheet with me (mahsan.naeem@gmail.com) and I will see exactly where you are having the problem.
GOD BLESS YOU, Learning Orbis!!!! THANKS A MILLION :D!!!
How do I extract a video caption using the TH-cam API?
please make code for youtube analytics , account , videos details scrapper
I am sorry at the moment its not possible since I am busy with my other online course. But hopefully after a couple of months I will work on that.
Thank you so much for uploading this video! I really appreciate your work.
I'm wondering if we can set certain dates when crawling these TH-cam comments because I've realized that TH-cam video with significantly large number of comments do not work with this code :(
For example, is there a way for me to collect comments from dates between Jan 21 2021 ~August 21 2021?
Thank You!
hi, thank you for video, but I have a problem. First time all was ok, I scraped comments with replies, but after I restarted notebook and re-ran this code nothing happened, so I have tried to repeat all step by step from begin and have got next error "TypeError. Cannot read property 'get sheets' of null (line 4, file code) And now i dont know how to solve it. Could you help me please
Hi. This seems strange. I would recommend creating a new sheet and do all steps again. If you still have the issue, you can share the sheet with me and I will have a look!
Is there a way to automate running this script and have it append new comments to the same sheet?
Dear sir, pls upload the fresh video as the script interface has changed a lot now. The code is also giving the error
9:21:22 PM Error
ReferenceError: TH-cam is not defined
scrapeCommentsWithoutReplies @ Code.gs:8
The interface is little changes. Now it is under Extensions. But there is no problem with code. You need to turn on TH-cam services as mentioned in the video.
Exactly what I needed. Thanks for sharing and keep up the good work, I'm confident it will pay off for you!
Thanks a lot 🙂
Thank you for your hard work! This is really helpful!! You're amazing
One question, though. If there are new comments on the TH-cam video after we ran this script. Will they be automatically added onto the google sheet? Or do we have to re-run the script? Cheers!
Thanks.
No you will have to re-run the script.
How to get the URL onto the sheet as well? I want the URL of the video beside each comment
Do this process work on Mac pro?
I failed. Not working.
I think there should not be any issue.
Tell me the video and share your email. I will check and make you the owner of that google sheet.
What an amazing content.
Searching for this kind of tool and always ended up with paid software's. You have done the job very efficiently.
Appreciate your work. Keep it up :)
-Team Fintaxpro
Thanks a lot 🙂
GoogleJsonResponseException: API call to youtube.comments.list failed with error: No filter selected. Expected one of: id, parentId
why it is showing this error?
Which video ID you are using?
@@LearningOrbis uD58-EHwaeI
this one
Thank you so much for this very helpful tutorial. You saved my day!!! But I have a project on Excel and I'm searching with no sucess something like this to scrap directly on it. Do you have on how to do that?
You want comments in Excel File? You can download the google sheet as excel file.
@@LearningOrbis Ok, thanks!
Why it shows:ReferenceError: TH-cam is not defined
scrapeCommentsWithReplies?
Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if issue gets resolved!
@@LearningOrbis I am still stuck here. With the new changes, I am unable to find a way out. Can't find resources either. :(. People like me who look for answers in the comment section can be helped here. Thanks
Selam Brother.
Wonder if there might be a code to scrape YT channel and all video of that channel searching for specific word?
ex. I would like to see a list of videos from a specific channel only where a specified word is found in video description and/or comments
Yes TH-cam API has this data point.
@@LearningOrbis how could I achieve this? Do you have script for something like this?
I don't have the ready script :(
@@LearningOrbis 😭 I hope you will end up coding script like this 🙏🙏🙏
@@LearningOrbis i tried playing a little but i cannot make it work lol :/
I am trying to use this, but it appears the script editor has been removed from Google Sheets.
Now it is under Extensions--> Apps Script
Thank you for the nice thing.....can you post a video showing that how can we get the contact details of the person making comments on videos in any channel.
Thanks.
Actually TH-cam doesn't public the contact information.
I get a Error ReferenceError: TH-cam is not defined (line 8, file "Code")
Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if issue gets resolved!
Hi, I'm trying to run this on a video that has hundreds of thousands of comments, and it keeps on bugging out. is there any way to edit the code to get the 300 most liked comments?
Hi,
Instead of 300 most liked comments, we can scrape first 300 or first few thousand comments.
For that see this code:
github.com/MAN1986/LearningOrbis/blob/master/scrapeFewComments.gs
See line number 6 of above code:
var total=1000
You may change that 1000 to any number but as multiple of 100.
Above code will scrape comments without replies. If you want to scrape with comments, you can use this code:
github.com/MAN1986/LearningOrbis/blob/master/scrapeFewCommentsWithReplies.gs
Let me know if this solves your issue.
Is this the simplest way to download comments? Seems rather complicated? Should be a 'one button' click?
You need to setup this once and then its just putting the Video Link and pressing 'one button'.
Sir Can you plese tell me the code for the batch extraction of comments from multiple videos.....
It can be done but not feasible. Google Sheet Scripts have a time limit of 6 minutes. If the script is not completely executed in 6 minutes, it will abort. Even if a single video has many many comments, this script can fail.
Arise this error "ReferenceError: TH-cam is not defined". How can I solve this problem?
You did not included the TH-cam API. Please follow the steps mentioned in the video.
Good job! Is it possible to download comments for the whole playlist, specifying which comment is for which video?
Not possible with the existing code. Would need to update the code.
Hello! I am having a problem when running the script. When running the first code, I receive this message : ReferenceError: TH-cam is not defined (line 8, file "Code"). I have looked for solutions online but could not find any. Any help would be greatly appreciated! Thank you
nevermind, I found the solution! If anybody else encounters this problem, all you have to do is to go to resources, Advanced Google Services, TH-cam Data API v3, And turn it on. Turn on TH-cam Data API v3 then it will work. For some reason mine was turned off, even though I had it on a few hours ago. Great video.
I have mentioned in video that you have to turn on the TH-cam Data API. Glad that you got it resolved :)
brother, just want to know can we reply to comments using the same technique? Like add the comments to Google Spreadsheet and then run a code and automatically youtube comments will be posted?
No. That's not possible 🙂
Wow!! You have helped the world in a great way. This is a fantastic tool for cutting research time in half!
Thank you for the compliments 🙂
Thanks. Permit me to share this with others too.
But what should one do when one gets this message? "Exceeded maximum execution time"
Thanks, but I got an issue with more than 25K - 30K comments for download by this way. Apps Script can execute up to 6 minutes the code with replies. So what can I do for skipping this current limit? - I still need download all comments & repplies. Thanks again!
I am really sorry that this code will scrape the comments with time limit of 6 minutes 🙁
@@LearningOrbis Yes, I noticed too in the current platform limits section. Now I'm interested if there's an extra code for avoid the 6 minutes limit on App Script or doing in microsoft excel software with any extension by some way. Anyway, cool instructions and simple explanations for such useful tool. Thanks for the answer!
There can be way but I could not explore that :(
Thank you so much for this and great taste of music there. I'm wondering if there's way to do the same thing with like facebook reactions and comments.
Thanks.
I have not explored Facebook data API yet. Sorry for that.
@@LearningOrbis it's fine, thank you again regardless.
I noticed that HTML code is displayed instead of actual readable character in cells of Google Sheets. For example for line break, and ' for apostrophe ( ' ). Is there any solution to display actual characters?
Yes you can use some google sheet formula to replace those texts.
@@LearningOrbis I used "Find - Replace" and edited the text. I wrote to know if any script would help. Thank you for your prompt reply.
Hello,
do in need to activate Google Cloud Platform to use this Script, i also get the Error (ReferenceError: TH-cam is not defined
scrapeCommentsWithoutReplies @ Code.gs:8) when i run the script, but i have the permision mentioned in your Video. Thx for your great work.
Hello,
Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if issue gets resolved!
Hi, it's very helpfull video. but, i can't find script editor in my spreadsheet tools, can you help me? thnkss
The outlook keeps changing. Now you need to go to Extensions-->App Scripts
Thanks. Really useful. Can you please also guide, how to extract phone numbers from all pages of a website.
Thanks.
For that you need web scraping. I haven't done that but you can easily find help on that.
Thanks. I've followed your video and tried it but didn't work... It shows the message ; ReferenceError: TH-cam is not defined
scrapeCommentsWithoutReplies @ Code.gs:8. How can I fix it?
Make sure to turn on the youtube services as shown from 02:02 to 02:43
Thanks. A really nice video. I particularly liked you checking the numbers as you went along. I did wonder about the quota system operated by the api. I know it works seamlessly in the background when the api is accessed from apps scripts but believe it still counts. Did you find problems of processing too much data in a period of time? Does each piece of data count towards the quota or is it per user or other grouping (i.e. should one only retrieve the exact data they want from a comment, like the user's name or does it use no more quota to get all the data for a given comment)?. Again, thanks and good luck.
Thanks a lot. Actually there is limit on script execution time (5 min) and the script will stop after that. The limit is on time and not exactly on the volume of data. A good script can process large data in this time compared to a poorly written script.
There can be a way to handle this time limit by using the script trigger. This is a fault at my end that I could not add that despite a few people requesting that. Actually I am quite busy in my teaching assignments and I wish I get some time to add this feature too.
@@LearningOrbis Hey man, thank you soo much for this! Can't you still work on it's time limitation? We can suport and contribute with you, or you can give your price to that. It's really something needed
thank you very much for your tutorial. He will help me a lot, even though I am not an IT specialist. I will try to follow your instructions step by step to get to download the comments of a video that I am studying at university.
However, if I understood correctly, once you have made your first page, you have to create a second to add it to the first?
Thanks for the code page links. Do I have to paste them on a new google doc page?
Welcome to my channel!
You need to add the video ID on first sheet and then run the code. The code will create a new sheet by itself and scrape the comments in that new sheet.
The present layout is a little bit changed and may be you are facing problem because of that. The best I can do for you is that you can share you Gmail id here and tell me the video. Also tell me, if you need just the comments or comments with replies. I will create a google sheet, will do all setting and will share that with you. And you will be able to use that for any other video as well.
@@LearningOrbis can you share with me? My coding eror in (var data ) section, please
@@dindatasyamahardika1437 Yes. Plz share the link of the video.
I had a problem of running it and what should I do?
What exactly is the problem? I would suggest to follow each step carefully and let me know which step you are unable to follow.
when will you update your video, i need toturial sracpe in youtobe comment with google appscript current version
It works on the current version. The difference is on Google Sheet layout. Now you need to go to Extensions-->Apps Script.
@@LearningOrbis th-cam.com/video/HSVfmLSz5Vk/w-d-xo.html why i can't scrape this link, but i try other links it work
I tried and it's working on the link you provided. Use this video id:
HSVfmLSz5Vk
@@LearningOrbis thank you so much sir 👍
You are welcome!
I have an error when running the code, it says:
GoogleJsonResponseException: API call to youtube.commentThreads.list failed with error: No filter selected. Expected one of: videoId, channelId, allThreadsRelatedToChannelId, id (line 8, file "Code")
Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if issue gets resolved!
How to scrape emails from TH-cam comments ?
That is not possible since the email info is never there.
I have a PDF which is in Punjabi Language of INDIA. So, it is difficult for me how to extract data from it. Please help me, Sir...
I have not worked on that. But I can try. Send me the pdf at mahsan.naeem@gmail.com
URGENT!! please help : it is giving error - TH-cam is not defined line number 9 in the second code , how to solve this?
You should add TH-cam services.
For that on the left side you will see a pallet having Files, Libraries, Services. Click the plus symbol of Services. A new window will open, from there select, TH-cam Data API v3 and click Add button.
problem with Exceeded maximum execution time，is there a way to solve this？
Unfortunately there is a time limit we get on google cloud and when the comments are too many, that limit exceeds.
Which video you are trying?
Can we save live chat in the same way as well
No.
This works so well for downloading comments and replies from videos. Is there a way it can be modified to scrape comments and replies from the community page of a channel as well? Thank you!
This is written in JS, right? Can you also do it in Python?
Personally I also prefer to work on Python. But Google Sheet scripts are written in JS and have better support in JS.
Thanks a lot, works well on November 2022. Be patient with large amount of comments! cloud services steps are not longer required
Thanks! What do you mean by "cloud services steps are not longer required"
can i know how to convert ' back to ' ?
this video help me alot thanks =D
If you have a comment in Cell B3, you can use this formula in any excel cell:
=SUBSTITUTE(B3,"'","'")
It will substitute ' by '
Let me know if it worked :)
Hi , i have a problem when im using your code in some videos. I have this error : GoogleJsonResponseException: Échec de l'appel d'API vers youtube.commentThreads.list awith this error : The video identified by the videoId parameter has disabled comments. (ligne 8, fichier "Code").
Have u any tips to resolve this ?
Please follow the steps correctly. If still have the issue, let me know the video you are trying to scrape and I will check at my end.
sir, what programming language do you use?, pyton?
It's basically Google App Script which is based on JavaScript.
@@LearningOrbis thank you, me from Indonesian, thank you for the information, this is useful for my undergraduate thesis research
Very well explained. I'm just curious...Is there a limit to the use of this before Google takes action against an account?
Thanks Jerry.
TH-cam has provided the Data API and as such there is no limit.
@@LearningOrbis Very good. I successfully ran the script once. The first run was beautiful, pulled in 1500 comments and allowed me to do my research quicker than before. However, now I tried a second video and it was unsuccessful using the same spreadsheet. Even though I used a different video code, the script repeated the scrape on the first video. I deleted the first scrape and tried, getting an error.
Then, I opened a new spreadsheet and added the new video code, then tried to run the script. I got: "ReferenceError: TH-cam is not defined (line 9, file "Code")"
I started from scratch with another new spreadsheet and the results are the same with another video, so I can't get beyond this issue. Hope you can help. Thanks.
Actually there should not be any issue when you use a new video ID. The code creates a new sheet and scrape the comments there.
Regarding the ReferenceError on new spreadsheet, Make sure to turn on the TH-cam services as shown from 02:02 to 02:43
Let me know if the issue is resolved.
@@LearningOrbis Hi, I followed the instructions and got another reference error, that the "(video ID) is not defined (line 9, file "Code")"
@@LearningOrbis I ran the script on a completely new video in a new spreadsheet, and it worked perfectly.
This is a really great tutorial and my first time using app script. Does the API allow us to scrape comments from multiple videos at once. And if yes, how do I modify the script?
Yes, it will allow but there is a time-limit of Google Sheet script which is 5 minutes. After 5 minutes the script stops. So better not to go for it.
Thanks bro, this was indeed helpful. Can you tell which language this code is in? Is it Java ?
It is Google Apps Script which uses JavaScript.
thank you so much it really helpful! btw plz I need to know, what language is it?
The script is written as Google App Script which uses JavaScript.
I got this error when I ran the code without the replies and I guess it will be the same for the one with the replies. It doesn't allow me to move on. What can I do?: "GoogleJsonResponseException: API call to youtube.commentThreads.list failed with error: The video identified by the videoId parameter could not be found. (line 8, file "Code") "
Please share the video link and let me try on that.
Apparently it looks like you are not copying the video id correctly (from the youtube video link). So please share the video link here and I will check.
Yes, I have two videos actually. 1. th-cam.com/video/Ie_mnxsY2Yw/w-d-xo.html&ab_channel=KonstantinaAdamaki and 2. th-cam.com/video/ZUVzB6Kn-0k/w-d-xo.html&ab_channel=Neocleous
I have checked both videos and there is no issue.
Use this video id for first video:
Ie_mnxsY2Yw
And use this one for the second:
ZUVzB6Kn-0k
@@LearningOrbis Thank you very very much! It's working. Thank you for the effort
Is it possible to collect only the most liked comments? Like for example only 1000 most liked comments.
Not possible.
Is it free to use the data comments API ?
Yes
Bro !! interface has changed . Cant folllow your instructions on new Google UI.
Need to go to:
Extensions--> Apps Script
cannot see script editor option only macros
Go to Extensions--> Apps Script
Hi. Thanks for this tutorial- very helpful. Do you have one on how to scrape comments on a public FB page on Google sheet (similar to what you have here but for FB)?
Welcome!
For that I will have to explore FB API in detail and at present it looks hard to spare time for that. Many people have asked this in comment section but trust me I am not getting time to explore that.
Really sorry for that.
Guys need a quick help.
1. How to modify it to write the video link or title in the sheet
2. How to make it run for multiple videos at a time.
And to mention very useful video.
Thanks in advance for help.
Regarding the comma query use this info:
If you have a comment in Cell B3, you can use this formula in any excel cell:
=SUBSTITUTE(B3,"'","'")
It will substitute ' by '
Then regarding the multiple videos scrapping, it is not a good idea. The time limit for google sheet script is 5 min and after that it will stop. So even if one video has like million comments, it will fail to scrape. And so we should not try it on multiple videos.
@@LearningOrbis Thanks for reply. But the first question is unanswered.
Yes that should be possible but at present I don't know exactly the way and will have to explore the API further. BTW the video ID is part of the url.
@@LearningOrbis yes just appending the video id with the standard prefix should give the url so it should not be tough. As I have no good experience with excel i cannot do it i cannot modify the script. Just writing the url in the first line and start writing data from second line will not be difficult for someone like you with good experience with app scripts.
Yes you are right but there is a catch. Sometime there is detail of current time and the playlist of the youtube video in url. In that case the video id is not at the end of the url. So, that will generate error with the code and hence I decided to place the video id directly in the cell.
Anyways, if you want to get the video id part from the url (without having the time and playlist info) then I can write a excel formula for you. But be careful that if there will be time or playlist info in the url, that will generate error.
How I can get e-mail IDs of people who are commenting...please help
TH-cam doesn't provide this information. So emails information is never available inside TH-cam Data. Stop trying for that.
why showing TypeError: Cannot read property 'getSheets' of null
Are you placing the video id on top left cell? Can you share the Google sheet with me mahsan.naeem@gmail.com
@@LearningOrbis check inbox
Brother, I scrapped your video's comments and there is no issue. I have added you in that Google Sheet. You must have received that email for sheet with name "For Shakil Azam".
I don't know where you did the mistake in following the tutorial but now you can use the sheet I shared to scrape any video's comments. Hope it helps!
I have made you the owner of the sheet and removed myself. You can use the sheet and if you get ant safety warning like mentioned at 2:46 , just allow that as shown in the video.
Thanks
Thank you so much! Because of you I won't fail my uni course :D
What is that course where you need TH-cam video comments?
@@LearningOrbis I am currently studying Media and Communications and I am participating in a course called "Digital Media Analysis" where we utilize a multitude of programs such as SNScrape to gather data and ConText and Graphi to process it and visualize it. Sadly, SNScrape is now unable to scrape Twitter data due to legal matters, thus I was forced (for an assignment) to gather youtube comments instead and assign sentiment analysis through ConText. Thanks to your video, I was able to gather the data which I am now processing through context. For these reasons, I am extremely greatful of your video. Thank you again for your awesome work
All the best :)
in tools i am not getting scipt editor
Now it is under Extensions.
The code works for some of the videos and not for all? Why is it so?
For which video it didn't work? Plz share the link.
@@LearningOrbis Okay its working now. Maybe I would have surpassed the daily rate limit
If i have to just get Hindi comments, what should i do?
Sorry that's not possible.
Thank you so much man, this helped me a lot. Your codes working so smoothly. Thanks once again.
TypeError: Cannot read property 'getSheets' of null (line 4, file "without reply")Dismiss
First Code (Without Replies):
bro i have this error
Which video you are trying?
if you please activate the subtitle / closed caption
How to get comments of all videos of a youtube channel in a single sheet?
Not possible dear!
Hey, how can I limit the amount of comments to be scrapped? For example, I only want to scrap 1000 comments from the video because it has too many. Thank you
For that I'll have to change the code. I'll try to do that by this weekend.
@@LearningOrbis Thank you so much! I was figuring out how to do it.
Here we go. Use this code:
github.com/MAN1986/LearningOrbis/blob/master/scrapeFewComments.gs
On line number 6, you can see the value is 1000. You can change to to any value and it will scrape those many comments. Note two things:
1- The number of comments should be multiple of 100.
2- It will always be the newest comments.
Let me know if it worked for you!
@@LearningOrbis It worked. Thank you!
@@LearningOrbis Btw what language did you use for this script? Is it Python?
Can i save the comments as html version also and how?
yes. TH-cam data API allows you to get the comments and you may save those in any format. Need to change the code accordingly.
@@LearningOrbis I have no idea about coding... can you help pls