Best video to learn Scraping with Octoparse that I have seen! I followed it and worked to a T. Only question is whether there's a limit on the number of data entries/rows you can scrape on the free version? I have 100,000 data entries that I want to scrape but only got 222 data entries after I ran my scraper. Keep up the great videos!
I just bought the product and I'm trying to make sure I've done this correctly. The page I'm scrapping from doesn't have a next page. It's just updates it's self every hour with a new Name/Title. The work flow I have is Go to the Webpage, then the Loop Item container and inside is the Extract Data. What I'm doing is Pattern Matching for Keywords via RegEx in Which I want to Clean Data then Match With Regular Expression then I input my RegEx key the words I'm looking for. I am then outputing any RegEx keywords found into a MySQL database I have in the cloud. I'm not 100 percent sure this is correct. But can you make sure this is correct?
Hi Francois, I’m Jose from Costa Rica, I’m new on this word of scraping, I think is a good way to have information about the market on a specific topic, for example cars, if I want to know on my country wich model of cars are the most on sell (inderectly you will have too the brand of the car, the year even on what part of the country you will find them cheaper) if you combine this information/data with power bi, it will be easier to select option or find offers…but I want to ask you one thing, do you see another way for use this data??
Hi Jose, I'm not a data analyst but I assume if you merge data, you might answer other kinds of questions. Overall, Web Scraping can also be used for lead generation.
Hello sir, can you help me, i cant seem to get the information of the description right, i followed all your steps the only difference is that "Load with Ajax" is ticked together with open in a new tab and my final result is my description is blank can you help me how to fix this? i badly needed your help thank you
@@francoisfromoctoparse No, it is a library of python language specialized for automation, instead of you using a tool to repeat the steps and get data like above, you use python to program for that repetition. I found this you can check out th-cam.com/video/tp_B5tpJS3c/w-d-xo.html
Hi. Is this totally legal and legit? I need a tool to collect comments from Facebook, Instagram to conduct behavioural analysis of consumers. It will be for my business so it has to be compliant to regulations
WOW this Octoparse is a mess. I am on the Free Trial right now and it has been nothing but a headache. This is NEVER easy to do..unless your a Website Developer.. Would it be to much to ask for a program that is point and click without the fluff in between? To much information, to little instruction, to many options that seem to make zero sense to the average User. Can someone not just make a tool that is point and click simple? Pre loaded with a standard list of product information so the use can just click what they want from a list...the green flashing when you hover over the items etc is SO VERY ABNOXIOUS that I can not focus on my task at hand because my mind is seeing the flash of green and distracting me by making me think something is wrong...NOT HELPING at all...The user should be able to input the URL information for the website they wish to scrape and then be able to choose to scrape the Product URL , Title, Pricing, Image URL, SKU, etc by clicking them from a drop down menu or similar...To ask a average person to figure out the side menu and how to move it around so you get what you want is NOT worth paying for...its like asking someone to stab themselves in the eye and pay for the pleasure of doing so...Users want EASY, STRAIGHT FORWARD, SIMPLE TO USE and most of all they want the process to be FAST start to finish. The learning curve with Octoparse is a turn off. I and I am sure others will agree that the entire user interface could be and should dumbed down if you will for the average person who hasnt a clue how all this works...and doesnt have a month to figure it all out and then get results...Nope
Downloading Octoparse:
octoparse.com?fpr=aus2f
30% discount with the coupon RFL30
For a Web Scraping request:
fdufaurboidin@gmail.com
Hello Francois, I just discovered your channel. You are doing a very good job and I wish you well!
Hello Thank you very much. We will keep it up 💪
Best video to learn Scraping with Octoparse that I have seen! I followed it and worked to a T. Only question is whether there's a limit on the number of data entries/rows you can scrape on the free version? I have 100,000 data entries that I want to scrape but only got 222 data entries after I ran my scraper. Keep up the great videos!
Thank you.
I think you can get up to 10 000 data rows with the free version.
Thank you for your video; it has given me a lot of insight.
Hi, I got stuck at the detail page, and I can have the button that you sugguested step by step, pls help me out
how to scrap pages that is redirecting to another page?
I just bought the product and I'm trying to make sure I've done this correctly. The page I'm scrapping from doesn't have a next page. It's just updates it's self every hour with a new Name/Title. The work flow I have is Go to the Webpage, then the Loop Item container and inside is the Extract Data. What I'm doing is Pattern Matching for Keywords via RegEx in Which I want to Clean Data then Match With Regular Expression then I input my RegEx key the words I'm looking for. I am then outputing any RegEx keywords found into a MySQL database I have in the cloud. I'm not 100 percent sure this is correct. But can you make sure this is correct?
Hello,
For any web scraping request:
fdufaurboidin@gmail.com
Oh I would have loved to know the answer to that!
Is it possible to scrape Tumblr properties using this tool
This is so cool. Sound like Jean Girard from Talladega Nights.
Have a big issue with Locate web element via nearby text. When I enter the Xpath I see the DIvs and everything below but won't let me apply
I have a website and I have to list the data by zipcodes. Let's say I need to write XXXXX and then continue scraping. How can I do this
This is an information that is more likely to be shared to my customers. But, indeed, you can do that through Octoparse.
Hi Francois, I’m Jose from Costa Rica, I’m new on this word of scraping, I think is a good way to have information about the market on a specific topic, for example cars, if I want to know on my country wich model of cars are the most on sell (inderectly you will have too the brand of the car, the year even on what part of the country you will find them cheaper) if you combine this information/data with power bi, it will be easier to select option or find offers…but I want to ask you one thing, do you see another way for use this data??
Hi Jose, I'm not a data analyst but I assume if you merge data, you might answer other kinds of questions. Overall, Web Scraping can also be used for lead generation.
if we have multiple variants in details page then it is possible to scrape data ?
Yes it remains possible.
Hello sir, can you help me, i cant seem to get the information of the description right, i followed all your steps the only difference is that "Load with Ajax" is ticked together with open in a new tab and my final result is my description is blank can you help me how to fix this? i badly needed your help thank you
Hello,
For any web scraping requests, you can send me an email at fdufaurboidin@gmail.com
Do you have any idea how to resolve human verification keeps looping back.. i am using a vpn
very nice article thanks
Hello Francois,I just want to use it on the web, I don't want to download the app, is it possible?
Hello,
No, it's not possible.
Maybe Web Scraper is a better option in your case.
@@francoisfromoctoparse thank iu and what do you think about using playwright crawl data
@@thinhlevan6913 Is that a tool ?
@@francoisfromoctoparse No, it is a library of python language specialized for automation, instead of you using a tool to repeat the steps and get data like above, you use python to program for that repetition. I found this you can check out th-cam.com/video/tp_B5tpJS3c/w-d-xo.html
Hello dude, I am stuck to strap something can you help me.
Hello, If you want to ask for a quote, you can directly send me an email: fdufaurboidin@gmail.com
Good job my friend
Thanks man.
is their a way to Scape social media pages ?
AMAZING!
I am Unable to scarape playstore reviews
For any web scraping request:
fdufaurboidin@gmail.com
Hi. Is this totally legal and legit? I need a tool to collect comments from Facebook, Instagram to conduct behavioural analysis of consumers. It will be for my business so it has to be compliant to regulations
Hi,
Better not to scrape Facebook related websites.
I think you cannot do it through Octoparse anyway.
@@francoisfromoctoparsethank you!
WOW this Octoparse is a mess.
I am on the Free Trial right now and it has been nothing but a headache. This is NEVER easy to do..unless your a Website Developer..
Would it be to much to ask for a program that is point and click without the fluff in between? To much information, to little instruction, to many options that seem to make zero sense to the average User. Can someone not just make a tool that is point and click simple? Pre loaded with a standard list of product information so the use can just click what they want from a list...the green flashing when you hover over the items etc is SO VERY ABNOXIOUS that I can not focus on my task at hand because my mind is seeing the flash of green and distracting me by making me think something is wrong...NOT HELPING at all...The user should be able to input the URL information for the website they wish to scrape and then be able to choose to scrape the Product URL , Title, Pricing, Image URL, SKU, etc by clicking them from a drop down menu or similar...To ask a average person to figure out the side menu and how to move it around so you get what you want is NOT worth paying for...its like asking someone to stab themselves in the eye and pay for the pleasure of doing so...Users want EASY, STRAIGHT FORWARD, SIMPLE TO USE and most of all they want the process to be FAST start to finish. The learning curve with Octoparse is a turn off. I and I am sure others will agree that the entire user interface could be and should dumbed down if you will for the average person who hasnt a clue how all this works...and doesnt have a month to figure it all out and then get results...Nope
Option 1: You work hard on something free.
Option 2: You use a saas (very easy) and you pay for it.
There is no wrong answer.
Good From Pakistan
How are you?
I'm fine. Thanks.
Hii I have some issues regarding this tool and i am trying to get help can u please help me.. Please let me know how can i contact you.?
Hi,
You can find the email in the pinned comment.