is this still works? i am having the same error that you got in the end, but there is no node 14 option i have node 18 selected and these dependemncies "chrome-aws-lambda": "^10.1.0", "puppeteer-core": "^10.4.0" what mgiht be the issue?
Thank you for your content, But when I tried to click to a tag, I got this error ? "Reclaiming failed request back to the list or queue. Node is either not clickable or not an Element" A very familiar scenario is that I take data from Google search and click on each result that Google returns. Locally it is fine but when deployed on lambda, the error above appears.
Thanks for this tutorial, it clarifies me how aws lambda works. I am trying to run puppeteer on Cyclic server, seems to bee a good free tier server, but so many errors... Can you do a tutorial explaining how to set puppeteer in it?
Thanks
Helped me a lot. Thanks!
Explained in a great way
Thank you Michael I'm learning so much data scraping from your channel.
I have a question please: is AWS lambda support puppeteer-cluster?
Not sure, I should do a video on that soon 👍
@@MichaelKitas thanks to you i created a scraper based on cluster however I'm not able to deploy it please do a video about that.
@@raiinstru Will do so, thanks 🙏
is this still works?
i am having the same error that you got in the end, but there is no node 14 option i have node 18 selected
and these dependemncies
"chrome-aws-lambda": "^10.1.0",
"puppeteer-core": "^10.4.0"
what mgiht be the issue?
Thank you for your content, But when I tried to click to a tag, I got this error ?
"Reclaiming failed request back to the list or queue. Node is either not clickable or not an Element"
A very familiar scenario is that I take data from Google search and click on each result that Google returns. Locally it is fine but when deployed on lambda, the error above appears.
Going to record an updated video today, which is going to deploy the exact code version which is hosted locally using aws sam.
Thanks for this tutorial, it clarifies me how aws lambda works. I am trying to run puppeteer on Cyclic server, seems to bee a good free tier server, but so many errors...
Can you do a tutorial explaining how to set puppeteer in it?
Not familiar with Cylic, but I might check it out in the future and make a video on it 👍
Hi, could u please make a video how to deploy puppeteer script in cyclic?
Not familiar with cyclic, but maybe soon will research it and post a video
@@MichaelKitas alright, highly appreciate it bro 🙌
thx man. this worked!!
Error: Cannot find module 'lambdafs'
Require stack:
- /var/task/node_modules/chrome-aws-lambda/build/index.js
- /var/task/index.js
- /var/runtime/index.mjs
Error: Cannot find module 'lambdafs'
Require stack:
- /var/task/node_modules/chrome-aws-lambda/build/index.js
- /var/task/index.js
- /var/runtime/index.mjs
npm i lambdafs
getting error cannot lunch ..... same annoying error
Watch the video again, make sure to set headless to true, nodejs v14, or something else is causing the issue
@@MichaelKitas its causing the issue with latest version like 16, 18, 20. How can we resolve it or overcome this issue. Kindly help
hi, repo is private :(
Sorry about that, I made it public now
but the zip size is 52mb so cannot upload :(
Use S3 option to upload the zip
Merci !
Thank you for the support!