How To Deploy Puppeteer Script in AWS Lambda in 2022

แชร์
ฝัง
  • เผยแพร่เมื่อ 13 ธ.ค. 2024

ความคิดเห็น • 28

  • @prodev08
    @prodev08 17 วันที่ผ่านมา +1

    Thanks

  • @philippesantossimoes9241
    @philippesantossimoes9241 8 หลายเดือนก่อน

    Helped me a lot. Thanks!

  • @Javedboqo1
    @Javedboqo1 2 ปีที่แล้ว +2

    Explained in a great way

  • @raiinstru
    @raiinstru 2 ปีที่แล้ว +2

    Thank you Michael I'm learning so much data scraping from your channel.
    I have a question please: is AWS lambda support puppeteer-cluster?

    • @MichaelKitas
      @MichaelKitas  2 ปีที่แล้ว

      Not sure, I should do a video on that soon 👍

    • @raiinstru
      @raiinstru 2 ปีที่แล้ว +1

      @@MichaelKitas thanks to you i created a scraper based on cluster however I'm not able to deploy it please do a video about that.

    • @MichaelKitas
      @MichaelKitas  2 ปีที่แล้ว

      @@raiinstru Will do so, thanks 🙏

  • @abdularhameth
    @abdularhameth 28 วันที่ผ่านมา

    is this still works?
    i am having the same error that you got in the end, but there is no node 14 option i have node 18 selected
    and these dependemncies
    "chrome-aws-lambda": "^10.1.0",
    "puppeteer-core": "^10.4.0"
    what mgiht be the issue?

  • @minhhieple6483
    @minhhieple6483 ปีที่แล้ว +1

    Thank you for your content, But when I tried to click to a tag, I got this error ?
    "Reclaiming failed request back to the list or queue. Node is either not clickable or not an Element"
    A very familiar scenario is that I take data from Google search and click on each result that Google returns. Locally it is fine but when deployed on lambda, the error above appears.

    • @MichaelKitas
      @MichaelKitas  7 หลายเดือนก่อน

      Going to record an updated video today, which is going to deploy the exact code version which is hosted locally using aws sam.

  • @KuroManX
    @KuroManX 2 ปีที่แล้ว +3

    Thanks for this tutorial, it clarifies me how aws lambda works. I am trying to run puppeteer on Cyclic server, seems to bee a good free tier server, but so many errors...
    Can you do a tutorial explaining how to set puppeteer in it?

    • @MichaelKitas
      @MichaelKitas  2 ปีที่แล้ว +1

      Not familiar with Cylic, but I might check it out in the future and make a video on it 👍

  • @pecandubisnis
    @pecandubisnis ปีที่แล้ว +1

    Hi, could u please make a video how to deploy puppeteer script in cyclic?

    • @MichaelKitas
      @MichaelKitas  ปีที่แล้ว +1

      Not familiar with cyclic, but maybe soon will research it and post a video

    • @pecandubisnis
      @pecandubisnis ปีที่แล้ว

      @@MichaelKitas alright, highly appreciate it bro 🙌

  • @hexoradigital
    @hexoradigital ปีที่แล้ว +1

    thx man. this worked!!

    • @cuber_papa
      @cuber_papa ปีที่แล้ว

      Error: Cannot find module 'lambdafs'
      Require stack:
      - /var/task/node_modules/chrome-aws-lambda/build/index.js
      - /var/task/index.js
      - /var/runtime/index.mjs

  • @cuber_papa
    @cuber_papa ปีที่แล้ว +1

    Error: Cannot find module 'lambdafs'
    Require stack:
    - /var/task/node_modules/chrome-aws-lambda/build/index.js
    - /var/task/index.js
    - /var/runtime/index.mjs

  • @sadekhossain9566
    @sadekhossain9566 ปีที่แล้ว +1

    getting error cannot lunch ..... same annoying error

    • @MichaelKitas
      @MichaelKitas  ปีที่แล้ว

      Watch the video again, make sure to set headless to true, nodejs v14, or something else is causing the issue

    • @gurugaming5884
      @gurugaming5884 9 หลายเดือนก่อน

      @@MichaelKitas its causing the issue with latest version like 16, 18, 20. How can we resolve it or overcome this issue. Kindly help

  • @audunhilden
    @audunhilden 2 ปีที่แล้ว +1

    hi, repo is private :(

    • @MichaelKitas
      @MichaelKitas  2 ปีที่แล้ว

      Sorry about that, I made it public now

  • @sadekhossain9566
    @sadekhossain9566 ปีที่แล้ว

    but the zip size is 52mb so cannot upload :(

    • @MichaelKitas
      @MichaelKitas  ปีที่แล้ว

      Use S3 option to upload the zip

  • @yohanndiravino
    @yohanndiravino ปีที่แล้ว +1

    Merci !

    • @MichaelKitas
      @MichaelKitas  ปีที่แล้ว

      Thank you for the support!