Stream responses back from Bedrock using Lambda Response Streaming

แชร์
ฝัง
  • เผยแพร่เมื่อ 16 พ.ย. 2024

ความคิดเห็น • 14

  • @focusotter
    @focusotter ปีที่แล้ว +1

    Great video as always!

  • @JasperRowan-v3n
    @JasperRowan-v3n ปีที่แล้ว +2

    Very helpful thank you! I am looking for examples of how to combine this with a front end, for example streaming results into a NextJS app. Having a hard time finding examples online.

    • @littlemagicpenguin9576
      @littlemagicpenguin9576 11 หลายเดือนก่อน

      any chance to add an interaction with frontend for example what if frontend send a question to apigateway that connects to this lambda. thanks a lot!

    • @1ALrX
      @1ALrX วันที่ผ่านมา +2

      This is exactly whats needed, they do not have a good example because you can't put anything in front of Lambda Function URL. It's not allowed to turn that on in many companies because of no throttling no authorization etc.

  • @jorgetovar621
    @jorgetovar621 4 หลายเดือนก่อน +1

    Do you have a playlist with all the generative AI work, or where can I find the tutorial where you created this?

    • @foobar_codes
      @foobar_codes  4 หลายเดือนก่อน +1

      Here u have blog.marcia.dev/getting-started-with-amazon-bedrock-and-serverless

    • @jorgetovar621
      @jorgetovar621 4 หลายเดือนก่อน

      @@foobar_codes thank you. You are amazing 🤩

  • @vineelwatches1417
    @vineelwatches1417 9 หลายเดือนก่อน +1

    Does streaming work from an actual web browser via ApiGateway? The docs seem to say no, and your video seems to avoid the issue -- although I am not expert enough in serverless to follow your template.yml syntax -- does it create an ApiGateway endpoint?

    • @foobar_codes
      @foobar_codes  9 หลายเดือนก่อน

      No api gateway does not work with lamba streaming. You need to use lambda functions urls

    • @foobar_codes
      @foobar_codes  9 หลายเดือนก่อน

      🆕 Lambda Response Streaming | Get faster responses from AWS Lambda!
      th-cam.com/video/k2CTnIDFHu8/w-d-xo.html

  • @rushipatel3393
    @rushipatel3393 ปีที่แล้ว

    Is that support typescript?

  • @madimakes
    @madimakes ปีที่แล้ว +1

    awesome! For my TS lambda, I ended up having to add a Layer for the @aws-sdk/client-bedrock-runtime and i was good to go...