How to Deploy ML Models in Production with BentoML

แชร์
ฝัง

ความคิดเห็น • 33

  • @TridomML
    @TridomML ปีที่แล้ว +3

    Would love to see an update to this video, perhaps with a more complex model framework such as PyTorch or Huggingface!
    BentoML has updated some of its infrastructure to handle custom objects, which can store the tokenizer for these models, but there's a gap in resources that demonstrate how to utilize that tokenizer in the `predict()` service function definition.

  • @JaydeepSamanta
    @JaydeepSamanta ปีที่แล้ว

    Thank you for the tutorial, I have a question, in my project I have multiple edge devices, can I use BentoML's runner instance to run on multiple nodes?

  • @shubhamtalks9718
    @shubhamtalks9718 4 หลายเดือนก่อน

    To be very honest, BentoML doesn't seem to be adding any value! Why would anyone switch from FastAPI to this?

    • @lolikpof
      @lolikpof หลายเดือนก่อน

      Same question

  • @iva1389
    @iva1389 ปีที่แล้ว +1

    I'm stuck: from mldeployment import training
    ImportError: cannot import name 'training' from 'mldeployment' (unknown location)

    • @medbenzou
      @medbenzou 6 หลายเดือนก่อน

      same issue

  • @marinamaayah6899
    @marinamaayah6899 ปีที่แล้ว

    I had this error How can I chck the server log to know what exactly the error
    rediction: "An error has occurred in BentoML user code when handling this request, find the error details in server logs"

  • @4sci
    @4sci 10 หลายเดือนก่อน

    Thanks 👍👍

  • @nguyenthehoang9148
    @nguyenthehoang9148 ปีที่แล้ว

    Thank you for your time and effort in making this video!
    May I have some comments:
    1) The good:
    - The content is great
    - About the video itself, everything is great (e.g., light, speech, clarity of explanation, .. and so on)
    2) The not really good:
    - People, looking for solutions for our showcase projects, don't see what we are looking for in the video and probably go back to some tutorials about using Flask to serve our models. Here's why: we probably want to make a web app or a mobile app (e.g., using react native) and include the link to the resume. Your content isn't finished, so it isn't convincing enough.

  • @jawadmansoor6064
    @jawadmansoor6064 2 ปีที่แล้ว +1

    How do you deploy voice recognition system (as in your previous videos) on bentos?
    Here at 13:39 on line 16 input and output is numpyNDarray, what would it be for audio data?

    • @ValerioVelardoTheSoundofAI
      @ValerioVelardoTheSoundofAI  2 ปีที่แล้ว

      It depends on the type of audio representation you use as input (e.g., spectrograms, waveform). In most cases, it would be NumpyNDarray. For the output, again, it depends. Most likely you'll have one-hot encoding as in the example of this video. For that, you can use NumpyNDarray. Hope this helps!

    • @jawadmansoor6064
      @jawadmansoor6064 2 ปีที่แล้ว +1

      @@ValerioVelardoTheSoundofAI Thank you I will try this

  • @ThomasFackrell
    @ThomasFackrell 6 หลายเดือนก่อน

    This is super cool! I can't wait to share it with my team.

  • @manhpham5772
    @manhpham5772 2 ปีที่แล้ว +2

    Dear sir, can I ask why should we use BentoML, while there're loads of robust serving frameworks? Or in other words, can you compare BentoML with others... Thank you!

  • @shadyizloo
    @shadyizloo 2 ปีที่แล้ว

    hey i need to know how does python work when you have two separate train and test files. like we train on one file and then test on another csv file. please guide if you know how does that work

  • @sarthak7413
    @sarthak7413 ปีที่แล้ว

    I am not able to containerize using bentoml..

  • @Diego0wnz
    @Diego0wnz 2 ปีที่แล้ว

    Why did you make a json file of the input?

  • @dongxiaxing7767
    @dongxiaxing7767 ปีที่แล้ว

    Thank you for sharing

  • @aibdarija5856
    @aibdarija5856 2 ปีที่แล้ว

    Can you do the blind source separation

  • @chadzulu4328
    @chadzulu4328 ปีที่แล้ว

    Great explanation, thank you!

  • @Raulvic
    @Raulvic 2 ปีที่แล้ว

    thank you for sharing!

  • @Raulvic
    @Raulvic 2 ปีที่แล้ว

    Thank you for sharing

  • @crackintosh
    @crackintosh 7 หลายเดือนก่อน

    Best video on bentoml!

  • @haoshoku8496
    @haoshoku8496 2 ปีที่แล้ว

    Hello I I have a question I want to make a project on removing stutter from a speech signal what data structures or tools do I need in order to make this?

    • @jawadmansoor6064
      @jawadmansoor6064 2 ปีที่แล้ว +1

      What is stutter in speech? If a person, (child or old) stutters I think it would be impossible to clear it.

    • @haoshoku8496
      @haoshoku8496 2 ปีที่แล้ว

      @@jawadmansoor6064 thank u for the reply!
      I myself am a stutterer so I just thought of making this. Impossible? Can't we filter out the redundant signals or something like that?

    • @jawadmansoor6064
      @jawadmansoor6064 2 ปีที่แล้ว +1

      @@haoshoku8496 Not through DSP, though we might be able to train an AI model that can filter or even generate a new voice.
      Do you speak English by the way? I am interested in this project.

    • @haoshoku8496
      @haoshoku8496 2 ปีที่แล้ว

      @@jawadmansoor6064 I think there is a dataset for this but I don't know machine learning yet so I decided that if I could do that by DSP and if DSP will not work here so machine learning is maybe the only solution and Yes i do speak English!

    • @jawadmansoor6064
      @jawadmansoor6064 2 ปีที่แล้ว +1

      @@haoshoku8496 Thank you. I will look for it now.

  • @alixmortimer5143
    @alixmortimer5143 2 ปีที่แล้ว

    ƤRO𝓂O𝕤ᗰ