How To Use the NEW Streaming Feature in OpenAI Assistants API

แชร์
ฝัง
  • เผยแพร่เมื่อ 24 ม.ค. 2025

ความคิดเห็น • 43

  • @vrsen
    @vrsen  10 หลายเดือนก่อน +7

    Hey everyone👋, we are currently looking for AI Agent Developers to join our team. Please apply in our discord in job-posts channel if you are interested. (link in description) Thanks!

    • @ailxes
      @ailxes 9 หลายเดือนก่อน

      Im interested in creating an AI agent for a small project with a finite amount of knowledge database with use for RAG purely for context with fixed API costs. How do I contact you?

  • @aiplaygrounds
    @aiplaygrounds 10 หลายเดือนก่อน +8

    Bro you are a gem, other creators didn’t understand the streaming that’s why they didn’t talk about it. Great value 👏

    • @vrsen
      @vrsen  10 หลายเดือนก่อน

      🙌

  • @alexanderholmefjord-sarabi3402
    @alexanderholmefjord-sarabi3402 10 หลายเดือนก่อน +4

    thanks for the videos, i think you're one of the very few whose ideas have change the way i approach these tools

  • @ronsijm
    @ronsijm 10 หลายเดือนก่อน +5

    Streaming is sick. I made an internal slack bot for people to chat with. First I wasn't using steaming, and whenever people were chatting with it, I needed to wait for the entire request, and everyone was complaining the bot was shit and slow. Then I build in a streaming function, now the bot is creating a slack message almost instantly, and then editting the message as the words are coming in from OpenAI.
    Now the bot is preferred over using the ChatGPT web-interface, because people don't have to context-switch from slack to the browser

  • @amandamate9117
    @amandamate9117 10 หลายเดือนก่อน +1

    did you tried to use your agency swarm with some Claude 3 model like the cheap Haiku that is beating gpt-4?

  • @itaitevet
    @itaitevet 9 หลายเดือนก่อน +1

    Hi, how could you add a knowledge base to agency swarm? For example, how would you train the AI based on your previous Facebook posts to create new ones with a similar style? Thanks!

  • @rasmusfoy
    @rasmusfoy 6 หลายเดือนก่อน

    Amazing Video! Thank you so much!

  • @jakobdango170
    @jakobdango170 10 หลายเดือนก่อน +1

    Hey just curious have u stuided cs or gathered team of devs and u mostly run ideas and business and sales

    • @vrsen
      @vrsen  10 หลายเดือนก่อน +1

      Yes, I studied CS, but dropped out of college after my first year. After that I read a ton of books on AI and worked as a freelance ML engineer for 3 years. I am still quite involved in coding, however I am trying to focus more and more on design work, rather than on implementation.

    • @ytvids.io123
      @ytvids.io123 10 หลายเดือนก่อน

      @@vrsen Hey do you have a way to account the tokens in my loved framework Agency Swarm.. Appreciate your efforts!

  • @MushtaqPatel-up1fb
    @MushtaqPatel-up1fb 8 หลายเดือนก่อน

    Hello Arsenni, Thanks for the all informative nad great value videos. Could you please create the playlist so it we will easy to follow and watch? Currently, there is no order in video which one to go first.

    • @vrsen
      @vrsen  8 หลายเดือนก่อน

      Right, will do. Thanks

  • @theepicosityofpizza
    @theepicosityofpizza 4 หลายเดือนก่อน

    God bless you bro this is the best tutorial ever

  • @ЯнПопов-э2ю
    @ЯнПопов-э2ю 17 วันที่ผ่านมา

    Hello! Thank you for explanation of creating and using new assistant and for your library dedicated for simplify this process. But i'm lokking for a method of using an exist assistant. Because it must use my database before giving an answer to user. I did it but without streaming and the task is complicated by the fact that assistant returns every paragraph in html blocks, so i need to accumulte chunks until a closing tag. Nonetheless I have a sense how to resolve this task, but existing assistang with streaming still a hard task for me. Can you give me any clue?

  • @7polletes
    @7polletes 10 หลายเดือนก่อน +2

    By the way i’d love to learn about your saas development process. It would be incredible.

  • @IdPreferNot1
    @IdPreferNot1 10 หลายเดือนก่อน

    Love the details.

  • @NiklasOtto
    @NiklasOtto 10 หลายเดือนก่อน

    Hello @vrsen, what are the advantages/disadvantages of Agency Swarm compared to Crew AI?

  • @AiDevHamza
    @AiDevHamza 9 หลายเดือนก่อน

    Hey nice video! I would really love to know the development process of your saas platform, I want to Launch my own AI SAAS but I have a lot questions and confusions in my head.

  • @raymondwienand8177
    @raymondwienand8177 10 หลายเดือนก่อน

    Great info!
    I would like your opinion on Devin.

  • @Faycal_djilali
    @Faycal_djilali 9 หลายเดือนก่อน

    hi ,i have app use twilio to get a vioce query from user than take that query to gpt model to get a response than sand this response to twilio to respod to user
    my probleme is whene user speak its take so long to respond
    any idea

    • @vrsen
      @vrsen  9 หลายเดือนก่อน

      I don’t think you can use gpt streaming, because if you are sending back a text, you need to have a complete response anyway. The only way to reduce latency in this case is use a smaller model.
      However, if you are sending back voice on a call, you could probably use streaming when generating voice from TTS model.

  • @YSl11
    @YSl11 7 หลายเดือนก่อน

    Thank you!!!

  • @selftaughtDevv
    @selftaughtDevv 10 หลายเดือนก่อน

    hi VRSEN can you create a video based on perplexity online llms and can I use their API endpoint which offers vast LLMs for creating agents

  • @cesargaray5809
    @cesargaray5809 9 หลายเดือนก่อน

    The website does not work in the creation part of openai

  • @zackmartin00
    @zackmartin00 10 หลายเดือนก่อน

    Do you work with smb?

    • @vrsen
      @vrsen  10 หลายเดือนก่อน

      Yes, checkout agents.vrsen.ai/

    • @cesargaray5809
      @cesargaray5809 9 หลายเดือนก่อน

      @@vrsen th-cam.com/video/iHVP7SkpUHE/w-d-xo.html

  • @____2080_____
    @____2080_____ 10 หลายเดือนก่อน

    Definitely would like to hear a video but is that something that someone can call you and consult about?

    • @vrsen
      @vrsen  10 หลายเดือนก่อน

      Yes, of course. You can use a link in the description. I reveal any secrets and insights for my consulting clients

    • @cesargaray5809
      @cesargaray5809 9 หลายเดือนก่อน

      ​@@vrsen
      The website does not work in the creation part of openai

  • @kazmi401
    @kazmi401 10 หลายเดือนก่อน +1

    This man is nice. But why is so underrated on youtube. Keep it up man.❣

  • @7polletes
    @7polletes 10 หลายเดือนก่อน

    Go go go!!

  • @2008tmp
    @2008tmp 10 หลายเดือนก่อน +3

    The big problem is that assistants API costs are uncontrollable. Until they fix the back-end and billing model, they are useless for anything but a demo.

    • @vrsen
      @vrsen  10 หลายเดือนก่อน +1

      Yes you are right. They definitely need a way to control amount of tokens that goes into the model. I am sure they will add it soon. In the meantime, I recommend just creating new threads as needed

  • @technologyforyou7621
    @technologyforyou7621 10 หลายเดือนก่อน

    All talks n no practice step by step funct

    • @cesargaray5809
      @cesargaray5809 9 หลายเดือนก่อน

      The website does not work in the creation part of openai