OpenAI Evals Explained with Examples | AI Voice

แชร์
ฝัง
  • เผยแพร่เมื่อ 14 ธ.ค. 2024

ความคิดเห็น •

  • @biiiiiimm
    @biiiiiimm หลายเดือนก่อน

    Very interesting ! Im working on adding this kind of feature in my SaaS, i was a bit confused about how it works exactly, you helped me a lot ! Good job

  • @bulutosman
    @bulutosman หลายเดือนก่อน

    is not there anyway to evaluate function callings?

    • @jannismoore
      @jannismoore  หลายเดือนก่อน

      You can always custom-build something and Vapi also offers its own structured date format that you can use to get KPIs.
      If you really want to analyze only the tool calling responses, you can probably do that by simple looping through the messages array within the end of call reports while fetching the tool call responses

  • @manideepagunde1632
    @manideepagunde1632 หลายเดือนก่อน

    How this gonna help in the web scrapping sir

    • @jannismoore
      @jannismoore  หลายเดือนก่อน

      You can analyze your scraped data if you look for something specific. I guess you could use it also for extraction with the response feature they offer

  • @Zack-AP
    @Zack-AP หลายเดือนก่อน

    Very sick video man. Did you create that replit for the vapi data with the replit agent by chance?

    • @jannismoore
      @jannismoore  หลายเดือนก่อน +2

      I used it for the foundation - then it’s just optimizing the code for my needs.
      It’s not always getting things right, so there’s quite a bit more of manual work needed, but it definitely shortens the dev time. 👍🏻