Host your own AI language models locally

แชร์
ฝัง
  • เผยแพร่เมื่อ 27 ธ.ค. 2024

ความคิดเห็น • 2

  • @Froppindroppin
    @Froppindroppin 8 วันที่ผ่านมา

    Super interesting. It’s pretty cool to think about putting one of these on an EC2 instance or something and getting a free chatGPT wrapper. Would be interesting to see $ value for power comparing the ChatGPT API calls versus self host.

    • @VincentStevenson
      @VincentStevenson  8 วันที่ผ่านมา

      Thank you - I am definitely trying to figure out that next step of putting this in ec2. I am going to try the t2 micro on the free tier and we will see how it performs.