Super interesting. It’s pretty cool to think about putting one of these on an EC2 instance or something and getting a free chatGPT wrapper. Would be interesting to see $ value for power comparing the ChatGPT API calls versus self host.
Thank you - I am definitely trying to figure out that next step of putting this in ec2. I am going to try the t2 micro on the free tier and we will see how it performs.
Super interesting. It’s pretty cool to think about putting one of these on an EC2 instance or something and getting a free chatGPT wrapper. Would be interesting to see $ value for power comparing the ChatGPT API calls versus self host.
Thank you - I am definitely trying to figure out that next step of putting this in ec2. I am going to try the t2 micro on the free tier and we will see how it performs.