Very interesting topic, thank the algorithm. A while ago I wanted to create a service, very similar to what MS calls "model as a service" now (endpoints for hosted AI models), but a year or so before they launched it and now everyone is doing it. It was a solo venture and the high prices for cloud GPU instances were a deal breaker. I couldn't afford to burn money for a year until I turn a profit. Then I needed to deploy an AI model for inference for one of my existing projects, looked at the prices again and decided that I will just build a server and host it in a data center, since there are many T2 and T3 data centers in my city. I wanted a 1U server so it's cheap to host, but it turns out these are super expensive and you can't build it yourself with off-the-shelf components. I'm a software guy, I have a hardware/electronics guy and 6 months ago we decided to start a company and make entry-level 1U GPU servers. I would like to exchange contacts with you, we might need your services down the road. Also feedback from someone like yourself will be super valuable. Cheers
What has your experience been of On Prem or Cloud? Help out our community by letting us know below 👇
Very interesting topic, thank the algorithm. A while ago I wanted to create a service, very similar to what MS calls "model as a service" now (endpoints for hosted AI models), but a year or so before they launched it and now everyone is doing it. It was a solo venture and the high prices for cloud GPU instances were a deal breaker. I couldn't afford to burn money for a year until I turn a profit. Then I needed to deploy an AI model for inference for one of my existing projects, looked at the prices again and decided that I will just build a server and host it in a data center, since there are many T2 and T3 data centers in my city. I wanted a 1U server so it's cheap to host, but it turns out these are super expensive and you can't build it yourself with off-the-shelf components. I'm a software guy, I have a hardware/electronics guy and 6 months ago we decided to start a company and make entry-level 1U GPU servers. I would like to exchange contacts with you, we might need your services down the road. Also feedback from someone like yourself will be super valuable. Cheers
Great to hear you found it interesting :), the best way to get in touch is probably through LinkedIn - www.linkedin.com/in/kristurk/