I found this video extremely helpful. Thank you for taking the time to create this video. I find it really amazing. Now I need to shift my focus and start using NIM and the models it comes with. Thank you!!
Thanks 👍 yeah let's see if Nims will be the breakthrough success or something else that's very similar like OpenAI GPTs. It's all the same idea though, digitized scalable boxed human-like experts
Mozilla has a more convenient LLM format known as LlamaFile. It works across like six (6) operating systems. It's pretty cool as well for quick deployment.
Edge computing will be a thing for a simple reason: inference latency. We humans have an inference machine in our head so we can timely react to changing environments. Similarly, humanoids and self-driving cars will have local inference. In this case, the microservice abstraction is more suitable because you can run a microservice on an edge inference device - or the cloud - without changing the API calls in your code.
I found this video extremely helpful. Thank you for taking the time to create this video. I find it really amazing. Now I need to shift my focus and start using NIM and the models it comes with.
Thank you!!
Thanks 👍 yeah let's see if Nims will be the breakthrough success or something else that's very similar like OpenAI GPTs. It's all the same idea though, digitized scalable boxed human-like experts
is Nim free of cost and resource free as we run an instance of docker?
Mozilla has a more convenient LLM format known as LlamaFile. It works across like six (6) operating systems. It's pretty cool as well for quick deployment.
Thanks!
why microservice instead of cloud?
Edge computing will be a thing for a simple reason: inference latency. We humans have an inference machine in our head so we can timely react to changing environments. Similarly, humanoids and self-driving cars will have local inference. In this case, the microservice abstraction is more suitable because you can run a microservice on an edge inference device - or the cloud - without changing the API calls in your code.
dayumm
facts
All this info and if I don't make a million dollars within a year - shame on me.
True! ;)