Create an LLM web service with LlamaEdge on a MacBook, deploy it on a NVIDIA device.

With LlamaEdge, you can develop and compile LLM apps on one machine, and run the apps on another machine.
Learn more: llamaedge.com/
Source code: github.com/LlamaEdge/LlamaEdge/