Orchestrate and move an LLM app across CPUs, GPUs and NPUs using LlamaEdge

LlamaEdge application can run without change across devices with different Operation Systems, CPUs and GPUs. The portable workload can be managed and orchestrated by container tools like Kubernetes in a heterogeneous cluster of machines.
Learn more: llamaedge.com/
Source code: github.com/Lla...