Run Nous-Hermes-2-Mixtral-8x7B on Mac + Across Devices with 1 single command

แชร์
ฝัง
  • เผยแพร่เมื่อ 17 ม.ค. 2024
  • Build a Nous-Hermes-2-Mixtral-8x7B chat app in @rustlang on my MacBook, runs it on a Jetson device, and access it anywhere on the web! Write once run anywhere, for GPUs. www.secondstate.io/articles/n...
    Nous-Hermes-2-Mixtral-8x7B excels at coding. It is a great base for agents
    New version of LlamaEdge!
    * Chatbot UI supports streaming
    * Two new Nous Hermes MOE models @Teknium1, @NousResearch
    * New config options: max_tokens, temperature & frequency_penalty
    Video shows streaming from Nous Hermes MOE on a Jetson device
    👉 LlamaEdge.com
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 4

  • @MetodNovak
    @MetodNovak 5 หลายเดือนก่อน

    Are there any plans to make API protocol compatible with ollama so we could run open-interpreter and crewai with wasmedge stack? Is there any more appropriate channel for technical communication?

    • @SecondStateInc
      @SecondStateInc  5 หลายเดือนก่อน

      Please come join our discord. link is not allowed in comment. check out @secondstateinc or @realwasmedge twitter bio for the discord invite

    • @SecondStateInc
      @SecondStateInc  5 หลายเดือนก่อน

      I do not believe we need Ollama for open-interpreter or crewai. They work with OpenAI APIs, which we support.

    • @SecondStateInc
      @SecondStateInc  5 หลายเดือนก่อน

      or you can also go to our github to raise an issue. I have attached an article in the video description!