- 144
- 62 162
Second State
United States
เข้าร่วมเมื่อ 18 ก.ค. 2019
Fast, safe, portable & serverless. Deploy Rust functions in edge computing, Jamstack, SaaS and service mesh applications.
WasmEdge WebAssembly runtime has been hosted as a sandbox project by CNCF under the Linux Foundation. One of the fastest WebAssembly runtimes on the market today.
GitHub github.com/WasmEdge
Documentation wasmedge.org/docs/
WasmEdge WebAssembly runtime has been hosted as a sandbox project by CNCF under the Linux Foundation. One of the fastest WebAssembly runtimes on the market today.
GitHub github.com/WasmEdge
Documentation wasmedge.org/docs/
WasmEdge Community Meeting #35 FLUX.1 on MacBook, and ChatTTS Demo (Oct 2024)
✨ WasmEdge 0.14.1 review & plans for 0.15.0
💻 Demo: Running FLUX.1 [schnell] on MacBook
🗣️ ChatTTS plugin demo - Convert text to voice!
register for our next meeting November: community.cncf.io/events/details/cncf-wasmedgeruntime-community-presents-wasmedge-community-meeting-2024-11-05/
💻 Demo: Running FLUX.1 [schnell] on MacBook
🗣️ ChatTTS plugin demo - Convert text to voice!
register for our next meeting November: community.cncf.io/events/details/cncf-wasmedgeruntime-community-presents-wasmedge-community-meeting-2024-11-05/
มุมมอง: 39
วีดีโอ
AI coding for aelf smart contracts using Zed and Gaia
มุมมอง 77หลายเดือนก่อน
A small LLM supplemented with knowledge of the aelf SDK is able to write C# smart contracts in the open-source Zed IDE. The "small" LLM is especially trained for coding tasks and is self-hosted on the Gaia network. Resources: * The Zed IDE: zed.dev/ * The aelf developer portal: docs.aelf.com/ * How to use open source LLMs on Zed: docs.gaianet.ai/user-guide/apps/zed * Gaia Network: www.gaianet.a...
Use an Open source LLM and Gaia to create a Rust coding assistant on Cursor
มุมมอง 210หลายเดือนก่อน
A small LLM supplemented with knowledge on the Rust programming language is able to write Rust code in the popular Cursor IDE. The "small" LLM is especially trained for coding tasks and is self-hosted on the Gaia network Resources: * The Cursor IDE: www.cursor.com/ * How to use open source LLMs on Cursor: docs.gaianet.ai/user-guide/apps/cursor * Gaia Network: www.gaianet.ai/ * Start your own sm...
A small LLM to help you write Rust code in Zed
มุมมอง 233หลายเดือนก่อน
A small LLM supplemented with knowledge on the Rust programming language is able to write Rust code in the open-source Zed IDE. The "small" LLM is especially trained for coding tasks and is self-hosted on the Gaia network. Resources: * The Zed IDE: zed.dev/ * How to use open source LLMs on Zed: docs.gaianet.ai/user-guide/apps/zed * Gaia Network: www.gaianet.ai/ * Start your own small LLM with R...
Write a Webpage with Yi-Coder + Cursor in 5 Minutes with 0 coding knowledge
มุมมอง 1702 หลายเดือนก่อน
Full tutorial www.secondstate.io/articles/yi-coder-cursor/ upercharge your coding with a personal AI assistant! This tutorial shows you how to set up Yi-Coder with Cursor in just 5 minutes. 🎥 In this video, you'll see: How to configure Cursor editor with a locally running Yi-Coder-9B model Live demo: Building a search page from scratch in 5 minutes using AI Real-time code generation and optimiz...
WasmEdge Community Meeting #34 Piper Demo, v0.1.4.1 Preview, and Cursor+Local LLMs
มุมมอง 552 หลายเดือนก่อน
Join us for our Sept WasmEdge community meeting, where we showcase the latest developments in WebAssembly beyond the browser! In this session: 00:00 - Introduction 00:30 - Piper Demo: Text-to-Speech with WasmEdge by @PeterD1524 WasmEdge LFX mentorship mentee 07:15 - WasmEdge 0.1.4.1 Preview: New Features and Improvements by @hydai 15:00 - Cursor Local LLM Integration with WasmEdge by @alabulei1...
Build a Rust app from scratch using local AI and Cursor
มุมมอง 1.5K2 หลายเดือนก่อน
Developers love Rust, but “the learning curve is too steep”? NO MORE! With Cursor Gaia, you can use an LLM supplemented with Rust knowledge to help you write code. See this demo for a complete newbie building a working Rust app in 5 min!
WasmEdge Community Meeting #33 Run stable diffusion across CPUs, LLM function calls, LFX mentorship
มุมมอง 2033 หลายเดือนก่อน
The maintainers of WasmEdge host a monthly Community Meeting to discuss the status of the WasmEdge Project on the first Tuesday each month. Everyone is welcome to join. 1. Stable Diffusion Demo Speaker: @grorge123 (National Tsing Hua University) Details: Demonstration of using WasmEdge to run Stable Diffusion (SD) models. Learn how WasmEdge can be leveraged for efficient model execution. 2. Usi...
WasmEdge Community Meeting #32 Gemma-2-9B + Groqbook to generate a book; WasmEdge Q3 Roadmap
มุมมอง 584 หลายเดือนก่อน
We discuss the WasmEdge Q3 Roadmap, WasmEdge Governance Policy, and LlamaEdgeBook demo (use LLM to generate a book). WasmEdge Q3 Roadmap Discussion (We’d love to hear feedback from the community) - Yiying He Update WasmEdge Community Governance - Hydai -Governance -Welcome new contributors -Mentorship program Demo: Use Gemma-2-9B Groqbook to generate a book - Vivian Hu
CPU vs GPU: A whispter API server running on WasmEdge and Docker with WebGPU
มุมมอง 1265 หลายเดือนก่อน
CPU ≈ 22 seconds GPU ≈ 2.2 seconds github.com/LlamaEdge/LlamaEdge/blob/main/docker/webgpu.md
WasmEdge Community Meeting #31 LLVM JIT support, Wasm GC Proposal with Kotlin, Run LLM on Windows OS
มุมมอง 855 หลายเดือนก่อน
The team discussed the features and updates of the recently released 0.14 update, including the Git feature, new compiler, and language support. They also explored the performance improvement of compiling and branding a Western file on the fly, the differences between Ablet and Jed versions, and the strategy to improve the development experience with Kotlin. Lastly, they discussed the new proce...
Local LLM with LlamaEdge: Phi-3 reads Nvidia quarterly financial reports
มุมมอง 2255 หลายเดือนก่อน
What did today’s @NVIDIA financial statement say? Shall I buy $NVDA? I started a Phi-3 LLM, released by @Microsoft yesterday, on my own computer and asked it. DIY: github.com/GaiaNet-AI/node-configs/blob/main/phi-3-medium-instruct-4k/README.md Tech stack: github.com/LlamaEdge/LlamaEdge Try my node: 0xb81f880e9bd28dbddcfd56bd3b9df0390b409b52.gaianet.network
WasmEdge Community Meeting #30 LLM RAG app
มุมมอง 916 หลายเดือนก่อน
1.WASMEDGE 0.14.0 PREVIEW WasmEdge New features @hydai - Maintainer of WasmEdge 2.LFX MENTORSHIP OSPP LFX mentorship term 2 and OSPp 2024 araround the corner. Learn the opportunitiesto become Contributor to WasmEdge @juntao - Maintainer 3.BUILD A RAG APPLICATION WITH ONE SINGLE WASM BINARYBuild a complete RAG LLM serviceusing personal knowledge base @apepkuss- LlamaEdge
WasmEdge Community Meeting #29 Llama + Lima + WASI-NN RPC demo, YOLO, Run LLMs with Docker on GPU
มุมมอง 947 หลายเดือนก่อน
Join our next community meeting next month👉docs.google.com/document/d/1iFlVl7R97Lze4RDykzElJGDjjWYDlkI8Rhf8g4dQ5Rk/edit In the realm of Kubernetes and AI, the WasmEdge Community Meeting #29 showcased innovative approaches to deploying and managing AI applications. LLAMA LIMA WASI-NNRPC Demo The first segment, presented by Akihiro Suda, introduced a groundbreaking demo involving LLAMA, LIMA, and...
Google Summer of Code 2024 PROJECTS IDEAS
มุมมอง 828 หลายเดือนก่อน
Boost your resume! Check out the details of WasmEdge's GSoC 2024 project ideas. If you have any questions, comment below these issues👉 github.com/WasmEdge/WasmEdge/issues?q=is:issue is:open label:GSoC @hydai WasmEdge Maintainer
Wasm Functions on Civo Cloud by Saiyam
มุมมอง 648 หลายเดือนก่อน
Wasm Functions on Civo Cloud by Saiyam
Demo: Run on Mac multi-modal open source LLM Llava + Google's Gemma-WasmEdge Community Meeting March
มุมมอง 1388 หลายเดือนก่อน
Demo: Run on Mac multi-modal open source LLM Llava Google's Gemma-WasmEdge Community Meeting March
WasmEdge Community Meeting #28 Llava Demo, WasmEdge on Civo Talos K8s, GSoC
มุมมอง 1018 หลายเดือนก่อน
WasmEdge Community Meeting #28 Llava Demo, WasmEdge on Civo Talos K8s, GSoC
Create an LLM web service with LlamaEdge on a MacBook, deploy it on a NVIDIA device.
มุมมอง 3238 หลายเดือนก่อน
Create an LLM web service with LlamaEdge on a MacBook, deploy it on a NVIDIA device.
Orchestrate and move an LLM app across CPUs, GPUs and NPUs using LlamaEdge
มุมมอง 1178 หลายเดือนก่อน
Orchestrate and move an LLM app across CPUs, GPUs and NPUs using LlamaEdge
Demo: Run Llava, the multimodal LLM across Devices and ask it about pictures
มุมมอง 2118 หลายเดือนก่อน
Demo: Run Llava, the multimodal LLM across Devices and ask it about pictures
WASI Preview 2 Discussion - Bailey Hayes (WasmEdge community meeting Feb)
มุมมอง 3309 หลายเดือนก่อน
WASI Preview 2 Discussion - Bailey Hayes (WasmEdge community meeting Feb)
LFX Mentorship 01-Mar-May term 2024 Introduction -Hydai
มุมมอง 739 หลายเดือนก่อน
LFX Mentorship 01-Mar-May term 2024 Introduction -Hydai
Mewz Introduction - Saza & AiNozaki #wasm #wasi #webassembly
มุมมอง 1059 หลายเดือนก่อน
Mewz Introduction - Saza & AiNozaki #wasm #wasi #webassembly
WasmEdge Community Meeting #27 Mewz, WASI Preview 2, LFX Mentorship Spring 2024
มุมมอง 1429 หลายเดือนก่อน
WasmEdge Community Meeting #27 Mewz, WASI Preview 2, LFX Mentorship Spring 2024
Self-host StableLM-2-Zephyr-1.6B. Portable across GPUs CPUs OSes
มุมมอง 1569 หลายเดือนก่อน
Self-host StableLM-2-Zephyr-1.6B. Portable across GPUs CPUs OSes
Run Nous-Hermes-2-Mixtral-8x7B on Mac + Across Devices with 1 single command
มุมมอง 31310 หลายเดือนก่อน
Run Nous-Hermes-2-Mixtral-8x7B on Mac Across Devices with 1 single command
Self host Mixtral-8x7B MoE LLM on Mac+cross devices, 2MB AI inference app fully portable
มุมมอง 34810 หลายเดือนก่อน
Self host Mixtral-8x7B MoE LLM on Mac cross devices, 2MB AI inference app fully portable
Mistral-7B-Instruct-v0.2 on Macbook M2. Open source LLM solves math problem
มุมมอง 43010 หลายเดือนก่อน
Mistral-7B-Instruct-v0.2 on Macbook M2. Open source LLM solves math problem
Demo: Mixtral 8x7B on Jetson Orin. Run any open source llms on Huggging Face with LlamaEdge
มุมมอง 16110 หลายเดือนก่อน
Demo: Mixtral 8x7B on Jetson Orin. Run any open source llms on Huggging Face with LlamaEdge
I'm curious to know about the data set you used to finetuned your LLM for Rust. Would you be able to share it, please?
It's from the open-sourced Rust learning material.
討人厭的是如果要調度個tauri利用還要裝很多依賴
Finally an open source ide for Rust and an LLM that can help rustaecians
Yes. And the LLM inference app is also written in Rust. 🤗
Where we can get an api key for yi-coder
Just enter random characters as the API key.
ANy idea why it doesnt accept ollama or llamacpp?
Cursor? LlamaEdge can use llamacpp as a backend
What type of M2?
M2 chip with 16G mem
@@SecondStateInc How do you think it works with various AI-tasks? I'm thinking of buying one.
@@ToreSG705 7B models work on Intel chips too, just slower
Amazing job guys. I believe you are hitting something.
WTF MEWZ IS STUPIDLY AWESOME
We got any slides for Mewz talk?
docs.google.com/presentation/d/1L5lcJ8aR41GM1wCX3k9FBq1zF4HxkKb6s7yvdPLu2RA/edit#slide=id.g28ec80b4925_0_328
Are there any plans to make API protocol compatible with ollama so we could run open-interpreter and crewai with wasmedge stack? Is there any more appropriate channel for technical communication?
Please come join our discord. link is not allowed in comment. check out @secondstateinc or @realwasmedge twitter bio for the discord invite
I do not believe we need Ollama for open-interpreter or crewai. They work with OpenAI APIs, which we support.
or you can also go to our github to raise an issue. I have attached an article in the video description!
Does the WASM model store the whole model checkpoint within his memory space, and if yes, how can a 7B model fit the 4 GB maximum WASM linear memory? How does the WASM module use the CUDA, and in this case, the Apple Metal APIs? Great video!
Any insight?
That's impressive. Congrats! Would it be possible to use WasmEdge+Mixtral as a replacement for LMStudio and run the open interpreter with the command 'interpreter --local'? So, instead of LLM Studio, it would use your implementation. That would be something awesome.
Yes, absolutely! This article may be helpful www.secondstate.io/articles/mixtral-8-7b/. Please let us know if you have any questions.
good job！
Keep up good work! 👍
Sorry man. This explains nothing.
www.secondstate.io/articles/wizardcoder-python-7b/ in the description
i dont consider 18GB vram useage for iot 🙂
Cool
Promo*SM
And I thought my .diff summarizer was high speed 😂 well done
I think wasm on riscv is the future. The earlier the work for this starts the better.
The future is now
awesome
Many thanks to those on your team willing to present in their non-native language so that others from the English speaking sim mimicry may benefit from this very exciting work.
Too fast.
Notesd and thanks for pointing this out. You could aslo check out our docs. wasmedge.org/book/en/frameworks/serverless/secondstate.html
You could not have chosen a smaller font size.
Thanks for pointing this out. We will pay attention next time. You could also check out the text version of this guideline. wasmedge.org/book/en/os/sel4.html
@@SecondStateInc Thank you.
rust has a briiliant future!
Hello my friend, I try to use that but when I configure the devchain as provider is unreachable :-( why thanks Fabrizio
V8 comes with a virtual machine for web assembly built in though..
V8 has a JS engine bundled with its WASM engine. It sort of defeats the whole purpose of “lightweight”. It is also primarily optimized for the browser use case - meaning it has no AOT or other server specific extensions.
Hi amazing video. I plan to launch my own coin but still confused about total supply vs liquidity on pancake, allocation of pool keeping or not the tokens etc. There anyway if you a moment I can dm you about it ;-) really appreciate it mate
Nice!
Any practical example? Any git repo please!
Hi, Please check out the CNCF WasmEdge project github.com/WasmEdge/WasmEdge
Amazing Information !
is it same with uniswap org?the oasis eth uniswap
So this is private, no front running, and possibly lower fee?
Um, this is a GAME CHANGER!
Love that hot dog recognition =)) Great Silicon Valley reference.
Thanks!
I know I am kind of randomly asking but do anybody know of a good site to stream new movies online ?
Why china?
Great stuff
Really interesting tech. I was searching for serverless rust and came across secondstate.io. Question: How do I setup serverless environment on say Digital Ocean, using the information from the article deno-webassembly-rust-wasi? Thanks!
If you just a few functions, you can deploy them as a Nodejs app github.com/second-state/ssvm-nodejs-starter The serverless FaaS platform you can deploy yourself github.com/second-state/wasm-joey Or just use the Second State Functions www.secondstate.io/faas/
Is the smart contact code from ETH compatible to ETC? Can I use the same Smart Contract code?
Yes, you can!
ssvm nb!!
Not sure, why this video has to run at x3
Hey Tim, Glad I found your channel. Excited to check out this video and your other one on hi-perf Rust/JS/wasm! Are you on Twitter?
Yes. you can find Tim via @mistermac2008
@@SecondStateInc Awesome, followed
wow nice. I'm installing it right now. Thank you.
You could also try our FaaS for free if you do not want to run your own nodejs servers. :) Here is a tutorial: www.secondstate.io/articles/faas-image-classification/
Nice! Love the videos - do you have a LBRY or Odysee channel yet ?
We have a Discord channel. Welcome to join! discord.com/invite/MjxtURG
I feel over time the cost of using it will increase a lot. There is an alternative to it stormyapp.com
Fantastic work
Will there be support added to also give an option for open in VS Codespaces?