DeepSeek-R1-Distill-Qwen-32B + VLLM + OpenWebUI + SearXNG: Best Local Free Replica for DeepSeek Chat
ฝัง
- เผยแพร่เมื่อ 9 ก.พ. 2025
- this video demos how to build a super awesome FREE LOCAL REPLICA of chat.deepseek.com with reasoning and web search capabilities using DeepSeek-R1-Distill-Qwen-32B GGUF + VLLM + OpenWebUI + SearXNG Search Engine
Download DeepSeek R1 Model
huggingface.co...
Step 1: Activate Free GPU(s) on Kaggle
• Free GPU Model Trainin...
Step 2: Install VLLM
• DeepSeek R1 + Aider + ...
• DeepSeek R1 + VLLM + C...
Step 3: Install OpenWebUI
• Dolphin 3.0 + Ollama +...
• Qwen SmallThinker-3B: ...
Step 4: Install SearXNG
• Perplexica + SearXNG: ...
Step 5:
Lastly, Follow this tutorial to config WebSearch with DeepSeek R1 Model on OpenWebUI
Kaggle notebooks:
Notebook is only created for demonstration and serve as a guidance for those who were interested using similar methods to build projects. It is NOT a free giveaway for a few reasons. 1. it works while the video is recorded, However it does not guarantee to work at a later date as tech communities make code changes all the time. Please follow the tutorial and create your own version of it if needed. 2. If you have any questions or need help, please join the discord server community to discuss or subscribe to the channel. 3. if you need further professional assistance, please feel to book a consulting call. Thanks for understanding
Discuss:
/ discord
Consulting:
cal.com/produc...
Buy Me a Coffee to support the channel, It means a lot
ko-fi.com/prod...
Follow me on x.com:
x.com/jacobcdev
Helpful links:
huggingface.co...
github.com/sea...
docs.searxng.org/
docs.openwebui...
github.com/vll...
Must Watch:
• Ollama + Nginx + Kaggl...
How to Use Free GPU on Kaggle:
• Free GPU Model Trainin...
How to Setup Visual Studio Code Web on Kaggle
• Roo-Cline (Cline 3.1 F...
Transform Kaggle Notebook to Virtual Machine with Good GPU, CPU and RAM
• Transform Kaggle and C...
You might also like:
PlayList
• AI Web Scrapers
• AI Coders
• Media Gen and ComfyUI ...
• Free AI Video Generators
• AI Agents
• AI Sound Generators
• LLM Reviews
Music from #Uppbeat (free for Creators!):
uppbeat.io/t/2....
License code: MKM7BDGHR8BXIH2S
Music from #Uppbeat (free for Creators!):
uppbeat.io/t/t...
License code: ATVBJRKCLBUUMZYA
