Vram is really hard to get. I have $800 to buy new GPU and only choice on market for this money is 4070 Ti 12Gb or used (presumably toasted) 3-year old 3090 24Gb (cheapest maybe from mining is 600, new sealed from 1000). And i perfectly acknowledged that after this purchase no more VRAM for me for next 2 years, there's need to be some hack to make it use system Ram too, like Nvidia made in the driver exclusively for Stable diffusion.
its a good project. but installation is a hassle. I tried to install 3 different times and I got error every time. or if you could make a detail video on how to install for windows and how to update it will be awesome. Now its time for using Personal AI
Hello i have issue when installing local gpt the issue is cuda extension is not installed but i already installed it on my pc any solution about this problem?
If you are interested in learning more about how to build robust RAG applications, check out this course: prompt-s-site.thinkific.com/courses/rag
Wow I didn't know local GPT was your project It has really helped me quite a lot
This is a great project - thank you for making it available and for the tutorials.
I swear to god this was what i needed at the moment
Vram is really hard to get. I have $800 to buy new GPU and only choice on market for this money is 4070 Ti 12Gb or used (presumably toasted) 3-year old 3090 24Gb (cheapest maybe from mining is 600, new sealed from 1000). And i perfectly acknowledged that after this purchase no more VRAM for me for next 2 years, there's need to be some hack to make it use system Ram too, like Nvidia made in the driver exclusively for Stable diffusion.
Very interesting video. A pre-configured hosted solution to overcome hardware limitation is a great idea.
its a good project. but installation is a hassle. I tried to install 3 different times and I got error every time. or if you could make a detail video on how to install for windows and how to update it will be awesome. Now its time for using Personal AI
LocalGPT is a awsome project! Thanks!
Hello i have issue when installing local gpt the issue is cuda extension is not installed but i already installed it on my pc any solution about this problem?
excellent and useful !!