Uncensored GPT AI on AMD GPUs / And Not Only

Uncensored GPT AI on AMD GPUs / And Not Only
Hello everyone! After my winter hibernation, I'm excited to share uncensored alternatives to Chat GPT that you can run on your own hardware (we will use AMD).
First App (exe): github.com/Yel...
Model: huggingface.co...
If you want more information about models, layers and other useful stuff - check text version of the guide: (Coming soon)
New UI (SillyTavern) instalation guide with images: docs.sillytave...
GPT 4.5 Character: drive.google.c...
System Prompt: drive.google.c...

[@kostiantynkv]

WHAT A PITY 🎉

[@zenas09]

I can't figure out how to import GPT 4.5 into SillyTavern, I only have the PNG file?

[@OleksiisTech]

There is "import character" tab. PNG file is a character.

[@kevinmiole]

@@OleksiisTech do I have to save the code in json file?

[@kevinmiole]

hello I tried it the first time it does lunch. When I installed node.js it does not run anymore

[@OleksiisTech]

It seems you are experiencing issues with SillyTavern. Try to reinstall node.js , I haven't encountered this issue so sorry, I don't know what exactly should you do.

[@kevinmiole]

I got to work it finally. Thank you for this tutorial

[@StefanBlurr]

Damn, only 448 subs. I hope you won't give up to this channel, your content is really good.

[@OleksiisTech]

Thanks, I will try :)

[@PlayerLolly]

Regular kobold now has native compatibility! ( Using the NOCUDA version ) I was having issues with the forked version for amd gpus, But when i tried the original one it just.. Worked, Altho i did needed to chose the "Vulkan NoAVX2 (Old CPU)" Because of my silly ahh processor, But still, I had 21 t/s (Wich basically gave me texts in real time)

[@OleksiisTech]

Interesting, what GPU do you have? I also experience problems with ROCm fork now, it just can’t run some models, which older versions can.

[@PlayerLolly]

@@OleksiisTech I have a rx 7600 with an i5 2500 (Yea, Pretty old cpu) Thats why i needed the "NoAVX2 (Old CPU)" But i still have text in real time so... I doesn't really matter, As it looks like that the cpu is barelly being used.

[@OleksiisTech]

@@PlayerLolly wow, weird build. What model do you use?

[@iknowwhy2629]

Yo thanks for the video. is there a way to add tts to koboldcpp like oogabooga?

[@OleksiisTech]

You can add tts to Silly Tavern.

[@OleksiisTech]

And also a lot of other cool modules, even Stable Diffusion

[@iknowwhy2629]

@@OleksiisTech thanks