AI vs Steam Deck: Large Language Model
ฝัง
- เผยแพร่เมื่อ 23 ส.ค. 2023
- AI is notoriously hard to run and typically is thought to just reside in data centers or on expensive graphics cards. However, just for fun, I am seeing just how much AI can a Steam Deck run locally.
Can a Steam Deck run the Llama 2 7 billion parameter Large Language Model? Let’s find out.
Here are the Steam Deck specs, if you aren't familiar:
CPU: Zen 2 4c/8t, 2.4-3.5GHz
GPU: 8 RDNA 2 CUs, 1.0-1.6GHz
APU power: 4-15W
Running Windows 11 (on an external hard drive connected via USB)
Software Used: GPT4All (gpt4all.io)
