did you try if phi3:mini model runs faster? (as you show it seems run faster than my notebook) but did you check if it is running over gpu or cpu? (here on notebook it is running on cpu)
yeah next time pop in a PIC-e 4x riser with 4 slots and put a a ssd on one and a intel ARC GPU A770 GPU or Radeon 7900XT and see what you get. the steam deck is my goto portable computer, great console!
@@IanWootten I've also experimented with it and unfortunately wasn't able to get it running on the GPU. If you're successful, I'd be very interested in the results.
2:54 love the honesty of hitting the bug and keeping it in the video ❤
Thanks Dave. Thought it was important to show that if you do go ahead and install stuff, it's going to potentially get wiped out with SteamOS updates.
I just read your article on running the brew package manager on the Deck!
did you try if phi3:mini model runs faster?
(as you show it seems run faster than my notebook)
but did you check if it is running over gpu or cpu?
(here on notebook it is running on cpu)
You should try again but this time with windows, theres an amd driver for the gpu so it gets detected like a amd card.
Like using the windows os on steamdeck or using the ollama windows setup?
@@Lechuga2x Using Windows OS, since there are better amd drivers improved by the community :)
yeah next time pop in a PIC-e 4x riser with 4 slots and put a a ssd on one and a intel ARC GPU A770 GPU or Radeon 7900XT and see what you get. the steam deck is my goto portable computer, great console!
Does it run on CPU or GPU ? Thx
Hi there, I mentioned toward the end, but yeah it's running on the CPU.
@@IanWootten I've also experimented with it and unfortunately wasn't able to get it running on the GPU. If you're successful, I'd be very interested in the results.
@@yuuleeyianmaiser2900 Im doing this as well, and unfortunately as well ... ...
Cool
$ sudo steamos-readonly disable
well, that makes things much easier :)