I hardly disagree with your desktop review. You have mentioned Joshua's ubuntu rockchip, those images does 4k60 on youtube fine, even vp9 and av1, not just h264 like pi5 on youtube (limited to 1080p30fps) . Rpi5 is not even close to that. The same can be accomplished with armbian legacy gnome noble with mesa/vpu extension that foes similar additions than Joshua-Riek ubuntu-rockchip + real mesa panthor kernel gpu driver. I understand that you used official images, but I do daily on rock5b and it's miles away from rpi5 as desktop.
Yea, but that's your only real option with the OPis. RPi has tons of packages that work for tons of use cases. OPi being propped up by 1 person is sad. JR is amazing for his work but you can't ignore the lack of support for OPi.
"I love pie" What I feel many youtubers miss is that there are lots of transferable skills in the SBC world, especially for the same or similar SOCs. Once you get the taste of the mediocre first party operating systems, you know to avoid them at all costs. It is sad that each SBC is approached naively and without any context. It should not be surprising the community distributions are better. They are made by people who actually try to use this stuff. And if there is a new board with the same SOC, great, just convert another system and you're done. Manufacturers always seem to be reinventing the wheel (and failing at it). Of course each SBC has its quirks, some are completely broken, but I doubt anyone sane uses official images for things other than set-and-forget boxes.
Thanks for the comment. I mean, there are transferable skills in pretty much everything in life. Are you implying I'm a TH-camr? Dunno if I'm flattered or offended ;)
Orange Pi 5 for me, because 1) it's more expensive , but already includes m.2 slot and doesn't require a fan 2) it's faster 3) standard HDMI. It doesn't include WiFi, but I do not need it.
You can run Ollama with the flag --verbose, to see the token speed. You can run Stable Diffusion (text to image) on all three boards (CPU only), with OnnxStream.
@@makerbymistake by the way, you can set 2 params - so called temperature and seed and after that you will start receiving exactly the same answers on different boards and on different runs
Thank you for the very informative video! PS. Orange Pi accessories, like all sorts of coolers and enclosures are widely available on AliExpress but not on Amazon for some reason.
Thanks for the video! In my opinion, that's the most important comparison video between SBC on TH-cam. One suggestion I could make is, making a comparison video between Rock 5C and X4.
@makerbymistake Thank you for the compliment ans allow me to say the same about you! ❤️ I'm already subscribed and hit the bell to be informed of any future amazing video you'll be making! 😉
I love these SBCs, they're an alternative to my current too powerful PC. If I want to do things quickly and smoothly I'll just turn on my PC. If I feel like doing MCU projects and SBC projects with a huge size reduction, and portability is a must. I'll get my SBC and esp32, pico, etc boards. They are all cheap and accessible, you can buy all and don't have to worry much about the difference. Heavy linux user and SoC designer here, I love them all.
I'm looking forward to receive my Crowview Note and plan on using it for browsing/Writing stuff+ maybe a bit of retro gaming. Wanted to know whether you got a recommendation of a SBC for a that usecase? Gotta confess I'm kinda new to these kind of things :D I love Pie ❤
I Love Pie. This is a very good comparison. Especially telling us that Hailo 8/8L isn't for LLM. Joshua Riek was another good pointer. Better image than the manufacturer's OS.
I love pie, In my opinion the main issues with non rpi pi boards is the lack of proper up to date documentation or a lack of decent mainline support (If at all) Documentation is always helpful for beginners who are not deep into the whole sbc ecosystem And mainline ensures users have the latest security patches or drivers (Or customizing the kernel/writing custom modules)
I love Pi. Basically, I've moved on to using Mini PCs for most of my use cases. I still have a lot of these SBCs laying around, but what I absolutely dislike about most of these ARM and RISC-V boards is that they don't support mainline linux. I have to rely on these very shady and hit-or-miss images that the manufacturers release and I have never actually felt comfortable with any of them except Raspberry Pi's offering. The Raspberry Pi itself has increased in cost, especially if you add up all of the peripherals it needs, so I am going to be sticking with Mini PC Proxmox clusters for most of my use cases going forward. I use the older SBC models to support the Armbian project for now, but I am not going to be spending any more money on devices that won't get mainline Linux support.
Thanks so much to Joshua for his service. But he's no longer actively working on these boards. If you want the latest kernel for these boards try MiniArch. They are active and are constantly improving support for SBCs.
"I love pie" I have a Orange Pi 5, 8G. runing Ollama with phi-3, got eval rate o 3.27 (good for me). love your testing on AI model, note: I use armbian and got "RKNPU driver: v0.9.7" base on command I seen in yours.
I can't speak for the others, but I've been using an 8GB Raspberry Pi5 as a desktop PC for the past 10 months. Admittedly, I've also spent out on an SSD and Pimoroni NVMe Base, as well as an IQaudio Codec Zero HAT for high quality stereo audio in and out, but that's given me a system that completely replaces my power hungry main PC for everything apart from gaming and video encoding. It gets used for all everyday tasks which, in my case, includes use as a media centre running KODI, music production with the free DAW Ardour, as well as running FreeCAD and PrusaSlicer to create 3D models to squirt across the network to a 2GB Pi4 running OctoPrint with a camera attached to a 3D printer. Power consumption at the desktop when running Raspberry Pi OS is around 5W. Once you go NVMe SSD at Gen 3 on a Pi5, they become surprisingly responsive for their limited horsepower. It's very rare that I have to sit around waiting for anything to happen.
Who likes Arch? I do :p So far I've enjoyed the Orange Pi. I don't even use the NPU. For camera, there's always the USB interface. BTW, I also love Pi's
Wish the Pi 5 use more advance process. Hard to compare a 16nm Pi 5 to a 8nm RK3588S. BTW, there is RK3588 in the same form factor with PCIE Gen3x4 NVME. If you test the DNN of OpenCV, the Pi5 will be super HOT! The stock fansink will be a jok. And the 3Ghz Pi 5 will be slower than Pi 4B in that test. Finger crossed...
I Love Pie, In my opinion, the Rock 5B is an even better choice due to its M.2 NVMe slot (PCIe 3.0 x4) and an additional M.2 E-key slot, which is set by default for a Wi-Fi card. However, you can use the Radxa M.2 E-key to SATA adapter, and by changing the overlay, you can connect an external SATA drive. It also has a 2.5Gb Ethernet port, which results in its higher price.
The Rock 5B is a great option. I use it quite a bit but it's fiddly with power adapters. Sucks that I can't just grab any power adapters. I think they fixed that in the newest revision
@makerbymistake I don't know, I had this board connected to a Samsung PD 25W charger and to an AliExpress 5 ports 140W charger and it works in both cases, although I currently use a different power supply option, i.e. connecting fixed supply voltage, that is, if I remember correctly, you can connect a power supply with a voltage in the range of 5V-20V to the USB C port without any protocol
Actually there are already ASICs for LLMs, just like almost 10 years ago they appeared for bitcoin mining. Right now they are pretty expensive, but in 5-10 years I'm sure we will have hats with LLM acceleration (100x and more)
I bought the original Orange Pi 5 (RK3588S) on pre-order during the Raspberry Pi shortage. I was thinking about buying the Max version, which is next one up from the Pro with the RK3588. Right now, I think that one of the original two Orange Pi 5 models might be better deals. I haven't seen them compared head to head but there are more OS available for those two. They're the same processors, the second model, has the full RK3588. I'm pretty sure that my original Orange Pi has the NPU. I'll have to check on that. In the end, I ended up buying an N100 based mini PC. Don't get me wrong. I still love my SBCs. But I needed a small cheap, desktop computer and all of the SBCs have lost out to the little NUC boxes on that front. They're great for projects not being the best cheap desktop anymore.
Thanks for the insight. What I found in my research is that the difference between the full RK3588 and the other S and S2 variants is just I/O features. Processing power and NPU are the same
So many TH-camrs get on the same bandwagon with their opinions that documentation is better for the Raspberry Pi. In fact the RK3588 has a far more detailed technical reference manual than the BCM2712. The GPU inside the BCM2712 (and other Pi models) is totally closed and meaningful, public documentation is virtually non existent. Yet, according to TH-camrs, the documentation it is better.
I was evaluating it from an every day end user perspective. Where would I find the documentation for the RK3588? I don't see it on Orange Pi or Radxa's website
I have and love the 5b and used it as daily driver for months , but the documentation is all over the place. They have two different version of spec pages because they never disabled the older ones. An at least for me, Riek's Ubuntu was the closest to OOTB operation but I had to get through the early official images being very incapable before Riek's. And seeing he's on an indefinite hiatus with it -- part of the issue is that Rockchip doesn't appear to be helping anyone out with their software development for sbc's, so that's gonna also hinder Radxa/Opi in being able to reach, at bare minimum, a consistent ability to load an OS on the board and get going. And a lot of is not the Eli5 that new/inexperienced users benefit from
I also think it seems most of the videos are focusing on the OOTB /default image experience for the same reason. Like any one of them would have a different experience with the Ubuntu but I think nobody seems to test and review because at bare minimum the default should be fine.
I love Pie. Well done and thanks for sharing your experience. I am a Rpi user, I have 2, 3, 4 and 5 and I still feel other SBC can't hold the user experience.
"Support" can be compensated by simply... you know... learning. In other words, not having out of the box support does not make (an sbc) worse. That also goes for "Ease of use". This is like trying to convince a mathematician to use something completely unrelated to its job while trying to adapt (said unrelated thing) to what s/he knows -- its simply not possible.
I love Pie, lol ) Thank you for the video, bro. I would like to see more tests on AI side and compatibility with different hardware hats for Raspberry and Radxa boards
asking which is best out of these 3 is like asking whats the best screwdriver........could you be more vague.......it depends what you are doing with it......these all excel in their own way.
I see very less people compare Redxa rock 5c in there video. Really appreciate you picked this board up for your comparison.
You’re the only one that did a nice job of comparing all 3 famous boards.
Glad you enjoyed the comparison!
Yep! I don't believe that it took 2 whole years for a decent video on this topic...
I hardly disagree with your desktop review. You have mentioned Joshua's ubuntu rockchip, those images does 4k60 on youtube fine, even vp9 and av1, not just h264 like pi5 on youtube (limited to 1080p30fps) . Rpi5 is not even close to that. The same can be accomplished with armbian legacy gnome noble with mesa/vpu extension that foes similar additions than Joshua-Riek ubuntu-rockchip + real mesa panthor kernel gpu driver. I understand that you used official images, but I do daily on rock5b and it's miles away from rpi5 as desktop.
Yea, but that's your only real option with the OPis. RPi has tons of packages that work for tons of use cases. OPi being propped up by 1 person is sad. JR is amazing for his work but you can't ignore the lack of support for OPi.
Great comparison. Always wanted to see differences, not only based on specs but also documentation and community support.
And I love Pi.
"I love pie"
What I feel many youtubers miss is that there are lots of transferable skills in the SBC world, especially for the same or similar SOCs. Once you get the taste of the mediocre first party operating systems, you know to avoid them at all costs. It is sad that each SBC is approached naively and without any context. It should not be surprising the community distributions are better. They are made by people who actually try to use this stuff. And if there is a new board with the same SOC, great, just convert another system and you're done. Manufacturers always seem to be reinventing the wheel (and failing at it).
Of course each SBC has its quirks, some are completely broken, but I doubt anyone sane uses official images for things other than set-and-forget boxes.
Thanks for the comment. I mean, there are transferable skills in pretty much everything in life. Are you implying I'm a TH-camr? Dunno if I'm flattered or offended ;)
I love Pie.... Excited to get my first IoT board
I like pie. I love pie. Your comparison is well done - thanks!
I'm a fan of pie too!
Orange Pi 5 for me, because 1) it's more expensive , but already includes m.2 slot and doesn't require a fan 2) it's faster 3) standard HDMI. It doesn't include WiFi, but I do not need it.
You can run Ollama with the flag --verbose, to see the token speed.
You can run Stable Diffusion (text to image) on all three boards (CPU only), with OnnxStream.
Awesome, good to know. The side by side comparison shows that ollama on the RPi was indeed slower.
@@makerbymistake by the way, you can set 2 params - so called temperature and seed and after that you will start receiving exactly the same answers on different boards and on different runs
Thank you for the very informative video!
PS. Orange Pi accessories, like all sorts of coolers and enclosures are widely available on AliExpress but not on Amazon for some reason.
Thanks for the video! In my opinion, that's the most important comparison video between SBC on TH-cam.
One suggestion I could make is, making a comparison video between Rock 5C and X4.
You are too kind! Thanks for the suggestions
@makerbymistake Thank you for the compliment ans allow me to say the same about you! ❤️
I'm already subscribed and hit the bell to be informed of any future amazing video you'll be making! 😉
I love these SBCs, they're an alternative to my current too powerful PC. If I want to do things quickly and smoothly I'll just turn on my PC. If I feel like doing MCU projects and SBC projects with a huge size reduction, and portability is a must. I'll get my SBC and esp32, pico, etc boards. They are all cheap and accessible, you can buy all and don't have to worry much about the difference.
Heavy linux user and SoC designer here, I love them all.
Thanks for the review!
I love pie
Me too!
I love pie. I have both the RPi5 and Rock 5c. Look forward to trying the Ubuntu image you mentioned for rock5c.
Awesome!
I'm looking forward to receive my Crowview Note and plan on using it for browsing/Writing stuff+ maybe a bit of retro gaming.
Wanted to know whether you got a recommendation of a SBC for a that usecase?
Gotta confess I'm kinda new to these kind of things :D
I love Pie ❤
nice I cam across this! This is the style of video I like.
and I love pie ... ok I jumped the gun
Haha, Nice!
I Love Pie. This is a very good comparison. Especially telling us that Hailo 8/8L isn't for LLM. Joshua Riek was another good pointer. Better image than the manufacturer's OS.
Thanks!
i like eating pi. idk if like blueberry pi but i for sure do love me some rasp pi
I love Orange Pi but I'm starting to like Radxa lineup
I love pie, In my opinion the main issues with non rpi pi boards is the lack of proper up to date documentation or a lack of decent mainline support (If at all)
Documentation is always helpful for beginners who are not deep into the whole sbc ecosystem
And mainline ensures users have the latest security patches or drivers (Or customizing the kernel/writing custom modules)
For sure!
This is why a Raspberry Pi 5 was an easy choice for my first sbc.
I love Pie... Well I just love tiny PCs. Will you do any RISC-V based computers?
Hopefully soon
I love Pi. Basically, I've moved on to using Mini PCs for most of my use cases. I still have a lot of these SBCs laying around, but what I absolutely dislike about most of these ARM and RISC-V boards is that they don't support mainline linux. I have to rely on these very shady and hit-or-miss images that the manufacturers release and I have never actually felt comfortable with any of them except Raspberry Pi's offering. The Raspberry Pi itself has increased in cost, especially if you add up all of the peripherals it needs, so I am going to be sticking with Mini PC Proxmox clusters for most of my use cases going forward. I use the older SBC models to support the Armbian project for now, but I am not going to be spending any more money on devices that won't get mainline Linux support.
I understand where you're coming from.
Have you considered calling your channel Mistaker, has a nice ring to it, just a thought
I Love Pie... all the way down from Spain
'/set verbose' once the LLM is loaded to show tokens per second, eval rate, etc.
Thanks, yeah, another comment mentioned that. Still don't have a way to do that with RKLLM to compare though. Ollama on the RPi is obviously slower
I love pie
I also love these videos there so helpful!
Glad to hear it!
Thanks so much to Joshua for his service. But he's no longer actively working on these boards. If you want the latest kernel for these boards try MiniArch. They are active and are constantly improving support for SBCs.
"I love pie"
I have a Orange Pi 5, 8G. runing Ollama with phi-3, got eval rate o 3.27 (good for me).
love your testing on AI model, note: I use armbian and got "RKNPU driver: v0.9.7" base on command I seen in yours.
Thanks for the info. Yeah, armbian has the newer NPU firmware also!
I can't speak for the others, but I've been using an 8GB Raspberry Pi5 as a desktop PC for the past 10 months. Admittedly, I've also spent out on an SSD and Pimoroni NVMe Base, as well as an IQaudio Codec Zero HAT for high quality stereo audio in and out, but that's given me a system that completely replaces my power hungry main PC for everything apart from gaming and video encoding.
It gets used for all everyday tasks which, in my case, includes use as a media centre running KODI, music production with the free DAW Ardour, as well as running FreeCAD and PrusaSlicer to create 3D models to squirt across the network to a 2GB Pi4 running OctoPrint with a camera attached to a 3D printer. Power consumption at the desktop when running Raspberry Pi OS is around 5W.
Once you go NVMe SSD at Gen 3 on a Pi5, they become surprisingly responsive for their limited horsepower. It's very rare that I have to sit around waiting for anything to happen.
I would love pie if I had one
I Love Pie... Sometimes.
I have strong positive feelings for pie. Apple pie, pizza pie, strawberry rhubarb pie, raspberry pi.... 😅
Haha, I'm a big fan of pie too!
I love pi too, but I use it only as a NAS 😂
Who likes Arch? I do :p
So far I've enjoyed the Orange Pi. I don't even use the NPU. For camera, there's always the USB interface.
BTW, I also love Pi's
Wish the Pi 5 use more advance process. Hard to compare a 16nm Pi 5 to a 8nm RK3588S. BTW, there is RK3588 in the same form factor with PCIE Gen3x4 NVME.
If you test the DNN of OpenCV, the Pi5 will be super HOT! The stock fansink will be a jok.
And the 3Ghz Pi 5 will be slower than Pi 4B in that test.
Finger crossed...
Bad timing as the Ubuntu development for the Rockchip has ceased.
What do you mean?
I Love Pie,
In my opinion, the Rock 5B is an even better choice due to its M.2 NVMe slot (PCIe 3.0 x4) and an additional M.2 E-key slot, which is set by default for a Wi-Fi card. However, you can use the Radxa M.2 E-key to SATA adapter, and by changing the overlay, you can connect an external SATA drive. It also has a 2.5Gb Ethernet port, which results in its higher price.
The Rock 5B is a great option. I use it quite a bit but it's fiddly with power adapters. Sucks that I can't just grab any power adapters. I think they fixed that in the newest revision
@makerbymistake I don't know, I had this board connected to a Samsung PD 25W charger and to an AliExpress 5 ports 140W charger and it works in both cases, although I currently use a different power supply option, i.e. connecting fixed supply voltage, that is, if I remember correctly, you can connect a power supply with a voltage in the range of 5V-20V to the USB C port without any protocol
@GremlineQPl I believe they fixed the power issue in newer revisions. If you search for rock 5B power issues, you will see what I mean
@@makerbymistake I meant more that I don't know if they fixed it or not, I knew they were there, but I didn't have any
Got it
I love pie 🥧
I love pie and Pi.
I'm sure someone will come out with a LLM hat soon, and it will be no contest. I❤pi
Actually there are already ASICs for LLMs, just like almost 10 years ago they appeared for bitcoin mining. Right now they are pretty expensive, but in 5-10 years I'm sure we will have hats with LLM acceleration (100x and more)
I Love pie - and Wisconsin!
Cheers!
I love pie. Would have loved to see some computer vision test.
Don't use the AI kit for RPI. They decided to not include an NPU, that is on them.
Already working on a computer vision comparison
I bought the original Orange Pi 5 (RK3588S) on pre-order during the Raspberry Pi shortage. I was thinking about buying the Max version, which is next one up from the Pro with the RK3588. Right now, I think that one of the original two Orange Pi 5 models might be better deals. I haven't seen them compared head to head but there are more OS available for those two. They're the same processors, the second model, has the full RK3588. I'm pretty sure that my original Orange Pi has the NPU. I'll have to check on that.
In the end, I ended up buying an N100 based mini PC. Don't get me wrong. I still love my SBCs. But I needed a small cheap, desktop computer and all of the SBCs have lost out to the little NUC boxes on that front. They're great for projects not being the best cheap desktop anymore.
Thanks for the insight. What I found in my research is that the difference between the full RK3588 and the other S and S2 variants is just I/O features. Processing power and NPU are the same
I love steak and ale pie ;)
awesome))
So many TH-camrs get on the same bandwagon with their opinions that documentation is better for the Raspberry Pi. In fact the RK3588 has a far more detailed technical reference manual than the BCM2712. The GPU inside the BCM2712 (and other Pi models) is totally closed and meaningful, public documentation is virtually non existent. Yet, according to TH-camrs, the documentation it is better.
I was evaluating it from an every day end user perspective. Where would I find the documentation for the RK3588? I don't see it on Orange Pi or Radxa's website
I have and love the 5b and used it as daily driver for months , but the documentation is all over the place. They have two different version of spec pages because they never disabled the older ones. An at least for me, Riek's Ubuntu was the closest to OOTB operation but I had to get through the early official images being very incapable before Riek's. And seeing he's on an indefinite hiatus with it -- part of the issue is that Rockchip doesn't appear to be helping anyone out with their software development for sbc's, so that's gonna also hinder Radxa/Opi in being able to reach, at bare minimum, a consistent ability to load an OS on the board and get going. And a lot of is not the Eli5 that new/inexperienced users benefit from
I also think it seems most of the videos are focusing on the OOTB /default image experience for the same reason. Like any one of them would have a different experience with the Ubuntu but I think nobody seems to test and review because at bare minimum the default should be fine.
i love (apple) pie XD
I Love pi - as you asked at th-cam.com/video/2OQ5ascBuCw/w-d-xo.html
I love Pie. Well done and thanks for sharing your experience. I am a Rpi user, I have 2, 3, 4 and 5 and I still feel other SBC can't hold the user experience.
I've been using all sorts of SBCs for over a decade and I also think RPi is the best when it com a to documentation and support
I love Pi. Thank you for your test😊
My pleasure 😊
"Support" can be compensated by simply... you know... learning. In other words, not having out of the box support does not make (an sbc) worse. That also goes for "Ease of use".
This is like trying to convince a mathematician to use something completely unrelated to its job while trying to adapt (said unrelated thing) to what s/he knows -- its simply not possible.
"a separate connector for eMMC modules" - he said while placing an SPI flash module
I did grab the SPI module instead of the EMMC but only noticed that during the edit
I love Pie, lol ) Thank you for the video, bro. I would like to see more tests on AI side and compatibility with different hardware hats for Raspberry and Radxa boards
I'm working on that vídeo!!
I Love Pi Great Video.
Awesome, thanks!
I love pie. Just that.
Lovely coming from someone named Paixao!
i love pie, pretty descriptive
I love pie. Greetings from Perú.
Thanks for watching!
I love pi. ... and, thank you for including the AI info.
Thanks for watching! Yeah, "edge AI" is definitely gaining traction
I love pi
Great video
Thanks, and thanks for watching!
I love pie!
I love Pie. SBCs are beasts now. Even beefier Rockchips are rumoured "coming out soon™". 😎
For sure. Yeah a new RK chip was announced. Probably some new boards early next year
I love pie. would be interesting to add radxa x4 into the mix and see how x86 fares VS arm
Thanks for watching. I compared the X4 to other SBCs in my X4 video!
I love pi
I love pie.
Thanks for watching!
I love pie 👍 good video :)
Thank you 😋
I don't like pie, but own an Orange Pi Zero3 (cost US$40) so.. Mmmm, Floor Pi.
define best......:).....
I love pie. But gluten doesn't agree with me all that much anymore.
Nice comparison 👍
Thanks! I'm glad you enjoyed it.
I love Pie
asking which is best out of these 3 is like asking whats the best screwdriver........could you be more vague.......it depends what you are doing with it......these all excel in their own way.
fyi the orange pi isnt made by the raspberry pi foundation, so technically its not a pi either
I love pie
RPi hands down. You get a fraction of the support with the others. OPi is being held up by 1 dude mostly, lol.
I love lamp
I love lamb ♥️
I love pie 😊
Cheers!
I love pi!
I love Pi
I love pi. ❤
Me too!
I love pie...
Although I would wanna go for zima board. (I know, it's x86; I am good with that)
overpriced
@SK-bl1lp that's true 🥲
Whatever suits your needs or satisfy your cravings!
👀❤🥧
Lol, that's the spirit!!
i love pi :-)
Thanks for watching!
your ai test is bogus.....the rasp pi does not do ai like the others unless you buy the ai kit.
The Raspberry Pi AI Kit doesn't do LLMs. You might have missed the part of the video I mentioned that.
Whats desktop mode on raspberry pi?.........does it have a different mode then that?.....lollol
I love pie
I love pi
I love Pi
I love pie !
Don't we all?
I love pie.
Cheers!
I Love Pie
I Love Pie