Meet the Turing Pi 2 - Mix Pis and NVIDIA Jetsons on a Mini ITX Board!
ฝัง
- เผยแพร่เมื่อ 18 พ.ค. 2024
- The Turing Pi 2 is a compact ARM cluster that provides a scalable computing on the edge. The Turning Pi 2 comes with many improvements over the Turning Pi 1. This model ships with 32GB of RAM, SATA III interface, Raspberry Pi Compute module 4 support, and support for NVIDIA Jetson boards. This means that you can mix and match both raspberry Pis along with Nvidia Jetson boards. This gives us a ton of flexibility to be able to run Pis for general compute workloads, and then Nvidia Jetsons for AI or ML workloads. Join me as we explore the Turing Pi 2 and prepare its home inside of my HomeLab server rack.
Video Notes: technotim.live/posts/turing-p...
Support me on Patreon: / technotim
Sponsor me on GitHub: github.com/sponsors/timothyst...
Subscribe on Twitch: / technotim
Become a TH-cam member: / @technotim
Merch Shop 🛍️: l.technotim.live/shop
Gear Recommendations: l.technotim.live/gear
Get Help in Our Discord Community: l.technotim.live/discord
2nd channel: / @technotimtalks
Disclosures:
- I was not paid
- Turing Pi 2 was sent to me for evaluation
📦Products in this video📦
Turing Pi 2 - turingpi.com
Raspberry Pi Compute Modules - www.raspberrypi.com/products/...
NVIDIA Jetson - amzn.to/3eGDQje
Rosewill 2U Server Chassis Case - amzn.to/3qxbygk
EVGA 550 Power Supply - amzn.to/3EMEzd4
Noctua 80mm Redux PWM Fans - amzn.to/3zdBUbp
Samsung EVO microSD 64 GB - amzn.to/3FR5Oos
Samsung EVO microSD 128 GB - amzn.to/3eCIajx
CR2032 Batteries - amzn.to/3zfWE2b
CM4 Heat Sinks - amzn.to/31hSVVk
Multipurpose Rails amzn.to/3Hr6wsS
4 Pin Splitter Cables amzn.to/3mQvzh4
(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)
#RaspberryPi #TuringPi2 #HomeLab
00:00 - Intro
00:24 - Improvements
01:15 - Hardware Specs
01:45 - ATX Power
02:05 - NVIDIA Jetson Support
03:03 - Populating Nodes
03:39 - Raspberry Pi CM4 Compute Modules
04:28 - Turing Pi Node Storage
05:17 - CM4 Cooling Solution
07:05 - Battery
07:26 - 2U Mini ITX Server Rackmount Case
08:22 - Mounting the Turing Pi 2 in a Case
09:34 - ATX Power Supply
10:31 - Mounting the Power Supply
11:31 - Cabling
12:25 - Powering on the Turing Pi 2
12:44 - Installing New Case Fans
15:08 - The Most Annoying Peel Ever
15:37 Putting the Case Bask Together
16:07 - Plans for my Turing Pi 2
16:26 - Stream Highlight - It's not the first time; it will not be the last time
"Carne Asadude" is from Harris Heller's album Pastel.
l.technotim.live/sb-music-lic...
Thank you for watching! - วิทยาศาสตร์และเทคโนโลยี
![ตรงที่เดิม - ฝน พรสุดา [ต้นฉบับ :เบส ขวางหวัน]](http://i.ytimg.com/vi/c5YnbGEztI8/mqdefault.jpg)
What would you do with 4 Pis on one board?
For me, definitely a Kubernetes Cluster w/ Rook + Ceph storage. Can't wait for the upcoming software video!
Better question for me is what can I do!?!?!
My favorite parts of your video was:
1. Watching you peel of the protective sheet…. “Of course I forgot one” 😂
2. Your comment: I’m sure if I’m wrong someone will let me know. I was rolling on this one.
Can’t wait for the next video.
cats and dogs with pyspark
Even more Docker in Swarm mode 😁
How does this configuration compare with the performance of something like an i7?
So excited to get a hold of one of these.
Brilliant as always. Happy new year. Looking forward to seeing how you use your new project
Same to you!
well this looks amazing! compute at the edge is pretty cool... It was interesting to learn that all Chik Fil As run on a cluster of NUC's sent to each location.
Sounds like the perfect cluster for retail / food service with many locations, just ship commodity hardware!
Making chicken sandwiches is serious business.
@@theglowcloud2215 based on the line I see when I drive by it certainly is!
This is exciting!
Really looking forward to the next part.
Thanks!
@@TechnoTim Is there a follow up video to this? My search skills appear to be lacking.
This is super cool Tim! Amazing you were able to get your hands on it. Can’t wait to see what projects you have in store for the Turing Pi 2!
I think some kind of hyperconverged setup would be neat where you run a three node Kubernetes cluster on the Pi’s (k3s) and then leverage Jetson for some AI or ML workloads since the NVIDIA Container Toolkit >= 1.7.0 (nvidia-docker2 >= 2.8.0) you used for your GPU passthrough video now supports Jetson with Ubuntu 20.04 + arm64.
Sweet! Can’t wait to be able to get one and do the same!
Love to see the channel growth brother, keep working hard! 🙌
Ethan! Thanks man!
As always a really Great video! Looking forward to the next video on this! =D
Thank you!
Looks like a nice project!!
It is!
Dang I'm jealous, this looks like it's gonna be awesome!
Happy New Year Tim! I hope you are keeping warm with the below zero weather in Minnesota.
Haha! -10 today! Thank you!
Dope thanks a lot for the tutorial. 🤓
Thank you!
Great video - I had a very similar issue with the PSU in a 2U chassis like that. In the end, I put the fan downwards and cut a hole in the bottom to allow the PSU to breath. Maybe frowned upon, but it has worked out very well. Cool air in from the bottom outside the chassis and vented out the back. I guess there is the risk of dust ingress into the PSU, but I stand by my decision...
Home version of "Blade system" nice!
Vote up, thanks for sharing the video :)
Thanks for voting!
I actually can't wait for the next video! I have x3 Nvidia Jetson Nano 2GB and and 3 Raspberry Pi 4b+ that ice been wanting to combine into an AIO cluster! Will you be deploying anything on your new cluster? Perhaps a series?
Cool video, thank you
Glad you liked it!
Dude!!! I want one. Been waiting months!
Soon!
Nice video
I literally just bought the 4 bay version rosewill case to put my old itx into. Big fan. Do note that I swapped the fans out for some noctua 80mm ones
so did I in this vodeo!
@@TechnoTim ya I commented like 30 seconds before you did the fan swap >.< shame 🔔
All good! I love play by play comments!
Since it's mini-ITX, two of these can fit into that 2U, that would be amazing.
It certainly would!
I have a similar PSU in a 2U case powereing 9 HDDs with the fan up against the top like that. It's been running for months without issue. I have a actual 2U PSU to replace it with but I haven't gotten around to it yet.
Nice! I later figure out that the lid is vented!
15:15 For the front fans, I heard that early revisions of the Turing Pi 2 had backwards fan headers. Maybe try reversing the polarity.
Given that the PSU will not have to supply a lot of power, I think it will run just fine
According to EVGA website fan on this PSU has "ECO" mode - when enabled it should not even spin until 40% load and I don't think this cluster will ever reach 220W. So you can enable ECO mode (switch next to the main on/off switch on the PSU) and don't really concern yourself with the PSU fan.
Good call! Discovered that button after the video!
PicoPSU or Corsair SF 450 Platinum (for more breathing room) is maybe the better pick, if you care about efficiency.
Really cool! Where's the video covering the software setup? Can't seem to find it.
Soon!
@@TechnoTim I appreciate all your videos man. Have you by chance posted the software setup yet?
@TechnoTim which operating system did you use for this cluster? Did you use Linux4Tegra and did that also work with CM4’s? Thanks!
What a cool little build, would love to get into something like this. Question does the board now have a back plate?
This prototype did not, I assume the final will
Update: Still unsure but Jeff Geerling created a model to 3d print one!
@@TechnoTim Worth a print if he did, now was it Jeff or Red Shirt Jeff who did hehe
hello Tim
so great as usual
...but what is the difference between this and a standard PC ? Or a NAS ?
May you post a tutorial on how to do to setup Traefik + openLDAP + Keycloak to manage auth on docker containers ? It will be so good. welldone for this channel. bye
Think of this as a Raspberry Pi cluster on one motherboard.
What's the advantage of running a Pi cluster over a cluster of low-power Celerons or Pumas or even a single hexacore?
It seems to me that power consumption would be pretty much the same but performance would be greater with the x86 cpus.
What was the project cost for all of this? Looks fun!
This needs a custom loop!
Hey, great walkthrough, did you ever make a follow-up on this?
Not yet!
I have question - can you combine rockchip + pi + jetson and use this together?Next question arm windows 11 on this?
notice the atx has offset mounting holes, so it mounts only one way -if you use all 4 securing screws-
i like to use the picopsu's for these low power devices -intel j4205 omv4 with 12v up to 180watt wall wart etc- in small cases to mount extra usb3 hd's where the psu would have been. lol never did 3d print/popsicle stick a cage for em though, ill do it some day
The downside of pico psu is that the while it is small in the case, the power brick is huge. I’d rather tuck the mess away in a case with a standard psu
@@TechnoTim true if you look in the pc sections.
if you look in the lighting & car sections you can find 12v 10a + laptop power sized 12v to run these fine
oc you could use laptop 19v high amp ww with a small cheap as chips dc to dc 'buck' converter to
Thank you!
Did part 2 ever come out? I can't seem to find it. Trying to get my software set up
Not yet! I didn't get a TP2 yet!
@@TechnoTim =O Hopefully soon! I finally got my individual nodes up and running, just need to get Kubernetes configured
Thank for sharing. What's version of Jetson 2 or 4 GB? Is there big difference?
This is a 2. Not sure I would notice the differences unless you are running a specific workload
hi dude, would you know (or try for us) if the jetson is capable of running a plex server with hardware transcoding ?
Obviously fan down for the PSU. Don't you see the text on it is upside down?
Excellent Tutorials on Turing Pi v2 board. Just wondering who got the documentations on the different flavors for the Turing Pi v2 board since it supports both the Raspberry Pi and Jetson. Can the board supports the Jetson Nano, Xavier and high end Jetson AGX. If you have 1 x Jetson Nano (2GB), 1 x Jetson Nano (4GB), 1 x Xavier NX plus 1 x AGX Xavier. Does it mean when you turn the system on, you will get 4 separate screens that will allow you to the multi-taskings. I think more cost effective is to have 3 or 4 nodes on Raspberry Pi to run on Kubernetes and Containers.
Thank you! Each device has shared and dedicated hardware. As far as video output, only 1 can have access to the HDMI, which is node slot 1. You can still use other nvidia devices but not with a video output. Remote control or just pushing your ML / AI workload is going to be the way to go, even if it is connected to HDMI.
Are these CM4 SODIMM adapters come from Turing? I've only heard about Gumstix but they look different. I just ordering all the parts in advance to get ready for Turing Pi V2 launch ;-)
They are from Turing. From my understanding they will have them available for sale closer to the launch.
PC fan screws are always snug because they're designed to cut their own threads into the plastic as you turn them.
So satisfying!
Were you able to publish the follow-up video? If so, could you point me in its direction?
Going over on the PSU also means the fan won't turn on as often. Heard this from the most recent build of Linus Torvalds.
Less revolutions! I like it! Thank you!
The subtitles of this video clip was mentioned as Traditional Chinese, however it's apparently shown in Simplified Chinese language.
Any progress being made on the new video?
How can we Virtualize Macos with Proxmox?
Nice! What rails do you use to rack mount that case and do they slide?
I always choose these rails when the device I use doesn't come with them amzn.to/3Hr6wsS
@@TechnoTim Thank you. I clicked the link and it went to a page that said I last purchased these in April 2021. Haha. I am already using these for a different server.
haha! When I go there it says:
Purchased 3 times.
Last purchased Oct 14, 2020.
I need help :)
@@TechnoTim based on your videos I think you may soon need a full size rack 😁
@@groto27 I was just thinking the same thing last week...
I’m seriously considering one of these and I’m not an advanced user. I want to run web apps/kubernetes on pi 4s (UniFi, UNMS, PiHole, home assistant, etc.) and then I was thinking a jetson could be fun and maybe it could do transcoding for Plex? Is that possible? My current server is UnRaid based and I have a Gaming VM on it as well. I’m thinking something like this would give better fault tolerance plus be cheaper than trying to go to some higher end CPU to handle everything. I’m assuming I can give the cluster access to a share folder on my UnRaid server right?
Ansible show time soon?
Where do you get the raspberry pi boards? 😭
I'm not sure I get it, apart from being able to power it with a regular atx psu, what's the advantage of the turing pi 2 over running just a regular stack of pi's?
I haven't gotten one myself yet, but I heard it has an IPMI-like management option, there are a few M.2 slots to use the pis' PCIe lanes, and I heard if one of the pi's has a wireless modem connected to one of those M.2s it could share a connection with the other three.
I also figure since it has its own gigabit switch built in, and powers all 4 pi's off a single ATX connector, that makes it easier to supply power and to connect to network for all 4 nodes, rather than giving each one its own ethernet and its own power, or buying four PoE HATs and still having to run four ethernet cables.
Exactly!
This is just WICKED content !!
Thank you!
Does Ruring Pi work with Orange Pi?
Whats the total cost of adapters, board and all pi modules? To build such cluster.
haha! Crazy performance but only a single node!
Would this give any advantage over just getting some normal pi’s and using a POE switch?
Yes, no dongles
Any update on usage of this system?
It's a damn shame Pfsense doesn't run on these. I hope the Pfsense community is listening. These devices are getting better and better every day and every year. We really need to turn this into unified threat management system.
Looks like OPNSense works on ARM.
Anything new with the Touring Pi 2???
Does it support Nvidia Jetson Xavier NX?😮
Is it possible to use it for animation rendering?
Yep
The PSU problem is common since they built not much with 80mm FAN on the side anymore. Thats because they give up fast when nobody cleans em.
Btw. if your PC shuts off from time to time it could be a dirty PSU! Open and clean them atleast every 5 years!
Hi! What's the height of the board with the Compute Moduls? I have an empty 1.5U case here...
I believe 2.25" or so. On Wednesday I'll be posting a video about racking up the cluster. I had to get a 2U case because it was just too high for 1 or 1.5U.
@@JeffGeerling Thanks, Jeff!
Thanks Jeff! Can't wait to see yours!
can it run gamecube emulator?
Static damage is still a real issue.
Wounder how it would handle mining
A pity it doesn't come a backplate IO shield.
Jeff Geerling created a model to 3d print one!
@@TechnoTim 3D printers are like mods to games, they solve all sorts of problems, and come in all shapes and sizes.
@@festro1000 for sure!
But the compute modules are sold out everywhere, too.
Agreed
Well that's a reason to move plex to kubernetes
You never need to and I would most likely not unless you are doing single node and want the k8s api
Jack Sparrow🎉
Fun fact … Stan isn’t delivering still.
Would this new Turing Pi 2 be a good candidate to run as the third node for Proxmox High Availability? I'm looking for a low power option for the 3rd node, instead of running three enterprise class servers...I'd like the 3rd node to be low power and just vote for quorum.
it come with a IO shield ?
Not this prototype but the final should!
Jeff Geerling created a model to 3d print one!
@@TechnoTim Thanks I saw that this morning good looking out!
That case is overkill. It's too much. Smaller is better. Otherwise this is a great video share.
If you want it in a rack, you don't have many options!
it doesn't mater in witch direction you putting the PSU, is not gonna spin anyway at this low power.
Thank you!
I cringed so hard when you put the mobo with a battery on the exposed metal of the case lid. Is it just me or is it a miracle it didn't short?
The case has standoffs 😅
Very nice.
(But change the adress for your manicure.)
haha! I think I need to find one first
Whats the point of this? like what does it do and why do it this way instead of just building a normal system? What benefit does this add? what is the point? Please I just wanna understand the point..... I know computers well but NOT the Pi side of things or the Server/industrial side of things.
It's a way to run raspberry pis but in standard PC hardware. This gives you low powered ARM capabilities and connectivity in a single platform.
Or you can go with the cheapest M1 Mac mini , am I right 👍
Haha! Crazy performance but only 1 node!
so wtf is the point can I run haiku os or is this just for kubernetes clusters that I can never seem to find software worth using on and why the long and useless video
Thanks to you, I just bought an HP DL360p G8 8SFF server. Can't wait for it to deliver probably this week, what should I prioritize in March (when it's my birthday) Should I prioritize filling it with 1.2 TB disks? Or buy one more server or buy a rack? I want all of this, so yeah.
I say make it functional first! Rack can wait.
@@TechnoTim Cool!