Use ANY Headless GPU for Gaming in a Virtual Machine!
ฝัง
- เผยแพร่เมื่อ 2 ก.ย. 2021
- HUGE Thanks to Linode for sponsoring today's video. Get a $100 60-Day credit just for signing up for a new account at linode.com/CraftComputing.
For YEARS I've been trying to make this work. Now, you can use ANY graphics card for 3D Acceleration in a virtual machine. This means any nVidia Tesla or AMD FirePro card normally reserved for machine learning can now be used by you to play games.
But first... What am I drinking???
From Treehouse Brewing comes the Perfect Storm American Double IPA @8.0%. What starts as a mandarin orange juice bomb quickly turns into 'every other hazy IPA' I've ever had. Get a tulip, not a pint.
Full written instructions + software downloads: drive.google.com/drive/folder...
Links to items below may be affiliate links for which I may be compensated
Tesla K80 for $170 on eBay: ebay.to/3iAHkX9
Tesla M40: ebay.to/3DlPPxu
MERCH! GET YOUR MERCH HERE! Shirts, Hoodies, Glassware!
craftcomputing.store
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr...
Music:
No Good Layabout by Kevin MacLeod
Link: incompetech.filmmusic.io/song...
License: filmmusic.io/standard-license - วิทยาศาสตร์และเทคโนโลยี
![[Full Episode] MasterChef Junior Thailand มาสเตอร์เชฟ จูเนียร์ ประเทศไทย Season 3 Episode 4](http://i.ytimg.com/vi/e7Oqqo90x_w/mqdefault.jpg)
"but this is craft computing annnd I'm Jeff" 😂 😂 😂
I know I'm about, son.
@@CraftComputing right at the "but" I thought "it'd be funny as hell if he... Omg he did it!". I laughed so hard I choked on what beer didn't go flying
The man, not a myth, but a legend
"Do not check the primary GPU..."
MY GOD! I have been struggling to get my GRID K1 and Tesla M40s working and just couldn't figure it out in PVE5, 6 and 7. Now I can finally ditch Server 2012 for the host OS.
YOU ARE AWESOME!!!!
This is like the peak of the mountain of troubleshooting!
I can't tell you how satisfying it is to see such a clean and functional set up.
I know I'll never be doing any of this but the nerd in me loves these videos!
Same here. I do an ebay search every time even though I have a Rx 6800XT in my gaming PC.
Yeah, actual facts
I will never do any of this, but it's so interesting to see you tinker :) You and Level1Techs are doing to great work in these niche areas of PC land.
It seems you've been pretty busy on your conquest
Really enjoying your content !
I'm going to try this setup. Thanks for the video, I've been looking into how to do this for a while now
Still contemplating about setting up a proper home lab, but for the time being, I just watch and learn from your shenanigans, and I just love it!
Tesla cards aside, Jeff is without a doubt stepping up his beer game!
You are really making me prioritize building my server/workshop room before any other home improvement project. My NAS will not be happy sitting next to my desk for too much longer. Now I need get my v-machine box up and running....
I love theese videos!! You make it seem so easy, but i'm guessing it takes alot of work to get to that point.
Literally been looking for this method for years.
Thank you Jeff, Great video as always
Glad I could help you with the usbmmidd driver. :D
It was a putting 2+2+2 together with everything else that made this happen :-)
This video has answered so many questions thank you.
very cool. this is the exact sort of solution i was just looking into so my kids could play real pc games. honestly been thinking of setting my whole house up like this would save a lot of space we have 8 machines running here and i would love to consolidate that all into one rack.
Thank you so much for this amazing guide!!
Lot of work to make this video. Great job sir
This couldn't have come at a better time... I was just looking at using K80s (plus an older Threadripper) to run VMs for gaming for the family. I was unaware of the requirement that one VM of the two to not be running. Thanks so much for the heads up! It definitely decreases the interest level in using them (except for in the VM I'm going to be running for video streaming and gaming at once, but may look at different options for everyone else). I'm also going to second the community-driven FOSS Moonlight program. I find it to be better than Parsec at home and on par or slightly better over the internet.
Excellent find. Thank you.
I was just starting to mess with my virtualisation monster when I got the notification for this video: windows server running on Unraid aiming to get GPU-P working so I could get rid of my dedicated Hyper-V machine. I listed my two M40’s on eBay yesterday because I didn’t have the time to figure out the display issues, this gives me fresh hope.
Wish me luck!
It is midnight but a new video is a new video
Magnificent work :)
Thank you, I was able to get more performance from my K10 converted to Grid K2. I also got the K80 working and it's not great but not Bad.
The video I've been waiting for. Absolutely amazing work Jeff! I just wish the K80 could be cooled better for a in-room home lob.
Yeah, it's one VERY deep heatsink, and requires a ton of pressure.
I’m aiming to put an NZXT kraken G12 on at least one of my M40’s using an older Corsair AIO I have. It’s a fairly simple bracket so it’s probably easy to adapt or 3D print something that’ll add two AIO’s to the K80
There are full cover gpu blocks for the k80 if I remember correctly
How about a mineral oil dunk
This Channel made me switch from desktop hardware to enterprise system. So cheap for so much performance with raid dual and quad socket cpu configurations and more
I have an Nvidia tesla M40 in my machine. With a 980ti heatsink and fans on it for cooling. A little modding was needed but works great! the Pcb's are almost identical.
I pass through an old XFX 7550 Ghost single slot to a VM. It's a fun toy and Mesa drivers are so much better these days.
I’m so irritated I didn’t find this channel sooner been trying to do this kind of stuff and looking for tutorials for so long and now I have them thnx
No way. I was just wondering about this earlier today. Look at Twitter, I tagged you in a tweet about this earlier 😂
Awesome method! The way to survive scalperpocalypse!
So I just followed this tutorial(though I'm using manjaro and a tesla m40) and IT WORKS! One issue, just like you, is cooling I have a 3d printed adapter for a server fan and at 12V it's deafeningly loud 5V is just fine for minor games but it just isn't enough for most the games I'm trying to play. So, my plan is to modify a dead RX 480 blower that is much quieter even at 12V and I would be able to run the fan on a motherboard header instead. Hope this works!
Love it! Next phase, seeing how lean can you go on the client device. Thin client? Zero client? RPi?? Probably just minimum or recommended system requirements for Parsec I would think...
Wow, what a journey, let's do this ! Going to add Garuda gaming distro as well.
This methode works to for an rtx 2060 👌🏼 thanks man 😁
Thanks Jeff!!!!
The madman did it!
This is pretty cool. Looks pretty good for running remotely on a VM, on a Proxmox server
May try this for gaming lounge
Thank you for making this video. I hope to use steam and a steam link device. Wish me luck!
Wow this is cool maybe one of my future hobby project
I came here to learn about GPU passthrough but I'm just staring at the cat.
There are so many little clever tricks in this video it's admirable. Using a virtual display driver to force vnc to use another display driver so when noVNC shows up a blank screen the primary display adapter will be pushed through tightVNCs server. Then using the policy editor to force the screen on at each boot. THEN streaming a DirectX devices draw calls remotely with couch play software to fill in the gaps. All while benchmarking the second GPU on the same PCB in an adjacent VM, love it.
you seem to know alot about servers lol, why wont the virutal display driver run on my machine? The driver has a error 31
@@II_superluminal_II error 31 doesn't mean much without a lot of context. A few things suggest it's a permissions issue like the installer wasn't ran as administrator. It depends on what executable returned the error so that the error number corresponds to the appropriate lookup table.
I have to try this now.
Great stuff. By the way, I use your glass of beer as the progress bar :)
fooking life saver mate
Good video.
OHHH This need more IT knowledge that i thought :D
Spacedesk looks to be the answer to the problems getting an output from my Tesla m40 on my guests. Parsec worked fine on the host OS as described here but couldn’t grab the screen on the VMs.
My windows 10 hyper-v box sits on proxmox so I have nested virtualisation happening too, this isn’t wholly crazy as I think it’s the most effective way to have two graphics cards working with paravirtualisation.
Now I have an excuse to buy a thread ripper and less guilt towards the imaginary funds set aside for three computers for the children.
Thanks for setting me on this path Jeff!
Oué mec tout marche comme presenté je te kiff
0:12 What a beautiful cat❤
Parsec is amazing I use it for my Windows and Bigsur vm's on my Unraid server. Great video btw
Bigsur VM’s? On Unraid
Oh Parsec released support for MacOS fairly recently it seems, crazy. Thnx for the heads up
Hi, could this work with ESXI 7 or will you still be limited by being forced to use Nvidia Grid to allocate the 2 GPUs on the K80?
Could this work with a Tesla P4? Thank you
This guide is not only useful with Proxmox on a server passing a Tesla M40 to Windows VM (which your information here helped me set up, works fine), I also dualboot to just Windows 10 on the baremetal Poweredge R720 server for testing, and your setup with Parsec and the virtual display driver (I used usbmmidd_v2 instead of V1), is also useful there!
For example, on bare-metal Windows 10, if I use Parsec to just watch the 'hardware' Matrox built in graphics on the server, at 1080p (with the registry adjusted to unlock 1080p on that ancient Matrox built in card), I get 30ms encode in Parsec (not great)
But if I use Parsec to instead watch the virtual fake display like you have setup here, the encode actually kicks in on the Tesla GPU and the Encode latency time is down to 1-3ms or so (10x better).
Basically tl;dr your guide here is helpful not just for Proxmox but also even for just running bare metal Windows 10 on one of these headless servers and trying to get good latency in Cyperpunk 2077 remotely using a Tesla M40.
pretty neat jow u gpot it all working
I do wonder if the old arctic cooling kit for the GTX690 would fit the K80...it was made with two discrete coolers for each gpu chip and used stick on ram sinks.
Great Video, today i ordert a Nvidia K80 for my Dell PowerEdge R730. Hopefully the graphics card will run as well as your solution under VMWare ESXI 7
Fyi...
Depending on which pve you're using or if you're using grub or systemd boot... zfs on root may also affect...
But instead of /etc/default/grub
You may have to edit /etc/kernel/cmdline
And instead of update-grub
You may have to issue proxmox-boot-tool refresh OR pve-efiboot-tool refresh
Depends on the version of pve -
Depends if grub or systemd was the BL -
Depends if using UEFI
Unsure which is affecting the process - however if your wondering why your passthrough is not working follow what Jeff is doing - if it didn't work - try the other variations - one will work.
Exactly the video I need, I'm looking for a GPU to use with VMs. Need Windows for college, and there's a course with OpenGL, that should go much better with my VM able to use a whole GPU.
I don't have a huge amount of PSU capacity headroom, though while it's idle(which it would be when I'm not hammering it in my VM, and I'll mostly be not be hammering my main GPU at the same time) it should be OK.
Being able to use enterprise cards might open up options, though I'm currently leaning to an RX6400 for cost reasons.
Gosh! I shouldve done this before!
Amazing video!!! There actualy is a waterblock for the tesla k80 on aliexpress.
Yep, because it shares the same PCB as the Titan Z card :-)
I use usbmmidd to run parsec in a optimus, no mux switch laptop with the lid closed, so when you said that there was a solution, I bet that usbmmidd was involved.
respect Jeff, respect...
This is a good idea for those mining GPUs without any outputs
At least nVidia mining GPUs have NVENC disabled in their firmware, making streaming difficult. AMD mining cards would be great contenders for this though.
It is cool but it doesn't support gpu virtualisation so you are limited to the count of gpu's you have. PCI passthrough is enabled on 30 series too. So you can also use them. They don't have to be headless, actually if they have hdmi ports it is better. Just plug them into monitors, passthrough usb ports to add keyboard, mouse etc to the virtual machines, then viola, you have multiple gaming computers running on a single server.
Also using hdmi ports will remove the parsec's blurry gaming experience. It will be just like a physical computer. No additional configuration is needed! Just plug it and it works!
Yet, a lot of games won't support virtual machines especially those with anti-cheat systems. They don't like to be run in virtual machines. Including CS:GO, valorant, LoL etc.
Some games will just crash, in that case change you cpu type to host and enable Intel VMX or AMD SVM!
Some games will really suffer from limited ram performance. I could hardly get 40fps on cyberpunk on my 3090 (normally it would get around 60-70).
Also enabling pci passthrough will disable memory balooning. Which makes the virtual machines use the full amount of memory they have.
So if you have headless gpus, I HIGHLY recommend using gpu-p on Hyper-V.
This allows you to use memory balooning system of Hyper-V.
However with this method, you can run multiple cryptocurrency mining OSes on each gpu flawlessly. I highly recommend proxmox for that particular use case.
I would like to see a update of this with a m40.
You can skip the usbmmidd step on NV cards by adding the registry binary key DevicesConnected to 01 00 02 00 under Computer\HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Video\{some number}\0000. Upon reboot you can enable a fake VGA output. Works on my grid K2
also with some gpo tweaks you can use RDP shadowing instead of vnc
Iiiinteresting... I'll have to give that a shot. That might open up some more resolution options as well. Thanks for the tip!
@@CraftComputing Just updated my display driver from 392 to 465 and this registry trick stopped working :( - but on the plus side I have nvenc/nvdec now and those work headless.
@@jfarre20 what grid driver did you use all the ones i tried had trouble with incompatibility in new games
@@jaredhemley9175 I primarily use it for video decoding in EMBY. I'm not sure if games work very well on this old card. I've used drivers 392 and 465
@@jfarre20 where did you find those drivers the newest I could find on advanced driver search for win 10 64bit is 367 (370.41)
I've been needing this. thank you! would this work with quadro cards as well?
What kind of server did you put these cards in and do you think a setup where you put several of these cards in would make for a viable daily driver PC or would you start to worry about PCIe-lanes running out or becoming CPU bound?
And here I am in Unraid happy I don't have to jump through so many hoops to do the same thing lol
I'll guess it's leveraging Looking Glass?
Edit: it was not
16:22 parsec only supports the raspberry pi 3, not anything else. Since they have to access the encoder directly instead of through an api, it's much more work to develop an app for all rpi devices
Love ProxMox
I wonder if this will work just as effective as Steam’s own “Steam Link”, if you pass a gpu via a VM and launch Steam itself inside of it.
You could use Steam link instead of Parsec for streaming, but the USBMMIDD setup would still be required to emulate a monitor.
@@CraftComputing for a couple months when I had no monitor for my 1060, I used Steam Link to use my (now dead) MacBook Pro as a monitor for gaming, and I had no video output connected at all. No headless adapter, no usbmidd, none of the ports had anything connected at all. Parsec on the other hand, did not work, because it needs a video output device or monitor.
I bought some Tesla M40's a long time ago and stuck them in my Dell R720XD's and have been trying to get them to work like this for quite some time! Jeff you rock! P.s. I use Hyper-V and this process works great with DDA
I’m having trouble getting this to work with hyper-v using paravirtulisation on windows 10 21H1. Any experience getting this working or might I be better downgrading and going with DDA?
@@brianbuckleygray994 I'm using windows server, so I don't have GPU-P yet. If you can deal with only having 1 VM being able to use the GPU, use DDA
@@MikeWillTech thanks for that, if all else fails I can dedicate a card per VM, it’s more the number of computers I want to get under control.
I think you should try cooling the Tesla cards, at least the single gpu cards with one of the Arctic GPU coolers or an Kraken G12 AIO setup.
He has in a previous video slapped a giant blower fan on one side
been looking at a k80 which is titan x2, this would make sense now.
This is a great option for people who can´t buy any GPUs at the moment
I tried partitioning a Titan X Pascal inside a Windows VM using Hyper V for nested virtualization but it performed so bad its unusable. I'm guessing nested virtualization cause a lot of io wait and therefore laggyness. Was testing on an i7 5820K + Asus X99 Deluxe U3.1.
woow nice one
For everyone who wanna use this setup to run large language models, use type host in the cpu settings. Otherwise it can not use the shared gpu memory...
Setting cpu to host also makes the vm run faster since you aren't emulating a specific cpu model
Thanks for the interesting information. Can this method be used to improve video encoding performance? DaVinci Resolve 17.
I have a Tesla M40 that I couldn't figure out how to get to work so anything on getting it functional would be great
Thx. For the update.
This is really an interesting setup,
Can you elaborate the network issues with Linux VMs? I have an ubuntu vm running on proxmox with PCIs passthrough without any problems? (Or I just don't see them)
Time for a easy guide revisit now with the script and higher optics on paravirtualisation?
I do some of this in bare linux but with a consumer card. That way I don't lose any performance. Just use a desktop KVM and switch monitor ports.
Hey! I know that brewery. My wife used to live across the street.
I've tried Parsec and didn't like it and wouldn't give me the performance I wanted, tried Moonlight instead and only requirement for the VM would be to install Geforce Experience and setup the Shield section to add games. Got Moonlight installed on my X900H 65" and added a logitech wireless gamepad to the tv and now I don't even need a Rpi to run a software like parsec. You should look into this also, you can also multiple machines like Parsec does.
sunshine moonlight obliterates parsec
0:22 Cat:"I hate being ignored when set to max floof."
Nope you can't reason with a cat for not cuddling.
Food => Gather.
Homeless => Long fur
Warmth => Long fur, arguable.
No cuddles => No excuse
No treats => Umm, convinced, lol.
(but still annoyed.)
Yes I read cats like books.
I also greet animals more than their owners.
I wish the two GPU's on the k80 could be bridged with sli to complete ur virtualization hack.
just picked up at k20x for £20 great for powering my VM
just to make you aware jeff it works with any gpu not just headless, i followed your guide but i was using a gtx 970 and it works exactly the same.
Pet the damn cat!
I DID!!!!
Pro-tip - just use a virtual display in parsec, to run at any size. no registry keys needed
why not remove the shroud and strap fans directly to the heatsink? or is the heatsink part of the shroud on these/ not dense enough for regular fans. I have 2 120mm fans on an rx480 and it runs cool and quiet. I realise these are higher thermal output (and they look pretty with the shrouds) but is this not an option?
When parsec program is closed on client side does virtual monitor work 1080p in background not returning to 1024x768? so far i'm using teamviewer it works sometimes. I want to use camera stream 24/7 via OBS it has to go through the camera app without rtsp url
I wonder if you can comment on the following question? If I run headless GPUs inside a GPU server (Gigabyte) to do Compute (BOINC/F@H), and I then access Ubuntu desktop via IPMI (iKVM) will it work? There are some reports that you just get a blank screen as the BMC display cannot output if dedicated GPUs are installed; although these are mainly about Supermicro servers. I have searched Google high and low but cannot seem to find a definite answer on this. Your opinion on this would be most helpful.
What is the longest single sentence, involving computers/software,
you can make using mostly abbreviations ? (contest)
(it should be spoken as a single sentence,
not seperate sentences stringed together.)
(the primary score is for the amount of abbreviations.)
as someone looking to upgrade the kiddo setups from ancient Dell boxes, could you recommend a decent ebay server box to get started with one of these? appreciate all the content and guides! this is becoming my favorite channel after LTT :-D
After LTT? Pft.... 😉
Dell R720s include PCIe power most of the time, and make great 2U servers with airflow to support these cards.
@@CraftComputing He meant favorite after BmB
@@CraftComputing thanks for the rec! i'll have to tweet you the current setup while I gameplan the upgrade with your videos
LTT is a clown child that knows almost nothing, his entire corp is affiliate links and shills. Kids watch LTT
If the only intended purpose of a specific virtual machine is gaming, would it make sense to have it set to automatically boot into steam big picture, so that even something like an ayn odin could use steam link to connect? I know that it would barely be any different from setting up a dedicated physical machine, but I imagine the virtualization of such a menial task would be reasonable for the space savings, especially because multiple virtual machines could be set up for other functions without the added use of space.