How to Setup a LAN / Steam Cache with Pre-Fill & DNS on Unraid
ฝัง
- เผยแพร่เมื่อ 13 ธ.ค. 2022
- This video shows how to setup a LAN / Steam Cache using an Unraid server. See how to set up the DNS multiple ways and how to add
the pre-fill container to automatically fill the LAN Cache
Please, if you can and want to support the channel and donate you can do so by Paypal here goo.gl/dw6MLW or check my patreon page / spaceinvaderone
Bitcoin donations 3LMxDzcwPdjXQmmeBPzfvUgjYFDTqDAgQF
commands used in this video drive.google.com/file/d/17Okg...
Need a VPN?
PIA is popular with Unraid users as its easy to setup with various vpn download containers - www.privateinternetaccess.com...
Torguard is also an excellent VPN again with both openvpn and wireguard protocls supported.
Get 50% off for life using code spaceinvaderone torguard.net/aff.php?aff=6005
Need a cheap windows 10 licence for around $10 consogame.com/software/window...
Need to buy something from amazon? Then please use my link to help the channel :)
USA - amzn.to/3kCikfU
UK - amzn.to/2UsYb1f
USA link - USB HDD Docking station amzn.to/3v754WG
UK Link - USB HDD Docking station amzn.to/3hLenYp
HighPoint RocketStor 6414S amzn.to/3fiXv9s USA
Mini SAS 26-Pin SFF-8088 Male to Mini SAS 26-Pin SFF-8088
amzn.to/2V4x9kT USA
amzn.to/3xfkxEl UK
A big thankyou to Limetechnology for all the great work that they put into always improving Unraid OS. - วิทยาศาสตร์และเทคโนโลยี
If I ever ran in to this man in person, I'd probably tear up and try to give him a hug. I wouldn't have figured out anything about Unraid without his videos.
Thanks for sharing such kind words, it really means a lot to me! I'm so glad to hear that my videos have been helpful in your journey with Unraid. I started creating content to help others, and comments like this really make it all worthwhile. It's amazing to see the impact that technology and community can have on people's lives. Keep learning and exploring, and don't hesitate to reach out if you have any questions or just want to say hi!
@@SpaceinvaderOne be aware that you might have fans from all over the world. Cheers from Slovakia. And yes, same here as @tb0ne315 - word by word.
This. Just started using an OS other than Windows when I got a Steam Deck. Now I have an Unraid server. It's been a wild year. :D
Prefill dev here. Great work on the video! Always cool to see my stuff out there in the community.
The Prefill part is what I'm most interested in. Is there a way to set this up without caching my manual downloads? I would need a larger SSD to do this properly, but I would be able to use my cache drive for specific games until I add a larger SSD.
@@i_am_macgyver84 The only way to "disable" caching for your manual downloads would be to temporarily disable LC on the machine that you're installing them on.
Otherwise, another option would be to periodically run SteamPrefill with the --force flag. What this will do, is it will always "redownload" everything in the select-apps list. The result of this will be, is that anything you "manually" downloaded will eventually get pushed out of the cache, leaving only the things prefilled with SteamPrefill.
@@timpilius585 Thanks for the reply. I'm having an issue saying Setting up cron job failed, so my schedule isn't working correctly. So I just manually engaged the downloads through the console to at least test if everything else is working and I hit a little over 84MBps, which could probably be higher but I have other things going on. But for me to truly use this how I would like I will need to get a separate SSD one day.
I have a issue with the terminal that the under side of the terminal is been bugged.
@@SuperHD-uy4fn Yep, I've gotten a few reports of this. I'm going to revert the change today to fix it.
This is the first time I see my teacher after using unraid for 5-6 years. Thank you very much for helping us how to use unraid correctly.
Your tutorials have litterally made UNRAID for me. Thank you so much!
😀 The voice has a face! I thought it was an advert to start with! Strangely weird knowing the voice for the last 5 years or so. New studio looks cool! Edit..... Just realised I'm about a month behind the drag curve...... In my defence, I've got a big build on too..... Can't wait for more.... Make it so, No1....
I thought the same thing when he did the first video in the new studio lol.
I was just getting ready to say something to the same effect! - ill say it anyway, The voice belongs to a face! Thats awesome, i was just starting to think you actually where a space Invader. 🤔😅
I thought he was in his 70’s based off the sound of his voice lol
And all this time I was assuming that this channel was ran by the guy from the explainingcomputers TH-cam channel... mind blown
Exactly what I needed. Quality as usual Ed! So glad you are up and running again. After setting up my first UnRAID server 4 years ago and now looking back you are the reason I got into UnRAID in the first place, and the reason all the services runs so smoothly. I will be a Patreon for the foreseeable future.
Any chance you would do a video on secure file transfer like sftp?
Another reason to set this up is for those pesky ISP data caps. Idk when Comcast slipped it into my contract and I didn't figure it out until I tried to re-download my entire Steam library to my server. I've been meaning to set this up and I always have better success following your content, thanks for this one
Sounds like you need a better ISP and ISP plan. It's 2022, no time for data limits.
@@shootinputin6332 This is america, you don't get choice beyond maybe 2 (cable and telephone) so at best he might have AT&T.....there is a reason why cable companies have the worst ratings in the country...
I would not have been able to run Unraid without your tutorials, Ed. Great work. I am very pleased with Unraid and how it developes. The Community is also great. One wish though is a paid Support Service. Some times I get stuck in a problem that I can´t solve or find answers to in the Communty pages. Then a paid Support Service would be good solution.
I have no idea how I missed your tour video and the change in format, but I really really like it and I'm glad you are back. Now I need to catch up on your vids.
Great video! I have been trying to get a lancache going for a long time ! Thanks a lot for this
At 33:20, your writes are continuing even though you paused the download. And when you resume the download in steam, it speeds up briefly. To me, this indicates that it is technically downloading from the lancache, but the lancache is simultaneously downloading the file from the internet. When you pause the download in steam, you're basically letting the download buffer. You unpause, you get all that buffered data, then it slows back down as your download is waiting for the lancache to download.
But if the data is already in the cache server then why would the cache server be downloading it from the internet?
Another quality video! Thanks very much! Was missing host override in my setup.
I was originally using the lancache-bundle. Didn't realize this newer video was posted, so I dropped lancache-bundle and have everything setup per this video. I need to get you another beer!
When spaceinvader posts a video, you know the day is gonna be good !
Finally, I can always rely on Spaceinvader1. I could not get prefill console commands to work but that is not a big deal. Many thanks!
Excellent tutorial! Thank you very much. You make UnRAID approachable and fun for novices like me. 😁
Thanks for the great information as always.
Now I have pi-hole and lancache working perfect.
Love your work! Your videos really helped upgrade my home setup.
Hey man, it's so common to have a hosted Pihole or Adguard DNS instance, that it would be super helpful to have an all-in-one tutorial in how to integrate a LAN cache DNS with Pihole, etc. Still trying to figure out how to make that work. Anyhow, great vid and thanks for all the work you do.
*EDIT: Oh, I see you can change local files in Windows to point Steam to a specific DNS!
You're one of the best channels that does this sort of stuff. I had to unfollow you so I could follow you again, so it felt like I followed you twice. Best of luck to you with all of this man keep up the good work.
Nice to see u, never change ur style!
Good video as always Ed! Thanks for sharing it with us! and Merry Christmas!🎄🎁 Jp
A side by side screen cap of both the steam window and the unraid ssd information, this shows the lan cache doing its job by seeing the data usage going up as the game downloads.
Separate informative videos would be helpful with regards to DNS, Resolving names, LAN settings with unraid.
Powershell is something you should move to using when making videos for us, it's a level up for promts..
Great work, really well done. Thank you for the effort.
I had a totally different face in my head. Fun to see the reveal!
Very good video as always and great effects with the cool new studio!
He did a face reval more than a couple videos before, it just isn't titled as such, and I can't remember which.
As I said then, he has the voice of an angel and the look of a Hell's Angels biker.
Good to see the face behind the voice!!! Keep these videos coming!
I'd highly recommend setting up secondary/fallback dns for your DHCP to your router or pihole etc. That way you don't lose internet if the VM/container goes down.
I like your new Presentationconcept, you got a really nice Setup an it matches you. :)
Loving the new look!
i hate it when i go to log into the game and there update i got wait for net speeds, reading from you server and have it down load games seems a lot better and you just get it off the servers when need be sounds so much better. keep up the good work
Great tutorial Ed!
Hey, u look a lot younger than u sound. Gr8 vids. Many thx for your tute's. Got a pretty respectable setup now. All the best 2 u m8!
Great Video! I like the Video effects 🎉
Woah, you dont look how i pictured! Thanks again for the videos
I would fly across the US to hang out with this man. Helped me sosososososoSO much in my UNraid journey. A Continent is a bit too far for me though, :D
The Legend of the Unraid has a face! All Hail Ed! Excellent tutorials as always :) Thank you for all you do!
I'm too early for 1080p. Super hyped for this :D
So much useful information!! Thanx.
I like the new Style of this Video. 🙂
This is great! works perfectly!
There’s another reason for single computer users.
I don’t get much time to game, however I do have a dedicated gaming machine which only ever gets turned on when I want to game.
When I do game I don’t want to be sitting there waiting for yet another monster multi Gb update which still takes a long time even on a decent broadband connection.
So I build a cache drive basic AND created a basic VM which won’t be used for gaming but used as a “game update monitor” it will run steam in the background and download updates as they come up.
This means that when I get a chance to game, I can boot my game PC and it will download in mere minutes rather than hours.
Absolutely my use case... Great tutorial
Great to see a face to the voice!
Excellent tutorial, I use PiHole and Unbound for my DNS and didn't want to have to add an extra step in DNS resolving, great to find out I can override things in pfsense.
One quick question if you happen to see this comment. My pfsense is a VM on my Unraid with 2 physical gigabit ports, one for WAN and one for Lan and my Pihole is a docker on the Unraid. Does traffic for between pfsense and PiHole travel out via the physical port and back into the the unraid machine or does it communicate internally? I'm assuming it travels out, if so how can I adjust things so that traffic moves internally.
I was just going to complain that this will disrupt using Pi-Hole as your home DNS server when you came to the part about DNS resolver solving that issue. Thanks!
Nice video. Nice to see your face spaceinvader!
it's kind of confusing for me in every video, i always imagined to your voice an english banker in a suit.... for years... i dont know why xD
thank you for all your content, where would our unraids be without you :D
Additionally you can use pihole as dns and just populate dns files to pihole .
How does it manage game updates? if the version in the steam server is newer than the one on the lancache? does the steam client then think its a different game and doesnt use the cache and goes off to the internet?
Is there a lan-cache for PS-games?
BTW happy to see a video from you again.
Yes Sony is supported.
For pfsense DNS resolver do I need to make a new host overwrite for each CDN I want to add or do I add "additional names for this host"? I'm looking to do Windows, Blizzard, and Steam
@Spaceinvader One, for some reason i cant get the dns to take over the request for steam etc. Every time i do a ping or lookup it uses the standart ip even tho the dns is connected.
I also can use lancache prefill without any problems.
Do you have any idea what to try out for a fix?
Thank you very much!! I'll try to set this up right now. I wonder how to make a prefill of ubisoft games work, it seems there is no option to enable ubisoft in the prefill container settings...
Your editing reminds me of 90s or early 2000s editing.
Depending on how fast you need it to download, you don't need an SSD. I actually used a WD black and it was more than fast enough for this purpose and it was perfect.
What I did was I created a cache pool with only the WD black and then I created a share that only used the cache pool. You just don't want to use the array since it's slow but a dedicated drive is still way faster than the array, and the WD black is way faster than any drive on my array. It was doing 250 MB/s. It's still slow compared to an SSD but more than fast enough to saturate a gigabit connection. It may even be fast enough for 2.5 gigabit connections.
One question I have is how would you set up the DNS for the LanCache while using something like PiHole in conjunction? Or would it be something like the dns override?
+1 for this. Running adguard at the moment, but would love to have this too!
The issue I'm having is that port 53 is in use and cannot be used with lanchache-dns. Not sure what to do about that.
Once you have a bunch of games downloaded in lancache, how do you go about finding and deleting the ones you don't need anymore if you need to make room for other games? Thanks.
Does it also cache updates of games and steam app?
Also is there a way to limit the max size of the cache?
Does the gamedata still updated (patches etc.) when its in the lan cache?
Hi, would it be possible to limit the network bandwidth of the prefill docker?
We are using a 10gb nic for the lacache . When we have lots of users hitting the cache the ping on our game servers go up even trough our cpu and ram usage is low . Is there anyway to dedicate a network card to an individual docker/lancache and separate the traffic ??
So, how would I configure things if I also have pihole running?
At 4:56 your Main tab shows a ZFS Master pool with buttons to "Show Datasets", "Scrub Pool", "Export Pool", "Create Dataset". This is a community app "ZFS Master" Beta from Iker's Repository. Is this stable for critical data? Should we create the pool with terminal commands, export it, and this app can import, display and manage the pool? PLEASE let us know your experience and procedure with this app.
Question, what if you are using adguard home or pi-hole on your network? How would you go about using both that and the lancache dns?
By using the host file option
Thanks a ton for the incredibly tutorial. I was able to get everything up and running and prefill worked perfectly until I restarted prefill and now it won't let me log in properly. Is there an easy way to start from scratch on prefill tried uninstalling it then reinstalling it but still has the same issue.
Danke!
Is there a similar tool to DNS override on Unifi?
How do you view which games are cached? How can you clean up cache by removing games?
Awesome video as always. Since lancache bundle isn't working anymore, i was looking for an alternative. However, i'm missing 1 key feature.... how can i tell lancache DNS what the forward DNS ip is? Because i like having it route everything through pihole.
Just a fyi, for anyone looking for this specific information: Adding a custom parameter for the UPSTREAM_DNS will solve this issue.
I have been waiting for this how-to, just one question though, could you use pi-hole as the dns for lan cache? I do believe that you can add local dns resolves on pi-hole, so it should be doable. I haven't tried to mess too much with either, so maybe that could be a quick part 2? Other than that, great video :)
simply put your lancache dns ip into your custom dns server on pihole. so you can route it from pihole to lancache and then put a field in the main lancache container on unraid. that is a variable setting and has "Container Variable: UPSTREAM_DNS" as the name and add in another dns which can be anything ex: google, cloud flare and should work from there
What if I want to use a PiHole as well? Is this possible?
Does lancache work with PlayStation? Also can I point lancache to go through my DNS server ie Technitium DNS?
ED, would a group of RAID 0 HDDs give the same performance as an SSD but with the storage size HDDs?
No, ssds are much better at handling small random files. That’s where hdds fall on their face. Raid 0 will help a little but it’s not the same.
Personally I run it off a small low power system with super slow 2.5” drives and it’s still faster than my 300/300 internet but not by a lot. It also takes a few minutes to get up to speed. Also, keep in mind if you have multiple people reading from it at the same time, it will dramatically slow down.
YESSSSS!
Great video as always. Ran this and it downloads only 1 game successfully. for the rest in the queue throws the following error "Manifest request timed out for depot {gamename}- {id}. Retrying... Downloads the next one in the queue if i wait for rest of the failures and run the commands again.
Hey, thank you really much without your help it would be impossible to run unraid as good as it is with your tutorials. But unfortunately I am struggling hard with Epic Lanchache i tried serverl reinstallation but didnt got it work as it should be.
My Problem is that everytime i try to download something over EpicGames the first few gigs working fine with a fully gigabit but then it stops to zero and says it has problems to reach the network. I run into several forums but didnt find any solution which fits in my case, because SteamCache is working very fine. So maybe you or the community could help me by my problem.
Will this work for 3 separate steam accounts that use the same games on the same LAN?
Also, can I still use my pihole dns and this at the same time?
Yes
when starting the caching i get : Unexpected download error : Unable to get available CDN servers from Steam! Skipping app.... it does this for all games. any ideas?
Hi, prefill dev here. I recently put up a new version two days ago that should hopefully fix this. Give the latest a version a shot and let me know if it helps
Will be building my new server within the next few weeks, waiting for some parts to arrive.
I really hope Unraid works this time, as currently using Truenas and I do not like it at all.
This is something I will be looking to setup, if Unraid works.
Why didn't it work the last time? Can recommend the different Discord servers for OS and services. Lots of friendly people there to help you out if you have problems
@ It worked but it crashed every 2 to 4 days, which then meant a parity check and then it would crash again within a day or two of it completing.
I tried it on 2 systems, the Dell R720 and then a custom AMD PC.
I will be trying it on the server that I am building once everything turns up, and see how it goes because when it did work it was awesome.
@ Should add, I tried a couple of different pen drives without anything like plex etc installed just the fresh unraid install and they all crashed as well. Truenas and Windows both ran and are running without issue.
@@techo2k9 I do not understand why that would mean that the parity check was the culprit?
There could be so many reasons. The system log file should give you some answers. Or if not, try the Discord servers.
@ Sorry I think you there is a mis-understanding, I am not saying the Parity was the cause, I am saying that it would take a day to complete the "Parity Check" then it would crash a day or two after that.
If I have issues with the new server then I will try the Discord servers and see if it can be figured out.
can't i blacklist or whitelist certain games?
Does anybody know what DNS server is hit after it goes through lanchace DNS docker?
I know is hitting the lancache server but if it is for something that isn't in steam my lancachedns doesn't have that data so were is it pulling it from? I would like if it hitted opndns servers after a no resolve form lancache DNS.
this video is fantastic I was able to set it up and is running flawlessly, I thank you so much for your quality content video after video!!!
what happens if your running Pi-hole as your DNS ? I have that dns on my router, will that effect having 2 different dns?
I read on reddit that you have to setup both DNS server "in line", one is the downstream of the other.
So the DNS request hit the lancache DNS, then (if not resolved) it's passed to pihole.
You can add an upstream DNS to the lancache container, point it at your pihole
possible reason for slow transfer with god of war is the number of small files. Small files will slow down rates. larger files will always download and transfer faster due to compression and ssd and hard drive read rates, as opposed to read and seek which will cause a bottle neck
Every time I enter my Steam password in the prefill the connection times out. Does anybody have any tips on how to get past that?
Why can’t you just put a second dns in your router to fall back to? Does that stop it from working right?
That's not how DNS works; adding a second dns just gives devices a choice between the two. No priority is given to the first DNS over the second DNS
how much lan could a lan cache cache is a lan cache could cache cache
Installed on unRAID, lancache-prefill is asking for a password when su $USER, thoughts?
Same here. It might be due to container going into sleep mode. Logs:
---Checking if UID: 99 matches user---
---Checking if GID: 100 matches user---
---Setting umask to 000---
---Checking for optional scripts---
---No optional script found, continuing---
---Starting cron---
---Taking ownership of data...---
---Starting...---
---SteamPrefill enabled!---
---SteamPrefill not found, downloading and installing, please wait!---
-----Something went wrong while getting the latest version!-----
---Please try again later, putting container into sleep mode!---
Anybody experienced this and knows the solution?
Thanks!
dude i want that background the one at 0:48
Did you notice when you hit that 18GB RAM limit, the God of War download speed tanked?
how can prefill epic games
Tried that out, it works on steam but not on epic... very strange
Hallo Spaceinvader One würde gerne deine Videos in Deutsch mir anschauen gibt es da eine Möglichkeit?
Deine Videos sind der Hammer da ich neu bin was Unraid betrifft wäre deutsch super!
LG Frank
so THATS what you look like.
wow... I imagined much more grey
If you're privacy / security conscious I'd suggest hiding your SSIDs as it's possible to geolocate someone with reasonable accuracy using the info in your video
19 minutes ago??
A lot of the sony studios games have this very issue dont know the reason its just silly!
not everyone has unraid
can someone help me? this is very confusing to someone that has never programed anything or run any command lines or networking. All these instructions are assuming everyone knows the basics and start ahead of an average NOOB. I have a mechanical engineering degree and build aircraft for a living and I love to learn but dang. People in the computer science world that code and sit in front of a computer all day, really suck at techical writing instructions and giving examples for people to follow that are new to expereiced levels. I write work instruction all the time that direct people from 0 level expereince to 40 years on how to install and build structures on a plane or repair issues. My CAD and engineering Drawings are crearted the same way.
With my little rant out of the way lol
WTH does when using the prefill container we need to use the DNS and the lan cache conatiner at 25:59 point. You only type the dns IP conatiner and mention the Lan cache conatiner but never input that info or show how to do it. The way you say it, makes it sound like the IP for the lan cache container needs to be added with the DNS one., is that correct?
I have pulled all info from all sources and there is so much conflicting instructions trying to set this up, from the Github, Wiki, youtube, Reddit, unraid and the lan cache website. This is ridiculus lol I feel like I need help and use my Lean Six Sigma skills to help the community with their techincal instruction skills and quailty of instructions smh lol
Wow a face. I honestly thought you must be some old guy in a dark room avoiding his wife. Not true!
A better way to test if the lancache is getting hit correctly is opening a terminal in the monilithic docker and executing this command:
"tail -f /data/logs/access.log | grep "MISS""
To see access that didnt hit the lancache and got forwarded to the internet. Otherwise only execute the tail command without grep and you can see all the traffic that hits or misses the lancache