You know, I have the highest respect for how you create your videos. You have this ability to make something like explaining command-line entries a fun exercise to watch. Brilliant, educational and entertaining in one go. Respect!
Chuck, really, I learn with your videos more that I do by paying a complete course with a boring teacher. You really bring so much value for all of us who whach your videos. Thank you!
Your videos are amazing! Not only does it show how powerful computing is but how easy it is to get started from beginner and up, thanks alot Chuck! Very Professionally Made Videos
studying for my a+ passed 1001 and now on the 1002, im recognizing about 90% of these commands, its nice to watch your videos in a semi fluent language! thanks for all your content chuck, you have inspired me to begin my IT path :)
Hey Chuck, I have been watching your video for the past 8months now and have learned a lot. Everything that I learned from you landed me a job as a Systems Engineer and now I am teaching/helping my younger brother get into tech as well. Please continue with the great content.
Another simple way to create nested directories is with ranges. For example: mkdir -p \ shelf{0..9}/book{0..9}/page{0..9}/letter{0..9} Then you get a path like this shelf0/book1/page2/letter3/ And about 10000 directories 😉
This is also a good example why scripting or learning cli commands should always be done in bash. Because when I enter your command in fish I get this: └── shelf{0..9} └── book{0..9} └── page{0..9} └── letter{0..9} 4 directories, 0 files My advise to new linux users: Don't use fancy terminals like fish when you learn basic commands. Stay in bash for that.
NetworkChuck, you need to win the TH-camr of the Year Award, RIGHT NOW! Man, even though I'm not in the networking or hacking industry, I just can't skip a video published by you.
Directory vs Folder, unix and dos predate Windows with directory as both of them go way back and have the mkdir command. I think "Folder" might have originated with the Mac. AmigaDOS and GUI had an even worse "Drawers". Can't we all just go with an already set standard terminology of "directory"???
I think you are correct that Macintosh was the first to use "folder" syntax which was then adopted by Windows 3.x. I can't remember what Windows 1.0 and 2.0 had but I want to say they still used "directories."
I love this series. I have my own Linux machine, but I’m kind of curious if fenrear, a terminal screen reader, would work with Hack The Box. Thank you for saying out loud what you’re doing and what you’re typing, very descriptive for anyone with visual impairments and people in general.
Try these for multiple directory and file creations: mkdir dirs{0001..9999} touch files{0001..9999} BTW in bash it's called "Brace expansion" and can some funky stuff with it. Look it up!
Good to have ya back makin video's. As soon as you used the first "rm" command I was asking myself if you were gonna meme it or not. You did and I'm happy you did. Thanks for the learning experience, and for meme'ing it up. sudo rm -rf /
It's more of a DE/CLI difference. When in a DE, most operating systems are going to refer to directories as "Folders." When in their respective CLI, they will be referred to as "Directories." (Edit: for clarification, DE stands for Desktop Environment and CLI stands for Command-Line Interface)
directory became "folder" when windows 95 first came out (in the dos days it was directory) that is when they came out with the windows file explorer which displayed directories as folders... although apple did this same thing WAY BEFORE Microsoft ever did remember dos command to list contents of a "directory" is "dir" (dirp, dirp) but in the linux world which has always been command line first (insert political statement here), it has always been "directory"
You may think from Chucks joking, but this is a truly an eye opening learning experience. It proves that ms is just a data miner, not a software developer. This is how you show the true capabilities of good programming; by maxing things out to the limit, showing us how much are machines are truly capable of.
Great content as always. Before Linus existed and when databases were prohibitively expensive I wrote a complete job control system in the first port of AT&T Unix to i386 using directory names as primary keys and the best we had at the time for forms on terminals. The file system was a pretty good database. We used that thing for years.
I usually skip the sponsor segments, but that learning how hack service is pretty cool. (NSA or FBI if you're listening, learning how to hack so you can defend against it).
Before watching the scene in 17:51 , I was literally thinking about the special *remove* command that I watched in one of your old video and then you mentioned that! 😁
when I was first learning, I re-dated all the files with touch, then when trying to fix it, I created enough files with touch to completely fill the hard drive. learning is fun!
I think you should add at the beginning for beginners to type alias and find out if there are any default aliases setup for commands you’re using, because it’s normal or has been normal that they are setup.
Great video! I started watching your content during the pandemic and it really motivated me.. I've since enrolled in my local community College and acquired an associates in computer science, and have no plans to stop there. Big thanks!
@tradde11 Actually there's a historical reason why Microsoft used "\". The first MS-DOS versions did not yet support directories. But "/" was already used by IBM as a "switch'" to run a program with an option to change the behavior of the program. For example: a sorting program might list names from a-z but using a switch the program reversed the order of the list. The word "switch" dates back to an actual switch on a computer in the 70ies. An operator (a real person) could load a program and (optionally) flip a switch to change the behavior of that program. Back then computers did not have computer screens. Everything was outputted to a printer. Most of the physical actions (like flipping a switch, loading a program) were done by a person: the operator. But soon lot of these physical actions were taken over by software: the 'operating system'. (the operator was replaced by the operating system) So when MS-DOS finally supported directories they could not use "/" as that was already being used as a program switch. So they chose "\".
@@Shirtysneez Yes, it's IBM's fault. They could have just used "-" to pass parameters if they had been interested in being compatible with the Unix world.
About to watch a networkchuck video and realized i could not.. I was NOT prepared... I rapidly hit space bar to pause the video sprang from the couch and rushed to the coffee machine.. I'll play your video when i get back With my coffee... (actually because you came up in my cue shortly after i finished breakfast but i thought it was amusing cant watch network chuck without coffee)
They are technically called "directories" in windows too. The use of "folder" in a colloquial term that showed up after GUIs became common, as an easier to understand concept for people that are less tech literate. The two can mostly be used interchangeably. In both windows and linux almost everything API or CLI uses "directory" and user facing GUI will use the word "folder" when needed.
UNIX called them directories from the very beginning back in the 60's, so it was Microsoft that had to be different. Interestingly, back in the DOS days, they were called directories.
I love your videos! I don't think anyone else makes tutorials that are as detailed and exciting as yours. You're the reason I decided to build a homelab. Thank you for continuing to make great content!
I'm in love with your videos and Linux series. This is the best possible way to explain how this sucker works! Please make a video about Linux machine common troubleshooting. Like check what's happening with cpu/ram/memory, how to see what's wrong with database on a server or website if it's hosted on a linux machine.
Hello I am talking through the inspector element 😂😂I know something very minimal, what I want to say is. Thank you for these videos that you have made and all these wonderful tips, I have the attention span of a rubber band I draw to another video but then spring back trying to gain more information and then draw to another video but then come back learning more, yet your videos I stay and gather a lot of information and I love it. THANK YOU again
8:25 Actually, you can just use the command "mv file.txt coolstuff". If there is an existing directory called coolstuff in the current directory, the file will be put into that directory. If coolstuff doesn't exist, the file will be renamed to coolstuff in the current directory.
If you are back up files with cp command, use -p option to preserve time related metadata. It's really useful to see when it has actually modified last time, and not the time when it's been backed up.
mv stuff.txt folder , no need for ./folder. And make many folders mkdir folder{1..1000} makes folder1,folder2 to folder1000. So just repeat or pick big number.
another tip to make it easier to distinguish directories/files (even types of files) in a terminal. 1. install an app called exa 2. make an alias using [ alias ls=exa --icons' ] and save it in your terminal script (~/.bashrc if you are using bash) type ls now and see how it looks now with new fancy icons right next to the file names
This video is --F# AMAZING .!!! I am gonna PIN it and WALLPAPER it !!!!! COPY it and PASTE it in multiple DIRECTORIES on my TREE!!! THANK YOU, NETWORKCHUCK!!!
A million directories on a Linux filesystem is irrelevant. Depends on the actual file system, but _any_ genuine UNIX or Linux FS wouldn't care. However, utilities like tree, and probably ls, will simply not work ... for example: ext4 does not limit the number of subdirectories in a single directory, except by the inherent size limit of the directory itself. (In ext3 a directory can have at most 32,000 subdirectories.) To allow for larger directories and continued performance, ext4 in Linux 2.6.23 and later turns on HTree indices (a specialized version of a B-tree) by default, which allows directories up to approximately 10-12 million entries to be stored in the 2-level HTree index and 2 GB directory size limit for 4 KiB block size, depending on the filename length. In Linux 4.12 and later the _largedir_ feature enabled a 3-level HTree and directory sizes over 2 GB, allowing approximately 6 billion entries in a single directory.
Having seen directories with hundreds of thousands of files in them (no... really... God I had biologists sometimes) this is both a blessing and a curse. A blessing because when those people created all of those little files (seriously, why do you need thousands upon thousands of little 4k files?) it did not crash the system, but also a curse because it let them create that many in the first place without saying "Nope... sorry... you have reached your limit... learn how to program better so that you aren't using the filesystem like a database!"
@@jonakers704 Argh the curse of the bioinfomatics people. I have seen that myself. What we do to "avoid" the problem on our HPC system in the first place is put a quota on the number of files they can have. I think we are at about 100 millions files on the file system now, but no individual user can have more than one million. Actually the hard quota is two million, with a 30 day grace period, but the soft quota is one million. Actually they can but they firstly have to ask and secondly there is a charge. Only a handful of people have ever asked and nobody has gone ahead when the issue of the cost was raised. Prior to the introduction of quotas on files we had one user with 17 million files. We are using GPFS and with the right setup a search of one billion files will take under an hour, ~15 minutes springs to mind.
@@jonathanbuzzard1376 We are using lustre for our HPC system, sitting on around seven PB of storage. Users have to purchase their storage allotment on the system, so they get to do with it as they wish. We have had to take an "education of the user" approach for huge numbers of files in order to combat the problem, as we are not able to utilize quotas on the number of files due to our favorite 8th OSI layer... politics.
@@jonakers704 well thankfully we are no longer using the pit of some that is Lustre and are on GPFS, but that is a different story. However the point is that in addition to cost for capacity, every file has a cost too. So a single file 1MB in size is cheaper to store than a thousand files 1KB in size. You are burning through those expensive flash disks for metadata rather than cheap large capacity spinners. You are also filling up the TSM database which is also on expensive flash. All we do is put a reasonable default limit on both capacity and number of files. Above this you have to pay and I have this costed out for both capacity and files. If a user wants to store 10 million files that is absolutely possible they just have to pay the full economic cost of doing so, and they baulk at the cost in my experience. Basically it means they have to have a discussion with use *before* they store millions of files which gives us the opportunity to educate them.
DOS had directories, too. So it was definitely Windows being different calling them folders (copying Mac, really) All the dos commands, powershell commands and windows api commands still call them directories, too. Only folders in explorer
I recently found your Channel and I really like it, and this is the first series i finished. And i have to say: the information you present is really dense, this is awesome. And you are so high energy. Its awesome but also tiring. Maybe like a safeguard to not watch too many videos all at once so you learn better. Nevertheless: Awesome Work.
Nice video. You could run: mkdir dir{1..1000000} and that would also do it. You could then run top and or htop in another window/terminal to watch how that effects the machine.
Old Unix guy: ls -F (types without long format) and maybe in the case of directories with lots of stuff, ls -f (no sort, a time saver in cases of large number of things to sort).
Access your FREE Linux lab here: ntck.co/htbacad (HTB Academy) Have you ever wanted to destroy Linux or even create more directories than you could imagine? Well in this video, NetworkChuck shows you how to break your linux box as well as how to create a million directories!! He also shows you some helpful commands too…. But we know why you’re here. Checkout HTB: -HTB: ntck.co/htb -HTB Academy: ntck.co/htbacad 🔥🔥Join the NetworkChuck Academy!: ntck.co/NCAcademy **Sponsored by Hack The Box 0:00 ⏩ Intro 0:57 ⏩ Get your free Linux lab! 2:10 ⏩ Let’s get to our happy place! 2:22 ⏩ Time to touch some files 3:30 ⏩ a new way to use cat? 4:43 ⏩ echo “How to use echo to create a file with text inside” - Thistimestamp.txt 5:49 ⏩ Now let’s make some folders… I mean directories 7:36 ⏩ Time to mv some stuff 10:53 ⏩ You can’t cp this! 12:36 ⏩ How to make a million directories! 15:38 ⏩ Ready to destroy some stuff? 20:05 ⏩ Time to really make a million directories! 21:51 ⏩ Outro
Sir chuck! I created 1M a week ago in Linux and in windows. I m happy to be r student and that u also thought like me to create folders. code:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: in Linux { mkdir c cd c /home/me/./folders.sh } it will reopen the script after the process is done code:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: in Windows { :x mkdir %random%%random%%random%%random% goto x } code:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: in windows, it was pretty simple cause I defined the function x & call it back after the work is done, like a loop. Btw it's so slow.
@Not Convinced It's free for everybody to learn this, but how you want to use the knowledge is totally your thing. There are also lots of people learning ethical hacking to find bugs for companys before they get attacked
Hello guys, I was not paying attention and during the installation of Windows 10, instead of formatting the C drive, I deleted it, and now I don't know what to do, please help me.
Hey Chuck, please continue your bash script series.
Yess
@@testme8105 yes
Also .py
+1
+1
You know, I have the highest respect for how you create your videos. You have this ability to make something like explaining command-line entries a fun exercise to watch. Brilliant, educational and entertaining in one go. Respect!
Temon
Chuck, really, I learn with your videos more that I do by paying a complete course with a boring teacher. You really bring so much value for all of us who whach your videos. Thank you!
Me too👍 Chuck is a working CPU.
frfr
Your videos are amazing! Not only does it show how powerful computing is but how easy it is to get started from beginner and up, thanks alot Chuck! Very Professionally Made Videos
studying for my a+ passed 1001 and now on the 1002, im recognizing about 90% of these commands, its nice to watch your videos in a semi fluent language! thanks for all your content chuck, you have inspired me to begin my IT path :)
Hey Chuck, I have been watching your video for the past 8months now and have learned a lot. Everything that I learned from you landed me a job as a Systems Engineer and now I am teaching/helping my younger brother get into tech as well. Please continue with the great content.
Another simple way to create nested directories is with ranges.
For example:
mkdir -p \
shelf{0..9}/book{0..9}/page{0..9}/letter{0..9}
Then you get a path like this
shelf0/book1/page2/letter3/
And about 10000 directories 😉
library of babel?
This is also a good example why scripting or learning cli commands should always be done in bash. Because when I enter your command in fish I get this:
└── shelf{0..9}
└── book{0..9}
└── page{0..9}
└── letter{0..9}
4 directories, 0 files
My advise to new linux users: Don't use fancy terminals like fish when you learn basic commands. Stay in bash for that.
NetworkChuck, you need to win the TH-camr of the Year Award, RIGHT NOW! Man, even though I'm not in the networking or hacking industry, I just can't skip a video published by you.
Linux: yea sure create a million directories whatever
Windows: noooooo you can't call a folder CON thats illegal >:((
Dies in wisdoms*
This video has lots of stuff inside it! 👍
Finnally you remember that you have a Linux series
I almost forgot!
Directory vs Folder, unix and dos predate Windows with directory as both of them go way back and have the mkdir command. I think "Folder" might have originated with the Mac. AmigaDOS and GUI had an even worse "Drawers". Can't we all just go with an already set standard terminology of "directory"???
I think you are correct that Macintosh was the first to use "folder" syntax which was then adopted by Windows 3.x. I can't remember what Windows 1.0 and 2.0 had but I want to say they still used "directories."
I love this series. I have my own Linux machine, but I’m kind of curious if fenrear, a terminal screen reader, would work with Hack The Box. Thank you for saying out loud what you’re doing and what you’re typing, very descriptive for anyone with visual impairments and people in general.
Try these for multiple directory and file creations:
mkdir dirs{0001..9999}
touch files{0001..9999}
BTW in bash it's called "Brace expansion" and can some funky stuff with it. Look it up!
Thanks Chuck. I am so grateful I found you
Good to have ya back makin video's. As soon as you used the first "rm" command I was asking myself if you were gonna meme it or not. You did and I'm happy you did. Thanks for the learning experience, and for meme'ing it up.
sudo rm -rf /
Fun fact: windows calls them folders, but in cmd is using mkdir as well to create folders
It's more of a DE/CLI difference. When in a DE, most operating systems are going to refer to directories as "Folders." When in their respective CLI, they will be referred to as "Directories." (Edit: for clarification, DE stands for Desktop Environment and CLI stands for Command-Line Interface)
Glad you're back, Chuck! Hope your time off was relaxing, we don't want you to burn out!
directory became "folder" when windows 95 first came out (in the dos days it was directory)
that is when they came out with the windows file explorer which displayed directories as folders...
although apple did this same thing WAY BEFORE Microsoft ever did
remember dos command to list contents of a "directory" is "dir" (dirp, dirp)
but in the linux world which has always been command line first (insert political statement here), it has always been "directory"
Folders is a gui related term while
Directory is a tty/command line related term. They mean the same thing from different perspectives.
Thanks Man, I am really deeply grateful to you 🙏🏻!
You changed my way to deal with my iMac , not only The Terminal, All Respect 🙏🏻!!
Dude literally the LITTLE things, like clearing your terminal with control+L...... this man is valid, certified goat even
You may think from Chucks joking, but this is a truly an eye opening learning experience.
It proves that ms is just a data miner, not a software developer.
This is how you show the true capabilities of good programming; by maxing things out to the limit, showing us how much are machines are truly capable of.
Great content as always. Before Linus existed and when databases were prohibitively expensive I wrote a complete job control system in the first port of AT&T Unix to i386 using directory names as primary keys and the best we had at the time for forms on terminals. The file system was a pretty good database. We used that thing for years.
I love hearing about creative uses of technology. We work with what we have!
I usually skip the sponsor segments, but that learning how hack service is pretty cool. (NSA or FBI if you're listening, learning how to hack so you can defend against it).
Big thank u NetworkChuck !
Before watching the scene in 17:51 , I was literally thinking about the special *remove* command that I watched in one of your old video and then you mentioned that! 😁
I found this video interesting and fun. Thanks Chuck!
when I was first learning, I re-dated all the files with touch, then when trying to fix it, I created enough files with touch to completely fill the hard drive. learning is fun!
I think you should add at the beginning for beginners to type alias and find out if there are any default aliases setup for commands you’re using, because it’s normal or has been normal that they are setup.
Great video! I started watching your content during the pandemic and it really motivated me.. I've since enrolled in my local community College and acquired an associates in computer science, and have no plans to stop there. Big thanks!
It's totally Windows that renamed directories to folders. Don't believe me? Remember MS-DOS? MKDIR, DIR, RMDIR, etc?
Wait I never thought about it that way ... I just typed mkdir like I do in Linux and moved on
@tradde11 Actually there's a historical reason why Microsoft used "\". The first MS-DOS versions did not yet support directories. But "/" was already used by IBM as a "switch'" to run a program with an option to change the behavior of the program. For example: a sorting program might list names from a-z but using a switch the program reversed the order of the list.
The word "switch" dates back to an actual switch on a computer in the 70ies. An operator (a real person) could load a program and (optionally) flip a switch to change the behavior of that program.
Back then computers did not have computer screens. Everything was outputted to a printer.
Most of the physical actions (like flipping a switch, loading a program) were done by a person: the operator. But soon lot of these physical actions were taken over by software: the 'operating system'. (the operator was replaced by the operating system)
So when MS-DOS finally supported directories they could not use "/" as that was already being used as a program switch. So they chose "\".
@@Shirtysneez Yes, it's IBM's fault. They could have just used "-" to pass parameters if they had been interested in being compatible with the Unix world.
@tradde11it's fucking disgusting and they can't keep getting away with it
Super Video Chuck Your videos are awesome And informative 😊
Thank you!
About to watch a networkchuck video and realized i could not..
I was NOT prepared...
I rapidly hit space bar to pause the video sprang from the couch and rushed to the coffee machine..
I'll play your video when i get back
With my coffee...
(actually because you came up in my cue shortly after i finished breakfast but i thought it was amusing cant watch network chuck without coffee)
first video of NetworkChuck where i really learnt something (actually only something, but still something ), nice tutorial
The folder crap became popular with Windows 95. Before that folders were directories. Even in GUIs where they were folders.
13:22 pretty sure DJ Khaleds directory looks like this
Not only he creates cool directories but he's also cool at teaching. Thank you for the amazing stuff you teach!
They are technically called "directories" in windows too. The use of "folder" in a colloquial term that showed up after GUIs became common, as an easier to understand concept for people that are less tech literate.
The two can mostly be used interchangeably. In both windows and linux almost everything API or CLI uses "directory" and user facing GUI will use the word "folder" when needed.
Thanks, chuck! I just finished all your Linux for Hackers playlists.
UNIX called them directories from the very beginning back in the 60's, so it was Microsoft that had to be different. Interestingly, back in the DOS days, they were called directories.
Seeing your face always make me to pause and see what you've got to say. 😀Thanks for all you do.
windows also call Directories es in Unix, people started to call it folders after windows got a GUI
I love your videos! I don't think anyone else makes tutorials that are as detailed and exciting as yours. You're the reason I decided to build a homelab. Thank you for continuing to make great content!
Loving your channel and energy you keep bring over the years!
I'm in love with your videos and Linux series. This is the best possible way to explain how this sucker works!
Please make a video about Linux machine common troubleshooting. Like check what's happening with cpu/ram/memory, how to see what's wrong with database on a server or website if it's hosted on a linux machine.
That was a wild ride. It was a good review. Didn't know about the cloud Linux Lab systems, that seems pretty cool to me too!
Hello I am talking through the inspector element 😂😂I know something very minimal, what I want to say is. Thank you for these videos that you have made and all these wonderful tips, I have the attention span of a rubber band I draw to another video but then spring back trying to gain more information and then draw to another video but then come back learning more, yet your videos I stay and gather a lot of information and I love it. THANK YOU again
Love the Tree command! I've been using Linux for years and hadn't found this one... Yes to learning new things!
8:25 Actually, you can just use the command "mv file.txt coolstuff". If there is an existing directory called coolstuff in the current directory, the file will be put into that directory. If coolstuff doesn't exist, the file will be renamed to coolstuff in the current directory.
Nice videostuff man that bash command was awesome!
If you are back up files with cp command, use -p option to preserve time related metadata. It's really useful to see when it has actually modified last time, and not the time when it's been backed up.
Very cool vlog Chuck! Your vlogs are always informative and educational too! Keep them coming!
new to linux.. cured my anxiety with this playlist.. thank you
This series needs more videos !! great content!!
You can change the color pallet of the terminal to match your visibility ability.
Interesting ! Can't wait to test it out in my own hardware, ethically of course!
Im 12 I can't drink coffee but I'm drinking a tea watching the best youtuber 😅
You are just .. "coffee break" .. just perfect :)
mv stuff.txt folder , no need for ./folder.
And make many folders mkdir folder{1..1000} makes folder1,folder2 to folder1000. So just repeat or pick big number.
another tip to make it easier to distinguish directories/files (even types of files) in a terminal.
1. install an app called exa
2. make an alias using [ alias ls=exa --icons' ] and save it in your terminal script (~/.bashrc if you are using bash)
type ls now and see how it looks now with new fancy icons right next to the file names
What shitty distro are you using that does not change the colour of the directories over normal files?
@@jonathanbuzzard1376 i think its because chuck is color blind. i think he just wanted to share a tip.
Thanks Chuck, you have made my move over to Linux from years of using windows so easy and simple... your teaching style fits so well with me..
This video is --F# AMAZING .!!! I am gonna PIN it and WALLPAPER it !!!!! COPY it and PASTE it in multiple DIRECTORIES on my TREE!!! THANK YOU, NETWORKCHUCK!!!
Yessir. Always a pleasure to see a new vid posted by you! Let's get the coffee ready!
Bro you're cool you're my favourite youtubers i learned alot from you
A million directories on a Linux filesystem is irrelevant. Depends on the actual file system, but _any_ genuine UNIX or Linux FS wouldn't care.
However, utilities like tree, and probably ls, will simply not work ...
for example:
ext4 does not limit the number of subdirectories in a single directory, except by the inherent size limit of the directory itself. (In ext3 a directory can have at most 32,000 subdirectories.) To allow for larger directories and continued performance, ext4 in Linux 2.6.23 and later turns on HTree indices (a specialized version of a B-tree) by default, which allows directories up to approximately 10-12 million entries to be stored in the 2-level HTree index and 2 GB directory size limit for 4 KiB block size, depending on the filename length. In Linux 4.12 and later the _largedir_ feature enabled a 3-level HTree and directory sizes over 2 GB, allowing approximately 6 billion entries in a single directory.
Having seen directories with hundreds of thousands of files in them (no... really... God I had biologists sometimes) this is both a blessing and a curse. A blessing because when those people created all of those little files (seriously, why do you need thousands upon thousands of little 4k files?) it did not crash the system, but also a curse because it let them create that many in the first place without saying "Nope... sorry... you have reached your limit... learn how to program better so that you aren't using the filesystem like a database!"
@@jonakers704 Argh the curse of the bioinfomatics people. I have seen that myself. What we do to "avoid" the problem on our HPC system in the first place is put a quota on the number of files they can have. I think we are at about 100 millions files on the file system now, but no individual user can have more than one million. Actually the hard quota is two million, with a 30 day grace period, but the soft quota is one million. Actually they can but they firstly have to ask and secondly there is a charge. Only a handful of people have ever asked and nobody has gone ahead when the issue of the cost was raised. Prior to the introduction of quotas on files we had one user with 17 million files. We are using GPFS and with the right setup a search of one billion files will take under an hour, ~15 minutes springs to mind.
@@jonathanbuzzard1376 We are using lustre for our HPC system, sitting on around seven PB of storage. Users have to purchase their storage allotment on the system, so they get to do with it as they wish. We have had to take an "education of the user" approach for huge numbers of files in order to combat the problem, as we are not able to utilize quotas on the number of files due to our favorite 8th OSI layer... politics.
@@jonakers704 well thankfully we are no longer using the pit of some that is Lustre and are on GPFS, but that is a different story. However the point is that in addition to cost for capacity, every file has a cost too. So a single file 1MB in size is cheaper to store than a thousand files 1KB in size. You are burning through those expensive flash disks for metadata rather than cheap large capacity spinners. You are also filling up the TSM database which is also on expensive flash. All we do is put a reasonable default limit on both capacity and number of files. Above this you have to pay and I have this costed out for both capacity and files. If a user wants to store 10 million files that is absolutely possible they just have to pay the full economic cost of doing so, and they baulk at the cost in my experience. Basically it means they have to have a discussion with use *before* they store millions of files which gives us the opportunity to educate them.
i have been waiting for this !!!!!!! thx man you made my day with this Video
Good video, i learned how to make files with data already in them. Didnt know i could do that. Good stuff
"Pruned our tree" haha. Kinda how i just pruned this burrito.
The term directory predates windows. They called them that in DOS and Unix too. instead of ls. The command on dos was litteraly dir
Got to love network chuck from a fellow bearded one, coffee drinker and IT novice
you hit EVERY leaf on the way outta that tree, bro!
Bro I love your videos!!!
You missed out a directory/anotherone/bites/the/dust joke hehe
DOS had directories, too. So it was definitely Windows being different calling them folders (copying Mac, really)
All the dos commands, powershell commands and windows api commands still call them directories, too. Only folders in explorer
Finished the series, I can say I've learned a few things, as a thank you, you got my Sub. ;)
I recently found your Channel and I really like it, and this is the first series i finished. And i have to say: the information you present is really dense, this is awesome. And you are so high energy. Its awesome but also tiring. Maybe like a safeguard to not watch too many videos all at once so you learn better.
Nevertheless: Awesome Work.
Lots of things to learn from your channel, thanks Chuck.
Guys, what is his keyboard?
I don't know if he ever said it but, i really liked it's sound...
Hey Chuck, please continue your Linux for hackers series 😁👍
Thanks uncle chuck
I just want to say sudo thank you to you! That was a great course, exactly what I needed :)
thanx men i really appreciate it
Thank you very much for creating this course!! You make learning more interesting.
Sir You are awesome and your videos are awesome and I want you publish your videos daily
21:20
Someone should make a wallpaper engine set out of this!
So glad you taught me how to use VMs lol. Welp time to break a VM :D
Nice video. You could run: mkdir dir{1..1000000} and that would also do it.
You could then run top and or htop in another window/terminal to watch how that effects the machine.
Really Enjoyed this video 😂👌
I did the same thing years ago with a batch file in DOS on a floppy disk as I wouldn't dare trying it on a hard drive. lol
Finally finished the linux for hacker course!!! Time to get serious now!!!
pls do more videos on this playlist
Great content and an easy way to teach! Great job 👍🏼
That was pretty cool stuff Chuck
Thanks you for that videos! I think, that can find a DevOps job after you'r content; alias thankgs="man, you'r lessons are easy and beautiful"
Thanks! I made it to the last episode in the series
I love to see Chuck breaking things lol
Thanks a lot for this course. really learned a lot of things well explained and fun to watch.
Old Unix guy: ls -F (types without long format) and maybe in the case of directories with lots of stuff, ls -f (no sort, a time saver in cases of large number of things to sort).
Access your FREE Linux lab here: ntck.co/htbacad (HTB Academy)
Have you ever wanted to destroy Linux or even create more directories than you could imagine? Well in this video, NetworkChuck shows you how to break your linux box as well as how to create a million directories!! He also shows you some helpful commands too…. But we know why you’re here.
Checkout HTB:
-HTB: ntck.co/htb
-HTB Academy: ntck.co/htbacad
🔥🔥Join the NetworkChuck Academy!: ntck.co/NCAcademy
**Sponsored by Hack The Box
0:00 ⏩ Intro
0:57 ⏩ Get your free Linux lab!
2:10 ⏩ Let’s get to our happy place!
2:22 ⏩ Time to touch some files
3:30 ⏩ a new way to use cat?
4:43 ⏩ echo “How to use echo to create a file with text inside” - Thistimestamp.txt
5:49 ⏩ Now let’s make some folders… I mean directories
7:36 ⏩ Time to mv some stuff
10:53 ⏩ You can’t cp this!
12:36 ⏩ How to make a million directories!
15:38 ⏩ Ready to destroy some stuff?
20:05 ⏩ Time to really make a million directories!
21:51 ⏩ Outro
Sir chuck! I created 1M a week ago in Linux and in windows. I m happy to be r student and that u also thought like me to create folders.
code::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
in Linux
{
mkdir c
cd c
/home/me/./folders.sh
}
it will reopen the script after the process is done
code::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
in Windows
{
:x
mkdir %random%%random%%random%%random%
goto x
}
code::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
in windows, it was pretty simple cause I defined the function x & call it back after the work is done, like a loop. Btw it's so slow.
are you fr colorblind?
@Not Convinced It's free for everybody to learn this, but how you want to use the knowledge is totally your thing. There are also lots of people learning ethical hacking to find bugs for companys before they get attacked
@Not Convinced actually though i kinda understand your idea so you know, you got a point
Hello guys, I was not paying attention and during the installation of Windows 10, instead of formatting the C drive, I deleted it, and now I don't know what to do, please help me.
Wow! Even though you've got above-average bandwidth, that's some apparent delay between your key-presses and HTBa.
Uh! Well now I have the watch the video. The Machine Gods are very pleased with your sacrifice by the way.