What does accessing a supercomputer look like?
ฝัง
- เผยแพร่เมื่อ 21 ก.ย. 2024
- Are you a beginner interested in using a supercomputer. Then this video is for you!
We run a simple job on LUMI (www.lumi-super...), one of the fastest supercomputers in the world.
You can find more information on how to get started on LUMI on docs.lumi-supe....
Whether you're a business, public authority or academic researcher, EuroHPC JU provides free access to multiple supercomputers in Europe for your computation-intensive jobs. More information on how to apply for access here eurohpc-ju.eur....
We have also made a video on how to apply • How to apply for acces...
------------------
ENCCS is based in Sweden and provides free training and support for accessing and using European supercomputers.
If you are a company or public authority based in Sweden please visit enccs.se or contact us at info@enccs.se. We help you access and use European supercomputers.
Are you located in a European country, or associated country? Contact your local competence centre to get help and advice. For more information on the competence centres please follow this link www.eurocc-acc....
You can read more about the countries associated with Horizon2020 here ec.europa.eu/i...
![[TH] JFT vs RLF - VCT Ascension Pacific - Day 2](http://i.ytimg.com/vi/PuIH7w_jO6c/mqdefault.jpg)
Wow. One of the things I had wondered as a child reading non-fiction technology books was how one would access and control a supercomputer. TH-cam recommended this video and a question I never thought I wanted answered has been answered, especially because I already have quite a bit of experience with Linux.
Basically we need to use SSH to remotely access the supercomputer just like accessing any other linux server.
and you need to know how to submit jobs to slurm :)
As you might have noticed by the view-count, this is highly interesting as short-form content! Can you show one doing something in parallel where the jobs are split? Also, what happens to the data? Can a user upload petabytes of data for a job? It can’t all be stored on the login nodes, can it? Like a CERN dataset or large baseline interferometry data for radio astronomy?
You're definitely right! We are preparing such videos with parallel jobs, GPU programming examples and Jupyter notebooks. There are multiple options for storage. In the case of LUMI you can see the options here docs.lumi-supercomputer.eu/storage/
@@enccs Awesome! I thought the docs would only be available to registered users for some reason. Are there users who actually book all of the nodes at once? And I saw in the documentation that you can develop software on Lumi - what kinds of software need to be developed on the supercomputer itself?
lovely
You can always copy your private key to another computer, no need to regenerate.
From the U.S. ,Thank you , - and I really admire you guys , your people , and admire your government. I wish we did the same, with the same quality of service.
This is so awesome.
I will try later , thank you for the info❤
Why I have to generate keypairs in different machines? Of course, you need to copy the id_rsa to the another machine, and watch out that the copy is secured (SCP for example is good) but if you generate n+1 key, then you have to watch n+1 key. Also, if you using smartcards to store your keys for example. You don't need dedicated smart cards for every computer... Except that, it's a nice video!
It's true! You can do this as well!
True, but if you loose a device with that key on it you can just remove that key and dont have to replace them on all other machines. As a Sysadmin I use a bunch of different keypairs for different clients, servers, etc. Just generate them, they are for free ;)
One basically question, if i put 2000 computers combined working together each with 3 giga bites, is it a super computer. Just ank out of curiosity
👍
Apparently it's not free since you need the project number for billing.
With every access to a EuroHPC JU supercomputer you have a certain amount of core hours. This is why you need the project number. When the core hours are over in your project you have to apply for access again. And yes, it's free!
Learn more about every access here enccs.se/industry-public-administration/
How amazing! You type some UNIX text based commands in a Terminal window on macOS, then this gives you some text output back, but some of it comes from a remote computer!! No graphics or video. UNIX has existed since 1969. It looks like whatever these jobs were that you were running, it may as well have been done in 1969, or perhaps even 1977. macOS on a personal or single user computer looks light years ahead of this. What were these jobs or tasks you were running? What was the point of them?! I can't see any point to them at all.
What languages are available? Can jobs be written in C?
It's a computer with SSH access you can run whatever you want to run.
The only difference from a normal server is that you need to schedule your jobs. As you're not directly interacting with the server, but with a login server.
@@theuniverse2268 Hopefully not... First of all, the users cannot be root, but more important, the compiler, and the language has to have support parallel computing. Belive me, it's not just an apt/yum install :)
Yes! C and Fortran are traditionally used a lot in HPC!
Do people use Rust or Go for this?
Is access to supercomputer free?
For researchers, companies and public authorities that are based in Europe, yes! They can use EuroHPC JU supercomputers for free. Learn more about which countries are eligible here ec.europa.eu/info/research-and-innovation/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_en. In the description you can find our video on how to apply for access.
can an individual not from eu do this too?
The individual has to be working or studying in an EU country or a Horizon 2020 associated country. You can find the list of the countries here research-and-innovation.ec.europa.eu/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_en
What i learnt is that, how to copy a local file to ssh server😊
It's either:
WHAT does it look like
or
HOW does it look.
IT IS NOT "HOW does it look LIKE"
I dont see you doing a video to access a european supercomputer , lazy mofo.
you do a video on it then.
quit complaining , respect this man.
"What".. not.. "How".
please don't use these strange sound eddects
"How does accessing a supercomputer look like?"
Perhaps an instructional video on how to name videos in proper English would go further...