- 152
- 39 388
Center for High Throughput Computing
United States
เข้าร่วมเมื่อ 5 พ.ค. 2020
The Center for High Throughput Computing (chtc.cs.wisc.edu) is based at the University of Wisconsin-Madison and supports a variety of scalable computing resources and services for affiliated researchers and their collaborator. CHTC is also responsible for development, maintenance and support of the HTCondor batch processing software project (research.cs.wisc.edu/htcondor).
Questions? Send them to the htcondor-admin@cs.wisc.edu support address or the htcondor-users@cs.wisc.edu community list. We're happy to help you get started with HTCondor and answer any HTCondor/CHTC questions you may have!
Follow us on Twitter @CHTC_UW and @HTCondor
Questions? Send them to the htcondor-admin@cs.wisc.edu support address or the htcondor-users@cs.wisc.edu community list. We're happy to help you get started with HTCondor and answer any HTCondor/CHTC questions you may have!
Follow us on Twitter @CHTC_UW and @HTCondor
HTC23 Final Closing Remarks
To close HTC23, Miron Livny gives some final closing remarks.
Slides: agenda.hep.wisc.edu/event/2014/contributions/28451/
All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Meetings: htcondor.org/past_condor_week...
Slides: agenda.hep.wisc.edu/event/2014/contributions/28451/
All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Meetings: htcondor.org/past_condor_week...
มุมมอง: 52
วีดีโอ
HTC23 Generalizing HEPCloud Split Starter for Multiple Sites and Experiments
มุมมอง 22ปีที่แล้ว
Bruno Coimbra and his team discuss generalizing HEPCloud Split Starter (HPSS). They explain what HPSS is, why it's needed, and implementation. Coimbra and his team then talk about running test jobs on Summit (OLCF). Templating, batch system scripts, VO repositories, and VO account.conf are also covered. Slides: agenda.hep.wisc.edu/event/2014/contributions/28450/ All talks, speakers, and materia...
HTC23 E4S: Extreme-scale Scientific Software Stack
มุมมอง 20ปีที่แล้ว
Professor Sameer Shende discusses the Extreme-scale Scientific Software Stack (E4S) and the Exascale Computing Project. They then break down how to get started with E4S on OSG-HTC and aspects E4S includes. They then delve into key considerations when using E4S and support. Slides: agenda.hep.wisc.edu/event/2014/contributions/28449/ All talks, speakers, and materials from HTC23: agenda.hep.wisc....
HTC23 Scientific Workflows with Pegasus
มุมมอง 51ปีที่แล้ว
Karan Vahi discusses scientific workflows with Pegasus. They explain what workflows are and challenges of them across domains. Vahi also breaks down key Pegasus concepts and Pegasus's part in the ACCESS support strategy. Slides: agenda.hep.wisc.edu/event/2014/contributions/28448/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past...
HTC23 The Condor hatches in Africa
มุมมอง 20ปีที่แล้ว
Marco van Zwetselaar explains the arrival of HTCondor in Africa. He explains how his team was able to get two hpcs up and running in Africa, as well as the benefits that come with that. Slides: agenda.hep.wisc.edu/event/2014/contributions/28447/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Me...
HTC23 Transitioning Users to SciTokens and Getting them Closer to HTCondor with Jobsub_lite
มุมมอง 30ปีที่แล้ว
Shreyas Bhat provides a brief background on the jobsub project and past issues. They then dive into an overview on jobsub_lite, tokens in the software, adoption of the software, and sucesses. They end with relaying the lessons they've learned during this transition to SciTokens. Slides: agenda.hep.wisc.edu/event/2014/contributions/28446/ All talks, speakers, and materials from HTC23: agenda.hep...
HTC23 Tracing Service for Tracing-Driven Glidein Optimizations
มุมมอง 10ปีที่แล้ว
Namratha Urs and her team discuss GildeinWMS and the current state of Telemetry in GWMS. They also explain motivations and possible solutions, as well as how distributed tracing works. The team then breaks down GWMS tracing service architecture. Slides: agenda.hep.wisc.edu/event/2014/contributions/28445/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions...
HTC23 Refactoring GlideinWMS Credentials
มุมมอง 34ปีที่แล้ว
Bruno Coimbra and his team discuss refactoring GildeinWMS credentials. They go over what GildeinWMS is as well as the related factory and frontend. Traditional X509 Authentication, token authentication, credential refactoring, and generic credentials are also covered. Slides: agenda.hep.wisc.edu/event/2014/contributions/28444/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/e...
HTC23 HTCondor at BNL SDCC
มุมมอง 13ปีที่แล้ว
Kavin Casella, Tom Smith, and Christopher Hollowell discuss the Scientific Data and Computing Center (SDCC) at Brookhaven National Laboratory. They provide a brief overview of the center and relay how HTC is incorporated into the center. Slides: agenda.hep.wisc.edu/event/2014/contributions/28442/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All ma...
HTC23 HTCondor at Fermilab
มุมมอง 49ปีที่แล้ว
Farrukh Khan discusses HTCondor at Fermilab. He explains what the Fermi National Accelerator Laboratory (Fermilab) is, as well as HTCondor's position in the lab. Khan then explains the CMS and Dune global pools, as well as different facilities in Fermilab. Slides: agenda.hep.wisc.edu/event/2014/contributions/28441/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/co...
HTC23 Reaching new scales in the CMS Global pool
มุมมอง 15ปีที่แล้ว
Marco Mascheroni and his team discuss the CMS SI team evaluating scalability and why the do so. They also present the 2023 scalability tests they did and explain what it means. They end off with reasons as to why they must keep pushing the SI for higher scales. Slides: agenda.hep.wisc.edu/event/2014/contributions/28440/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/20...
HTC23 Intel Microarchitecture: Nomen Numen
มุมมอง 40ปีที่แล้ว
Greg Thain discusses Intel Microachitecture and the importance of well-named terms. He delves into the powers of clarity, metaphor, and generation when naming complex concepts. Thain then applies this to the OSPool as well as how Intel and RedHat help fix this problem. Slides: agenda.hep.wisc.edu/event/2014/contributions/28439/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/...
HTC23 Developing Machine Learning for Metadata Standardization with HTCondor and Snakemake
มุมมอง 70ปีที่แล้ว
Yuriy Sverchkov, Mark Craven, and Colin Dewey discuss the development of machine learning for metadata standardization using HTCondor and Snakemake. They provde some useful context on metadata and the task of standardizing it. Development workflow is also covered, as well as the strengths and weaknesses of using Snakemake and HTCondor. Slides: agenda.hep.wisc.edu/event/2014/contributions/28432/...
HTC23 What's New, What's coming?
มุมมอง 28ปีที่แล้ว
Todd Tannenbaum discusses what is new with the HTCondor Software Suite. He covers long-term support releases and feature releases. Tannenbaum also goes over new terminology, versioning changes, and so much more. Slides: agenda.hep.wisc.edu/event/2014/contributions/28437/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Week...
Strategic Directions for HTCSS
มุมมอง 10ปีที่แล้ว
Miron Livny discusses potential strategies to optimize HTCSS and strengthen the community around it. Slides: agenda.hep.wisc.edu/event/2014/contributions/28436/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Meetings: htcondor.org/past_condor_week...
HTC23 Running HTCondor cluster jobs at remote sites
มุมมอง 35ปีที่แล้ว
HTC23 Running HTCondor cluster jobs at remote sites
HTC23 TaskVine: Workflow for Data Intensive and Serverless Applications
มุมมอง 33ปีที่แล้ว
HTC23 TaskVine: Workflow for Data Intensive and Serverless Applications
HTC23 Automatic benchmarking of worker nodes to optimize resource provisioning
มุมมอง 13ปีที่แล้ว
HTC23 Automatic benchmarking of worker nodes to optimize resource provisioning
HTC23 Highly available HTCondor pools in Google Cloud
มุมมอง 31ปีที่แล้ว
HTC23 Highly available HTCondor pools in Google Cloud
HTC23 Orbiters and Clouds: Bringing Mars Reconnaissance Orbiter Imagery to the People
มุมมอง 13ปีที่แล้ว
HTC23 Orbiters and Clouds: Bringing Mars Reconnaissance Orbiter Imagery to the People
HTC23 Rubin Observatory USDF-at-SLAC Update and HTCondor-at-NCSA 2023
มุมมอง 9ปีที่แล้ว
HTC23 Rubin Observatory USDF-at-SLAC Update and HTCondor-at-NCSA 2023
HTC23 Radio Interferometric Imaging using a cluster of GPUs on PATh
มุมมอง 8ปีที่แล้ว
HTC23 Radio Interferometric Imaging using a cluster of GPUs on PATh
HTC23 Keynote: Unveiling the Universe through Gravitational Waves
มุมมอง 38ปีที่แล้ว
HTC23 Keynote: Unveiling the Universe through Gravitational Waves
Hi,Thank you for your detailed explanation! I would like to inquire if I can obtain the PowerPoint presentation as a learning material ~
I figured that the link to the administrator manual as attached above is no longer available. Is it because of patches or is put somewhere else?
Hi, when I recently want to setup a pool with V10.x, the instruction in the doc is no longer useful. Can anyone help on this?
public class ThreadExample { private static volatile boolean running = true; // Flag to control the thread public static class CustomThread extends Thread { @Override public void run() { while (running) { System.out.println("Thread is running..."); try { Thread.sleep(1000); // Simulate some work } catch (InterruptedException e) { Thread.currentThread().interrupt(); System.err.println("Thread interrupted."); } } System.out.println("Thread is stopped."); } public void stopThread() { running = false; } } public static void main(String[] args) { CustomThread customThread = new CustomThread(); customThread.start(); // Start the thread // Run the thread for a while try { Thread.sleep(5000); } catch (InterruptedException e) { e.printStackTrace(); } // Stop the thread gracefully customThread.stopThread(); try { customThread.join(); // Wait for the thread to finish } catch (InterruptedException e) { e.printStackTrace(); } System.out.println("Main thread exiting."); } }
thanks for the nice explanation!
Hello, I have a question about this htcondor. I got an error: condor_schedd is not running while I tried to run condor_q and condor_status. Anybody knows how to solve it?
Thank you!, is configure centralManager & submit in single node will work, I want to configure (5 clients+1 master) 6 node cluster
Hello, I have a question about this htcondor. I got an error: condor_schedd is not running while I tried to run condor_q and condor_status. How did you solve it?
Can we find the slides somewhere for all the playlist videos?
At 12:10 $INT(ProcId,%03) should be $INT(ProcId,%03d)
Can you direct me to the info on starting Execute Machines (workers) on SLURM? Thanks!
Hi, an ATLAS PhD student here. Thank you for uploading this talk :)
Glad you found it useful!
hehe same
Thank You
Thank You !
Can someone please tell me? How I can count the process from number 1 and not from number 0 using queue? I am trying to create a variable like this Number=$(Process)+1 to start from 1 but doesn´t work.
Lets say you wanted input to be foo.1, foo.2, foo.3, ...., foo.100, you could do number = $(Process) + 1 input = foo.$INT(Number) executable = myprogram.exe queue 100 This is an example from the Manual ( see htcondor.readthedocs.io/en/latest/users-manual/submitting-a-job.html#function-macros-in-the-submit-description-file )
Thank you for your service !
Is there any interface to conduct PBS script via Condor
Maybe the condor_qsub command can help? This tool ships with HTCondor, and is documented in the Manual and man pages. See htcondor.readthedocs.io/en/latest/man-pages/condor_qsub.html
Where do I download wget and sudo?
echo "CONDOR_HOST = condor-cm.example.com" how to know what to replace the 'condor-cm.example.com' and why you're going with 'condor-cm'?
You'd replace 'condor-cm.example.com' with the full hostname of your central manager. Our convention is to use the '-cm' suffix to indicate that a machine is a central manager, but it's not required.
how do i need to add windows htcondor to ubuntu central manager? it doesnt show on condor_status
Can you send an email to htcondor-users@cs.wisc.edu with a copy of the CollectorLog file from your central manager? This should help give some clues.
This is brilliant info for Condor beginners (like me!) - thanks for making this available on youTube!
condor__q displays as expected. condor_status return is empty. Ubuntu 20.04. Pleases suggest somewhere to start troubleshooting?
This sounds like a security or networking issue, or some variation thereof. Check the SchedLog and CollectorLog files in your log folder, or better yet send an email to htcondor-users@cs.wisc.edu
Mark Coatsworth You’re right. DNS wasn’t point correct.
Hi it seems that I have the same situation, can u let me know how you fix it?
htcondor.readthedocs.io/en/latest/admin-manual/quick-start-condor-pool.html Welcome
i was the 2nd subscriber and i really look forward to knowing it
Can you please please make a new video on how to setup a condor pool with detailed explanation for ubuntu / centOS ? Please please
Thank you!, Really helpful video, hoping to see more videos on configurations of HTCondor from scratch in future.
This video is only 15 days old - but that link is broken? It looks like that Quick Start section has been removed from the Admin Manual....?
Sorry about this, it's actually linked against a future page in the manual that should be going online any day now.
FYI, the link went live just a few hours after my last comment :)