Center for High Throughput Computing
Center for High Throughput Computing
  • 152
  • 39 388
HTC23 Final Closing Remarks
To close HTC23, Miron Livny gives some final closing remarks.
Slides: agenda.hep.wisc.edu/event/2014/contributions/28451/
All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Meetings: htcondor.org/past_condor_week...
มุมมอง: 52

วีดีโอ

HTC23 Generalizing HEPCloud Split Starter for Multiple Sites and Experiments
มุมมอง 22ปีที่แล้ว
Bruno Coimbra and his team discuss generalizing HEPCloud Split Starter (HPSS). They explain what HPSS is, why it's needed, and implementation. Coimbra and his team then talk about running test jobs on Summit (OLCF). Templating, batch system scripts, VO repositories, and VO account.conf are also covered. Slides: agenda.hep.wisc.edu/event/2014/contributions/28450/ All talks, speakers, and materia...
HTC23 E4S: Extreme-scale Scientific Software Stack
มุมมอง 20ปีที่แล้ว
Professor Sameer Shende discusses the Extreme-scale Scientific Software Stack (E4S) and the Exascale Computing Project. They then break down how to get started with E4S on OSG-HTC and aspects E4S includes. They then delve into key considerations when using E4S and support. Slides: agenda.hep.wisc.edu/event/2014/contributions/28449/ All talks, speakers, and materials from HTC23: agenda.hep.wisc....
HTC23 Scientific Workflows with Pegasus
มุมมอง 51ปีที่แล้ว
Karan Vahi discusses scientific workflows with Pegasus. They explain what workflows are and challenges of them across domains. Vahi also breaks down key Pegasus concepts and Pegasus's part in the ACCESS support strategy. Slides: agenda.hep.wisc.edu/event/2014/contributions/28448/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past...
HTC23 The Condor hatches in Africa
มุมมอง 20ปีที่แล้ว
Marco van Zwetselaar explains the arrival of HTCondor in Africa. He explains how his team was able to get two hpcs up and running in Africa, as well as the benefits that come with that. Slides: agenda.hep.wisc.edu/event/2014/contributions/28447/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Me...
HTC23 Transitioning Users to SciTokens and Getting them Closer to HTCondor with Jobsub_lite
มุมมอง 30ปีที่แล้ว
Shreyas Bhat provides a brief background on the jobsub project and past issues. They then dive into an overview on jobsub_lite, tokens in the software, adoption of the software, and sucesses. They end with relaying the lessons they've learned during this transition to SciTokens. Slides: agenda.hep.wisc.edu/event/2014/contributions/28446/ All talks, speakers, and materials from HTC23: agenda.hep...
HTC23 Tracing Service for Tracing-Driven Glidein Optimizations
มุมมอง 10ปีที่แล้ว
Namratha Urs and her team discuss GildeinWMS and the current state of Telemetry in GWMS. They also explain motivations and possible solutions, as well as how distributed tracing works. The team then breaks down GWMS tracing service architecture. Slides: agenda.hep.wisc.edu/event/2014/contributions/28445/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions...
HTC23 Refactoring GlideinWMS Credentials
มุมมอง 34ปีที่แล้ว
Bruno Coimbra and his team discuss refactoring GildeinWMS credentials. They go over what GildeinWMS is as well as the related factory and frontend. Traditional X509 Authentication, token authentication, credential refactoring, and generic credentials are also covered. Slides: agenda.hep.wisc.edu/event/2014/contributions/28444/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/e...
HTC23 HTCondor at BNL SDCC
มุมมอง 13ปีที่แล้ว
Kavin Casella, Tom Smith, and Christopher Hollowell discuss the Scientific Data and Computing Center (SDCC) at Brookhaven National Laboratory. They provide a brief overview of the center and relay how HTC is incorporated into the center. Slides: agenda.hep.wisc.edu/event/2014/contributions/28442/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All ma...
HTC23 HTCondor at Fermilab
มุมมอง 49ปีที่แล้ว
Farrukh Khan discusses HTCondor at Fermilab. He explains what the Fermi National Accelerator Laboratory (Fermilab) is, as well as HTCondor's position in the lab. Khan then explains the CMS and Dune global pools, as well as different facilities in Fermilab. Slides: agenda.hep.wisc.edu/event/2014/contributions/28441/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/co...
HTC23 Reaching new scales in the CMS Global pool
มุมมอง 15ปีที่แล้ว
Marco Mascheroni and his team discuss the CMS SI team evaluating scalability and why the do so. They also present the 2023 scalability tests they did and explain what it means. They end off with reasons as to why they must keep pushing the SI for higher scales. Slides: agenda.hep.wisc.edu/event/2014/contributions/28440/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/20...
HTC23 Intel Microarchitecture: Nomen Numen
มุมมอง 40ปีที่แล้ว
Greg Thain discusses Intel Microachitecture and the importance of well-named terms. He delves into the powers of clarity, metaphor, and generation when naming complex concepts. Thain then applies this to the OSPool as well as how Intel and RedHat help fix this problem. Slides: agenda.hep.wisc.edu/event/2014/contributions/28439/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/...
HTC23 Developing Machine Learning for Metadata Standardization with HTCondor and Snakemake
มุมมอง 70ปีที่แล้ว
Yuriy Sverchkov, Mark Craven, and Colin Dewey discuss the development of machine learning for metadata standardization using HTCondor and Snakemake. They provde some useful context on metadata and the task of standardizing it. Development workflow is also covered, as well as the strengths and weaknesses of using Snakemake and HTCondor. Slides: agenda.hep.wisc.edu/event/2014/contributions/28432/...
HTC23 What's New, What's coming?
มุมมอง 28ปีที่แล้ว
Todd Tannenbaum discusses what is new with the HTCondor Software Suite. He covers long-term support releases and feature releases. Tannenbaum also goes over new terminology, versioning changes, and so much more. Slides: agenda.hep.wisc.edu/event/2014/contributions/28437/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Week...
Strategic Directions for HTCSS
มุมมอง 10ปีที่แล้ว
Miron Livny discusses potential strategies to optimize HTCSS and strengthen the community around it. Slides: agenda.hep.wisc.edu/event/2014/contributions/28436/ All talks, speakers, and materials from HTC23: agenda.hep.wisc.edu/event/2014/contributions/ All materials from past HTC Weeks and European Workshop Meetings: htcondor.org/past_condor_week...
HTC23 Running HTCondor cluster jobs at remote sites
มุมมอง 35ปีที่แล้ว
HTC23 Running HTCondor cluster jobs at remote sites
HTC23 TaskVine: Workflow for Data Intensive and Serverless Applications
มุมมอง 33ปีที่แล้ว
HTC23 TaskVine: Workflow for Data Intensive and Serverless Applications
HTC23 Automatic benchmarking of worker nodes to optimize resource provisioning
มุมมอง 13ปีที่แล้ว
HTC23 Automatic benchmarking of worker nodes to optimize resource provisioning
HTC23 Highly available HTCondor pools in Google Cloud
มุมมอง 31ปีที่แล้ว
HTC23 Highly available HTCondor pools in Google Cloud
HTC23 Orbiters and Clouds: Bringing Mars Reconnaissance Orbiter Imagery to the People
มุมมอง 13ปีที่แล้ว
HTC23 Orbiters and Clouds: Bringing Mars Reconnaissance Orbiter Imagery to the People
HTC23 Rubin Observatory USDF-at-SLAC Update and HTCondor-at-NCSA 2023
มุมมอง 9ปีที่แล้ว
HTC23 Rubin Observatory USDF-at-SLAC Update and HTCondor-at-NCSA 2023
HTC23 Radio Interferometric Imaging using a cluster of GPUs on PATh
มุมมอง 8ปีที่แล้ว
HTC23 Radio Interferometric Imaging using a cluster of GPUs on PATh
HTC23 Keynote: Unveiling the Universe through Gravitational Waves
มุมมอง 38ปีที่แล้ว
HTC23 Keynote: Unveiling the Universe through Gravitational Waves
HTC23 Security and Token Auth Debugging
มุมมอง 18ปีที่แล้ว
HTC23 Security and Token Auth Debugging
HTC23 Talk of all the Tools
มุมมอง 41ปีที่แล้ว
HTC23 Talk of all the Tools
HTC23 Containers on the OSPool
มุมมอง 13ปีที่แล้ว
HTC23 Containers on the OSPool
HTC23 GPUs with HTCondor
มุมมอง 39ปีที่แล้ว
HTC23 GPUs with HTCondor
HTC23 Getting Your Data with HTCondor
มุมมอง 57ปีที่แล้ว
HTC23 Getting Your Data with HTCondor
HTC23 Intro to Pegasus
มุมมอง 29ปีที่แล้ว
HTC23 Intro to Pegasus
HTC23 HTCondor Services for Non-Humans
มุมมอง 22ปีที่แล้ว
HTC23 HTCondor Services for Non-Humans

ความคิดเห็น

  • @manmLm
    @manmLm 7 หลายเดือนก่อน

    Hi,Thank you for your detailed explanation! I would like to inquire if I can obtain the PowerPoint presentation as a learning material ~

  • @fp1036
    @fp1036 8 หลายเดือนก่อน

    I figured that the link to the administrator manual as attached above is no longer available. Is it because of patches or is put somewhere else?

  • @littlepaw8823
    @littlepaw8823 ปีที่แล้ว

    Hi, when I recently want to setup a pool with V10.x, the instruction in the doc is no longer useful. Can anyone help on this?

  • @sujitpandey8102
    @sujitpandey8102 ปีที่แล้ว

    public class ThreadExample { private static volatile boolean running = true; // Flag to control the thread public static class CustomThread extends Thread { @Override public void run() { while (running) { System.out.println("Thread is running..."); try { Thread.sleep(1000); // Simulate some work } catch (InterruptedException e) { Thread.currentThread().interrupt(); System.err.println("Thread interrupted."); } } System.out.println("Thread is stopped."); } public void stopThread() { running = false; } } public static void main(String[] args) { CustomThread customThread = new CustomThread(); customThread.start(); // Start the thread // Run the thread for a while try { Thread.sleep(5000); } catch (InterruptedException e) { e.printStackTrace(); } // Stop the thread gracefully customThread.stopThread(); try { customThread.join(); // Wait for the thread to finish } catch (InterruptedException e) { e.printStackTrace(); } System.out.println("Main thread exiting."); } }

  • @tachy8258
    @tachy8258 ปีที่แล้ว

    thanks for the nice explanation!

  • @Sil3nt67
    @Sil3nt67 2 ปีที่แล้ว

    Hello, I have a question about this htcondor. I got an error: condor_schedd is not running while I tried to run condor_q and condor_status. Anybody knows how to solve it?

  • @syamn796
    @syamn796 2 ปีที่แล้ว

    Thank you!, is configure centralManager & submit in single node will work, I want to configure (5 clients+1 master) 6 node cluster

    • @Sil3nt67
      @Sil3nt67 2 ปีที่แล้ว

      Hello, I have a question about this htcondor. I got an error: condor_schedd is not running while I tried to run condor_q and condor_status. How did you solve it?

  • @takaroz
    @takaroz 2 ปีที่แล้ว

    Can we find the slides somewhere for all the playlist videos?

  • @JohnHadish
    @JohnHadish 2 ปีที่แล้ว

    At 12:10 $INT(ProcId,%03) should be $INT(ProcId,%03d)

  • @sulsj
    @sulsj 3 ปีที่แล้ว

    Can you direct me to the info on starting Execute Machines (workers) on SLURM? Thanks!

  • @alberto_7683
    @alberto_7683 3 ปีที่แล้ว

    Hi, an ATLAS PhD student here. Thank you for uploading this talk :)

  • @allansoares6486
    @allansoares6486 3 ปีที่แล้ว

    Thank You

  • @allansoares6486
    @allansoares6486 3 ปีที่แล้ว

    Thank You !

  • @ericgonzalez2006
    @ericgonzalez2006 3 ปีที่แล้ว

    Can someone please tell me? How I can count the process from number 1 and not from number 0 using queue? I am trying to create a variable like this Number=$(Process)+1 to start from 1 but doesn´t work.

    • @centerforhighthroughputcom4787
      @centerforhighthroughputcom4787 3 ปีที่แล้ว

      Lets say you wanted input to be foo.1, foo.2, foo.3, ...., foo.100, you could do number = $(Process) + 1 input = foo.$INT(Number) executable = myprogram.exe queue 100 This is an example from the Manual ( see htcondor.readthedocs.io/en/latest/users-manual/submitting-a-job.html#function-macros-in-the-submit-description-file )

  • @orelhao
    @orelhao 3 ปีที่แล้ว

    Thank you for your service !

  • @sadashivsahoo
    @sadashivsahoo 3 ปีที่แล้ว

    Is there any interface to conduct PBS script via Condor

    • @centerforhighthroughputcom4787
      @centerforhighthroughputcom4787 3 ปีที่แล้ว

      Maybe the condor_qsub command can help? This tool ships with HTCondor, and is documented in the Manual and man pages. See htcondor.readthedocs.io/en/latest/man-pages/condor_qsub.html

  • @interpoltotbl
    @interpoltotbl 3 ปีที่แล้ว

    Where do I download wget and sudo?

  • @aihoneyai1197
    @aihoneyai1197 3 ปีที่แล้ว

    echo "CONDOR_HOST = condor-cm.example.com" how to know what to replace the 'condor-cm.example.com' and why you're going with 'condor-cm'?

    • @MarkCoatsworth
      @MarkCoatsworth 3 ปีที่แล้ว

      You'd replace 'condor-cm.example.com' with the full hostname of your central manager. Our convention is to use the '-cm' suffix to indicate that a machine is a central manager, but it's not required.

  • @chaiyy9252
    @chaiyy9252 4 ปีที่แล้ว

    how do i need to add windows htcondor to ubuntu central manager? it doesnt show on condor_status

    • @MarkCoatsworth
      @MarkCoatsworth 3 ปีที่แล้ว

      Can you send an email to htcondor-users@cs.wisc.edu with a copy of the CollectorLog file from your central manager? This should help give some clues.

  • @doughobbs7706
    @doughobbs7706 4 ปีที่แล้ว

    This is brilliant info for Condor beginners (like me!) - thanks for making this available on youTube!

  • @Theguywhoneverlived
    @Theguywhoneverlived 4 ปีที่แล้ว

    condor__q displays as expected. condor_status return is empty. Ubuntu 20.04. Pleases suggest somewhere to start troubleshooting?

    • @MarkCoatsworth
      @MarkCoatsworth 4 ปีที่แล้ว

      This sounds like a security or networking issue, or some variation thereof. Check the SchedLog and CollectorLog files in your log folder, or better yet send an email to htcondor-users@cs.wisc.edu

    • @Theguywhoneverlived
      @Theguywhoneverlived 4 ปีที่แล้ว

      Mark Coatsworth You’re right. DNS wasn’t point correct.

    • @littlepaw8823
      @littlepaw8823 ปีที่แล้ว

      Hi it seems that I have the same situation, can u let me know how you fix it?

  • @tanishqvyas8387
    @tanishqvyas8387 4 ปีที่แล้ว

    htcondor.readthedocs.io/en/latest/admin-manual/quick-start-condor-pool.html Welcome

  • @tanishqvyas8387
    @tanishqvyas8387 4 ปีที่แล้ว

    i was the 2nd subscriber and i really look forward to knowing it

  • @tanishqvyas8387
    @tanishqvyas8387 4 ปีที่แล้ว

    Can you please please make a new video on how to setup a condor pool with detailed explanation for ubuntu / centOS ? Please please

  • @ashishpandey698
    @ashishpandey698 4 ปีที่แล้ว

    Thank you!, Really helpful video, hoping to see more videos on configurations of HTCondor from scratch in future.

  • @ewaldmire
    @ewaldmire 4 ปีที่แล้ว

    This video is only 15 days old - but that link is broken? It looks like that Quick Start section has been removed from the Admin Manual....?

    • @MarkCoatsworth
      @MarkCoatsworth 4 ปีที่แล้ว

      Sorry about this, it's actually linked against a future page in the manual that should be going online any day now.

    • @MarkCoatsworth
      @MarkCoatsworth 4 ปีที่แล้ว

      FYI, the link went live just a few hours after my last comment :)