Cornell University Center for Advanced Computing

35
51 938

HPC-ED Overview and Demonstration for Early Testers

47:46

Introduction to Python (updated October 2023)

1:03:33

Data Analysis with R

1:17:09

Scientific Computing with Python

1:29:26

Getting Started with R

1:15:27

JupyterLab (in the Cloud) for Python

42:40

Introduction to I-WRF Containers

WRF is software for weather simulation modeling. WFT is notoriously difficult to compile and compute-intensive to run. Application containerization such as Docker or Apptainer (Singularity) with some build constraints can allow for very portable deployments to multiple platforms: HPC as well as public and private cloud using Docker to Singularity. These platforms have inherent differences in storage, compute, and network resources but workflows can be adapted with modular scripting to provision on each platform using the specific api for each using Slurm, Terraform, and Ansible.
Project Docker Hub: hub.docker.com/r/ncar/iwrf
Open SourceCode: github.com/NCAR/i-wrf

มุมมอง: 169

วีดีโอ

HPC-ED Overview and Demonstration for Early Testers

47:46

HPC-ED Overview and Demonstration for Early Testers

มุมมอง 967 หลายเดือนก่อน

Overview, demos, and examples for early testers of the federated catalog project. 0:00 Welcome 1:12 HPC-ED Overview 3:35 Share & Discover Prerequisites 12:22 Share & Discover Walkthrough 24:57 Case Studies 45:22 Q & A 46:40 Help & Feedback

Introduction to Python (updated October 2023)

1:03:33

Introduction to Python (updated October 2023)

มุมมอง 62010 หลายเดือนก่อน

This lecture will introduce the Python programming language, the Python software ecosystem, some key concepts in computer programming, and how those concepts are implemented in Python. The Python ecosystem contains a rich set of packages and tools to support research and data analysis in several different application areas; being able to use the Python programming language to customize computin...

1:17:09

Data Analysis with R

มุมมอง 2.2K10 หลายเดือนก่อน

This lecture presents several examples of data analysis and visualization in R. It will demonstrate a variety of analyses intended to help researchers determine if learning R is a good investment for their research, including new data analysis examples drawn from the WCM community.

1:29:26

Scientific Computing with Python

มุมมอง 1.7K10 หลายเดือนก่อน

This lecture provides an overview of select core components of the Python software ecosystem for scientific computing and data science, with a particular focus on numpy, scipy, pandas, and matplotlib. The lecture will include both descriptions of the overall design and structure of those packages and their key components, and numerous code examples that demonstrate some of the important functio...

1:15:27

Getting Started with R

มุมมอง 20310 หลายเดือนก่อน

RStudio is a common R interface used by researchers. This overview is designed to familiarize new users with the interface, features and best practices so they are ready to delve into conducting their own analyses. The video includes an overview of Quarto - an evolution of Rmarkdown - for documenting and sharing data analysis and research.

42:40

JupyterLab (in the Cloud) for Python

มุมมอง 56011 หลายเดือนก่อน

Jupyter is the most common Python interface used by researchers. Cloud computing providers, like Amazon and Google, offer their own Jupyter-alike interfaces. This webinar provides an overview of the JupyterLab interface and cloud-based derivatives. It is designed to familiarize new users with common Jupyter-like interfaces, features, and best practices. 0:00 JupyterLab overview 10:24 JupyterLab...

52:31

Using Relational Databases for Research

มุมมอง 241ปีที่แล้ว

An introduction to the use of relational (SQL) databases, with a brief overview of database structure then covering SQL queries, some information on best practices, and development tools. We will mostly deal with ANSI SQL which will run on most Relational Database Management Systems (RDBMs), noting some important inter-RDBMS differences. Covered will be SQL queries for data retrieval, insertion...

1:01:35

Using the Whole Processor

มุมมอง 185ปีที่แล้ว

Parallel processing is no longer just a concern for supercomputers these days, it takes place in nearly all computing devices down to laptops and cell phones. This presentation describes parallel computing capabilities that are found within single processors and how applications can access them through techniques such as multithreading and vectorization. 0:00 Introduction and motivation 11:01 C...

Case Study - Scripting ImageJ and PowerPoint with Python

36:43

Case Study - Scripting ImageJ and PowerPoint with Python

มุมมอง 444ปีที่แล้ว

Do you have a workflow with elements that can be automated? Sometimes the hardest part is knowing what might be possible. This case study involves using Python to process multichannel confocal microscopy images with ImageJ and then organize the output into PowerPoint slides.

Working with Excel Files in Python and C#

1:09:47

Working with Excel Files in Python and C#

มุมมอง 343ปีที่แล้ว

An introduction to working with Excel spreadsheets from within computer programs and scripts. Python and C# examples will be given for reading Excel files and accessing their contents, as well as populating, formatting, and writing new Excel files.

55:33

Research Project Software Continuity

มุมมอง 125ปีที่แล้ว

While producing long-lasting software in academic research domains shares many of the same problems as commercial development, the environment is often different. In particular, the number of coders is often smaller, the people writing code may be learning as they go, development of software is often not their main career goal, and the funding model is different. This means that industry approa...

54:01

Python for Data Visualization

มุมมอง 878ปีที่แล้ว

An examination of some of the Python packages that support data visualization for various use cases, providing both a general discussion of capabilities and multiple code examples demonstrating specific functionality. This lecture will address the generation of both static images suitable for inclusion in publications and presentations, and interactive data visualizations useful for exploring c...

55:50

Revision Control with Git

มุมมอง 249ปีที่แล้ว

Git is a widely used tool for revision tracking and collaborative code development. The talk introduces Git and how to use it effectively in conjunction with a repository hosting service like GitHub. 0:00 Introduction to Git, GitHub, and repositories 11:14 Basic Git commands and workflow 23:21 Git commands for syncing with a remote repository 29:09 Working with branches 39:27 Pull requests on G...

Creating the Best Visualizations for your Data

1:14:01

Creating the Best Visualizations for your Data

มุมมอง 442ปีที่แล้ว

An introduction to choosing the best type of chart to use for the data you have and the message you want to convey. Includes a breakdown of the different types of data you might have and descriptions of the main types of 2D data visualization. Does not include instruction for any particular visualization tool. 0:00 Introduction 6:17 Chart type is dictated by the message and data 22:32 Compariso...