LIDA - Leeds Institute for Data Analytics -
LIDA - Leeds Institute for Data Analytics -
  • 37
  • 34 232
SciML: Regional climate model emulator based on deep learning
Regional climate model emulator based on deep learning: concept and first evaluation of a novel hybrid downscaling approach
A talk by Dr Antoine Doury at the French National Centre for Meteorological Research on behalf of the SciML community at Leeds Institute for Data Analytics.
Providing reliable information on climate change at local scale remains a challenge of first importance for impact studies and policymakers. Here, we propose a novel hybrid downscaling method combining the strengths of both empirical statistical downscaling methods and Regional Climate Models (RCMs). In the longer term, the final aim of this tool is to enlarge the high-resolution RCM simulation ensembles at low cost to explore better the various sources of projection uncertainty at local scale. Using a neural network, we build a statistical RCM-emulator by estimating the downscaling function included in the RCM. This framework allows us to learn the relationship between large-scale predictors and a local surface variable of interest over the RCM domain in present and future climate. The RCM-emulator developed in this study is trained to produce daily maps of the near-surface temperature at the RCM resolution (12 km). The emulator demonstrates an excellent ability to reproduce the complex spatial structure and daily variability simulated by the RCM, particularly how the RCM refines the low-resolution climate patterns. Training in future climate appears to be a key feature of our emulator. Moreover, there is a substantial computational benefit of running the emulator rather than the RCM, since training the emulator takes about 2 h on GPU, and the prediction takes less than a minute. However, further work is needed to improve the reproduction of some temperature extremes, the climate change intensity and extend the proposed methodology to different regions, GCMs, RCMs, and variables of interest.
Antoine is a postdoc at the French National Centre for Meteorological Research (CNRM) and is a member of the large-scale and climate modelling department (GMGEC). His research focuses on regional climate modelling using machine-learning techniques. His research interests include statistical emulation of regional climate models and statistical downscaling of weather and climate forecasts.
มุมมอง: 43

วีดีโอ

Data Analytics Team software support for FIND-AF - Ramesh Nadarajah
มุมมอง 312 หลายเดือนก่อน
The LIDA Data Analytics Team supported FIND-AF researchers who had created a ground-breaking algorithm to help identify people at risk of atrial fibrillation. The FIND-AF team needed to bring their research algorithm into a usable clinical tool - the DAT gave them the software solution.
My Data Scientist Development Programme Experience - Favour Aghaebe
มุมมอง 942 หลายเดือนก่อน
Our award-winning data science programme is an opportunity for graduates and career changers looking to pursue a career in data science. It provides on-the-job training and experience in the form of a fixed 12-month, paid role. The data scientists own the delivery of two 6-month projects, working on real-world problems with real data across Health, Environment and Societies. They work with exte...
Data Science MSc Scholarship Student Review - Hazel Fernando
มุมมอง 352 หลายเดือนก่อน
Hazel talks about what the scholarship meant to her this year...
LIDA Health MRC Win - Luisa Cutillo
มุมมอง 352 หลายเดือนก่อน
The University of Leeds has been awarded £500,000 by the Medical Research Council (MRC) to fund an ambitious three-year project aimed at enhancing career prospects and leadership opportunities for biomedical data scientists.
LASER Artifactory - Python Package Index (PYPI)
มุมมอง 897 หลายเดือนก่อน
In this video, you’ll learn how to access and install Python packages from the PyPI repository using Artifactory within your LASER TRE, where internet access is restricted. By configuring Artifactory for PyPI, you gain access to all Python packages available in the PyPI repository. Once the initial setup is complete, it will persist for future sessions. Visit th-cam.com/play/PL6IHTglJFPj-k5Y8KE...
LASER Artifactory - CRAN
มุมมอง 907 หลายเดือนก่อน
This video demonstrates how to set up Artifactory for CRAN, in LASER, and download R packages even when there is no internet access within your TRE. By following the instructions, you’ll be able to retrieve all necessary R packages, just as you would on your local machine. This configuration is a one-time setup. Visit th-cam.com/play/PL6IHTglJFPj-k5Y8KExLRNe0JPjfOfqww.html&si=Sskl4dawZs3EGDRC f...
LASER Artifactory - Conda
มุมมอง 697 หลายเดือนก่อน
This video includes instructions on how to set up Artifactory for Conda, in LASER, which allows access to online Conda repositories. By following the demonstrated steps, you can download Conda packages just as you would on your local machine. Visit th-cam.com/play/PL6IHTglJFPj-k5Y8KExLRNe0JPjfOfqww.html&si=Sskl4dawZs3EGDRC for more LASER how-to guides. LASER is a cloud-based Trusted Research En...
Data Scientist Development Programme - Top Tips for applying
มุมมอง 8697 หลายเดือนก่อน
Watch the video to get our top tips for applying to become a LIDA Data Scientist! Our award-winning data science programme is an opportunity for graduates and career changers looking to pursue a career in data science. It provides on-the-job training and experience in the form of a fixed 12-month, paid role. The data scientists own the delivery of two 6-month projects, working on real-world pro...
Data Science Careers Advice - Aneta Swianiewicz (Visa)
มุมมอง 968 หลายเดือนก่อน
Aneta Swianiewicz, Graduate Data Scientist at Visa, gives us her top tips for beginning a career in data science and what's helped her along the way.
Data Science Careers Advice - Alexander Mudd (Asda)
มุมมอง 668 หลายเดือนก่อน
Alexander Mudd, Data Scientist at Asda, gives us his top tips for beginning a career in data science and what's helped him along the way.
Data Science Careers Event 2024
มุมมอง 979 หลายเดือนก่อน
Our free data science careers event featuring speakers from across industry including Visa, Asda and the Alan Turing Institute. They talk about their data science roles, their projects and career development. Visa An introduction to Visa - what types of data we have access to and how we use it. Some top tips on how to secure a role in the industry. Two of our recent graduate joiners who work in...
LASER log-in and walkthrough
มุมมอง 829 หลายเดือนก่อน
LASER log-in and walkthrough
LASER Dashboard Demo
มุมมอง 839 หลายเดือนก่อน
LASER Dashboard Demo
Rapid Spatio-Temporal Flood Modeling: Hydraulic GNN Approach
มุมมอง 3409 หลายเดือนก่อน
A SciML event Numerical modelling is a reliable tool for flood simulations, but accurate solutions are computationally expensive. In the recent years, researchers have explored data-driven methodologies based on neural networks to overcome this limitation. However, most models are used only for a specific case study and disregard the dynamic evolution of the flood wave. This limits their genera...
Forecasting Global Weather with Graph Neural Networks
มุมมอง 937ปีที่แล้ว
Forecasting Global Weather with Graph Neural Networks
Hands On Scientific Machine Learning - SINDy
มุมมอง 351ปีที่แล้ว
Hands On Scientific Machine Learning - SINDy
Could deep learning methods replace numerical weather models?
มุมมอง 481ปีที่แล้ว
Could deep learning methods replace numerical weather models?
Research & Innovation at LIDA
มุมมอง 121ปีที่แล้ว
Research & Innovation at LIDA
Bridging Trust & Research: Exploring the secrets of a secure environment
มุมมอง 54ปีที่แล้ว
Bridging Trust & Research: Exploring the secrets of a secure environment
Feature-Preserving Point Cloud Simplification with Gaussian Processes
มุมมอง 442ปีที่แล้ว
Feature-Preserving Point Cloud Simplification with Gaussian Processes
Cycling safety and participation - if you build it, will they use it and be safe?
มุมมอง 15ปีที่แล้ว
Cycling safety and participation - if you build it, will they use it and be safe?
Physics-based domain adaptation for dynamical systems forecasting
มุมมอง 363ปีที่แล้ว
Physics-based domain adaptation for dynamical systems forecasting
Future Innovations in Novel Detection of Atrial Fibrillation (FIND-AF)
มุมมอง 120ปีที่แล้ว
Future Innovations in Novel Detection of Atrial Fibrillation (FIND-AF)
Data Science Careers Advice - Bank of England
มุมมอง 251ปีที่แล้ว
Data Science Careers Advice - Bank of England
Data Science Careers Advice - Asda
มุมมอง 145ปีที่แล้ว
Data Science Careers Advice - Asda
LIDA Data Science Careers Event 2023
มุมมอง 136ปีที่แล้ว
LIDA Data Science Careers Event 2023
Data Science Careers Advice - Channel 4
มุมมอง 97ปีที่แล้ว
Data Science Careers Advice - Channel 4
ClimaX - A foundation model for weather and climate
มุมมอง 2.3Kปีที่แล้ว
ClimaX - A foundation model for weather and climate
Sea ice detection from concurrent visible and SAR imagery using a convolutional neural network
มุมมอง 511ปีที่แล้ว
Sea ice detection from concurrent visible and SAR imagery using a convolutional neural network

ความคิดเห็น

  • @bbkaran
    @bbkaran 4 หลายเดือนก่อน

    Thanks for the nice explanation. Can we use the snapshots from this video in presentation? If so, how to credit the author?

  • @fosbergaddai4996
    @fosbergaddai4996 7 หลายเดือนก่อน

    Great video. I am applying and this looks informative

    • @LeedsDataAnalytics
      @LeedsDataAnalytics 7 หลายเดือนก่อน

      Thank you for the feedback :) We look forward to hearing from you!

  • @vladyslavkorenyak872
    @vladyslavkorenyak872 9 หลายเดือนก่อน

    Damn if you could do this with a freaking heart I hope I can manage to do it with a simple plane model. Thank you for sharing!!

    • @LeedsDataAnalytics
      @LeedsDataAnalytics 9 หลายเดือนก่อน

      We believe in you! Let us know how you get on 😃

  • @raybar1915
    @raybar1915 11 หลายเดือนก่อน

    Using raw observations introduces many challenges. I would think that a significant one is filtering out erroneous observations.

  • @YourHoss
    @YourHoss ปีที่แล้ว

    Sounds truly groundbreaking. As a layman to me it’s amazing this works in the same “next-token” way as LLMs that have become so popular this year. I do wonder, how much memory is “too much”? Could we throw more memory at this problem and even if scaling is quadratic, is it feasible on some grand scale? We currently spend a lot of money on supercomputers, what it the same amount of resources was available for ClimaX?

  • @mauricebeck590
    @mauricebeck590 ปีที่แล้ว

    ❗ promo sm

  • @DennisWayo
    @DennisWayo ปีที่แล้ว

    Impressive!

  • @vladalbata880
    @vladalbata880 ปีที่แล้ว

    You have a high probability for building an AGI here.

  • @Septumsempra8818
    @Septumsempra8818 ปีที่แล้ว

    Can I use this in Economics? Econ has "conservation" in the long-run, but in the short-run wonky things happen.

    • @memegazer
      @memegazer ปีที่แล้ว

      Flash crash formula right here.

    • @Septumsempra8818
      @Septumsempra8818 ปีที่แล้ว

      @@memegazer please elaborate

    • @memegazer
      @memegazer ปีที่แล้ว

      @@Septumsempra8818 So basically in theory you could train a model to take certain economic assumptions to predict market behavior...but unlike physically based models those assumptions are not necessarily as objectively robost. So doing so, in theory if different competing models in the market used AI to guide their investment strategies...but those big firms made different assumptions...like for example that their firms model should beat the market...then that could easily spiral out of control if machines were making all the market decisions with goal of maximizing returns.

  • @sivaprasad-cl7xp
    @sivaprasad-cl7xp ปีที่แล้ว

    Can anyone tell about what residual form infers at 4:40 in the slide thanks

    • @LeedsDataAnalytics
      @LeedsDataAnalytics ปีที่แล้ว

      Hi Siva, the residual form simply involves moving all terms of the equation to one side, so we have F(x,u) = 0. If the ODE/PDE is satisfied then F(x,u) will equal zero, so minimising this term during training constrains the predicted variables to satisfy the residual, and thus the PDE/ODE. Hope that helps!

  • @DiamondSane
    @DiamondSane ปีที่แล้ว

    Nice work guys

  • @chilinh2206
    @chilinh2206 ปีที่แล้ว

    👍👍👍👍👍

  • @georgekarniadakis5089
    @georgekarniadakis5089 ปีที่แล้ว

    Great work Fergus! WE always use the self-adaptive weights of the Texas A&M group.

  • @haronmaiden
    @haronmaiden ปีที่แล้ว

    Congrats!!