Workshop Schedule for April 29, 2022
All times are in PDT
Workshop overview
| Start time | End time | Event |
|---|---|---|
| 8:00 am | 8:05 am | Introductory Remarks |
| 8:05 am | 8:45 am | Keynote presentation by Amy McGovern |
| 8:45 am | 10:00 am | Earth, Space, and Beyond Session |
| 10:00 am | 11:00 am | Poster Session |
| 11:00 am | 12:30 pm | Atmosphere Session |
| 12:30 pm | 1:15 pm | Sensors and Sampling Session |
| 1:15 pm | 1:30 pm | Break |
| 1:30 pm | 2:30 pm | Hydrosphere Session |
| 2:30 pm | 3:30 pm | Ecology Session |
| 3:30 pm | 4:30 pm | Panel Discussion |
| 4:30 pm | 4:35 pm | Closing Remarks |
Keynote presentation
8:05 - 8:45 am PDT (includes 15 min Q&A period)
Speaker: Amy McGovern
Director, NSF AI Institute for Research on Trustworthy AI in Weather, Climate, and Coastal Oceanography
Lloyd G. and Joyce Austin Presidential Professor, University of Oklahoma
Title: Explainable, Interpretable, and Trustworthy AI for the Earth Sciences
Click to read abstract
The NSF AI Institute for Research on Trustworthy AI in Weather, Climate, and Coastal Oceanography (AI2ES) is developing trustworthy AI for a wide variety of weather, climate, and coastal phenomena. In this talk, I will briefly overview AI2ES and then focus specifically on our recent developments in developing explainable and interpretable AI for the earth sciences. Specifically, I will discuss recent work (by Mamalakis et al, 2021; 2022) developing benchmark datasets to objectively assess XAI methods for geoscientific applications, work by Flora et al (in prep) on developing a standard toolkit for XAI for the earth sciences and to assess the validity of XAI methods, applications of XAI to a 3D CNN coastal fog predictive model by Krell, Kamangir et al (submitted), and quantification of the sources of XAI uncertainty from deep ensembles by Gagne et al. (in prep). Because AI2ES is focused on developing AI that is deemed trustworthy by environmental forecasters and managers, I will also describe our preliminary findings on weather forecasters' perceptions of AI trustworthiness, explainability, and interpretability (Cains et al., 2022), in the comparative context of reviews of theoretical and empirical research on explainability, trust, and trustworthiness (Smith et al. in prep, Wirz et al. in prep).
Earth, Space, and Beyond Session
All times are in PDT
| Start time | End time | Type | Title | Authors |
|---|---|---|---|---|
| 8:45 am | 9:05 am | Invited Talk (20 min) | Model Interpretability as Key Trust Element for Onboard Science Autonomy Click to read abstractThe extremely limited communications bandwidth between Earth and distant spacecraft forms one of the greatest challenges to planetary science advancement. Rather than the 100’s of TB’s of remote sensing data now common in terrestrial remote sensing, a mission to distant ocean worlds like Enceladus or Europa may have only 75 MB of total downlink for both science observations and engineering data. Onboard science capabilities, a unique new form of autonomy, can mitigate much of this bottleneck by recognizing, summarizing, and prioritizing science observations based on their utility to ground science teams. As this requires building a new level of trust with mission scientists, these onboard systems must be constructed with reconfigurability and interpretability as primary requirements, as well as the capability to provide overlapping lines of evidence for any drawn conclusions, all with very limited onboard compute power. As these systems often incorporate machine learning and other data-driven solutions, they form a unique challenge area advancing the definition and boundaries of model interpretability for scientific insight generation. |
Lukas Mandrake |
| 0:05 am | 9:15 am | Regular Talk (10 min) | Don't Pay Attention to the Noise: Learning Self-supervised Light Curve Representations with a Denoising Time Series Transformer Click to read abstract Astrophysical light curves are particularly challenging data objects due to the |
Mario Morvan, Nikolaos Nikolaou, Kai Yip, Ingo Waldmann |
| 9:15 am | 9:25 am | Regular Talk (10 min) | Group Equivariant Neural Networks for Spectropolarimetric Inversions in Solar Astronomy Click to read abstractThe upcoming Daniel K. Inouye Solar Telescope (DKIST) will produce unprecedented high-cadence, high-resolution, and multi-line spectropolarimetric observations of the Sun. New computational techniques are needed to infer the state of the Sun's atmosphere from these observations. Deep learning is a promising approach to this spectropolarimetric inversion problem that can both provide real-time visualizations to astronomers and potentially improve upon existing algorithms by combining spatial, temporal, and multi-spectral information. Here we investigate group equivariant deep learning as a method for inferring the three-dimensional photospheric structures, training on magnetohydrodynamic (MHD) simulations of two types of solar features: sunspots and active regions. Our results demonstrate that including multiple lines improves the mean relative error from 18.6% to 14.4%, averaged over all MHD state variables, and that using group equivariant convolution architectures further improves the mean relative error to 12.5%. |
Michael B Ito, Ian Cunnyngham, Xudong Sun, Peter Sadowski |
| 9:25 am | 9:30 am | Lightning Talk (5 min) | MIMSS: A Dataset to evaluate Multi-Image Multi-Spectral Super-Resolution on Sentinel 2 Click to read abstractHigh resolution remote sensing imagery is used in a broad range of tasks, including detection and classification of objects. It is, however, expensive to obtain, while lower resolution imagery is often freely available and can be used for a range of social good applications. To that end, we curate a multi-image multi-spectral dataset for super-resolution of satellite images. We use PlanetScope imagery from the SpaceNet-7 challenge as the high resolution reference and multiple Sentinel-2 revisits of the same location as the low-resolution imagery. We provide baselines for both single imager super-resolution and multi-image super-resolution. We also provide an ablation on how number of scenes, cloud cover and dynamism in different scenes in the dataset affect performance. Finally, we provide our code to construct the dataset along with implementations of baselines for the community to build upon. |
Muhammed T Razzak, Gonzalo Mateo-Garcia, Gurvan Lecuyer, Luis Gomez-Chova, Yarin Gal, Freddie Kalaitzis |
| 9:30 am | 9:35 am | Lightning Talk (5 min) | Learning latent representations for operational nitrogen response rate prediction Click to read abstractLearning latent representations has aided operational decision-making in several disciplines. Its advantages include uncovering hidden interactions in data and automating procedures which were performed manually in the past. Representation learning is also being adopted by earth and environmental sciences. However, there are still subfields that depend on manual feature engineering based on expert knowledge and the use of algorithms which do not utilize the latent space. Relying on those techniques can inhibit operational decision-making since they impose data constraints and inhibit automation. In this work, we adopt a case study for nitrogen response rate prediction and examine if representation learning can be used for operational use. We compare a Multilayer Perceptron, an Autoencoder, and a dual-head Autoencoder with a reference Random Forest model for nitrogen response rate prediction. To bring the predictions closer to an operational setting we assume absence of future weather data, and we are evaluating the models using error metrics and a domain-derived error threshold. The results show that learning latent representations can provide operational nitrogen response rate predictions by offering performance equal and sometimes better than the reference model. |
Christos Pylianidis, Ioannis N Athanasiadis |
| 9:35 am | 9:40 am | Lightning Talk (5 min) | Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networks Click to read abstractNumerical simulators are essential tools in the study of natural fluid-systems, but their performance often limits application in practice. Recent machine-learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we introduce MultiScaleGNN, a novel multi-scale graph neural network model for learning to infer unsteady continuum mechanics in problems encompassing a range of length scales and complex boundary geometries. We demonstrate this method on advection problems and incompressible fluid dynamics, both fundamental phenomena in oceanic and atmospheric processes. Our results show good extrapolation to new domain geometries and parameters for long-term temporal simulations. Simulations obtained with MultiScaleGNN are between two and four orders of magnitude faster than those on which it was trained. |
Mario A Lino, Stathi Fotiadis, Anil Anthony Bharath, Chris Cantwell |
| 9:40 am | 9:50 am | Regular Talk (10 min) | Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulator Click to read abstract Subsurface simulations use computational models to predict the flow of fluids (e.g., oil, water, gas) through porous media. These simulations are pivotal in industrial applications such as petroleum production, where fast and accurate models are needed for high-stake decision making, for example, for well placement optimization and field development planning. Classical finite difference numerical simulators require massive computational resources to model large-scale real-world reservoirs. Alternatively, streamline simulators and data-driven surrogate models are computationally more efficient by relying on approximate physics models, however they are insufficient to model complex reservoir dynamics at scale. |
Tailin Wu, Qinchen Wang, Yinan Zhang, Rex Ying, Kaidi Cao, Rok Sosic, Ridwan Jalali, Hassan Hamam, Marko Maucec, Jure Leskovec |
| 9:50 am | 10:00 am | Author Panel | Q&A Session | |
| 10:00 am | 10:30 am | Breakout Room | Earth, Space, and Beyond Session Networking Event |
Poster Session
10:00 am - 11:00 am PDT
Join on GatherTown here. Note: from the landing page, you can go to the poster session or join the breakout room to meet and chat with other workshop participants.
| Title | Authors |
|---|---|
Don't Pay Attention to the Noise: Learning Self-supervised Light Curve Representations with a Denoising Time Series Transformer Click to read abstract Astrophysical light curves are particularly challenging data objects due to the intensity and variety of noise contaminating them. Yet, despite the astronomical volumes of light curves available, the majority of algorithms used to process them are still operating on a per-sample basis. To remedy this, we propose a simple Transformer model –called Denoising Time Series Transformer (DTST)– and show that it excels at removing the noise in datasets of time series when trained |
Mario Morvan, Nikolaos Nikolaou, Kai Yip, Ingo Waldmann |
Convolutional autoencoders for spatially-informed ensemble post-processing Click to read abstractEnsemble weather predictions typically show systematic errors that have to be corrected via post-processing. Even state-of-the-art post-processing methods based on neural networks often solely rely on location-specific predictors that require an interpolation of the physical weather model's spatial forecast fields to the target locations. However, potentially useful predictability information contained in large-scale spatial structures within the input fields is potentially lost in this interpolation step. Therefore, we propose the use of convolutional autoencoders to learn compact representations of spatial input fields which can then be used to augment location-specific information as additional inputs to post-processing models. The benefits of including this spatial information is demonstrated in a case study of 2-m temperature forecasts at surface stations in Germany. |
Sebastian Lerch, Kai L Polsterer |
Meta-Learning and Self-Supervised Pretraining for Storm Event Imagery Translation Click to read abstractRecent advances in deep learning have provided impressive results across a wide range of computational problems such as computer vision, natural language, or reinforcement learning. Many of these improvements are however constrained to problems with large-scale curated data-sets which require a lot of human labor to gather. Additionally, these models tend to generalize poorly under both slight distributional shifts and low-data regimes. In recent years, emerging fields such as meta-learning or self-supervised learning have been closing the gap between proof-of-concept results and real-life applications of machine learning by extending deep-learning to the semi-supervised and few-shot domains. We follow this line of work and explore spatio-temporal structure in a recently introduced image-to-image translation problem for storm event imagery in order to: i) formulate a novel multi-task few-shot image generation benchmark in the field of AI for Earth and Space Science and ii) explore data augmentations in contrastive pretraining for image translation downstream tasks. We present several baselines for the few-shot problem and discuss trade-offs between different approaches. Our code: https://github.com/irugina/meta-image-translation. |
Ileana Rugina, Rumen R Dangovski, Mark Veillette, Pooya Khorrami, Brian Cheung, Olga Simek, Marin Soljacic |
Testing Interpretability Techniques for Deep Statistical Climate Downscaling Click to read abstractDeep Learning (DL) has recently emerged as a promising Empirical Statistical Downscaling perfect-prognosis technique (ESD-PP), to generate high-resolution fields from large-scale climate variables. Here, we analyze two state-of-the-art DL topologies for ESD-PP of different levels of complexity over North America. Besides classical validation leaning on accuracy metrics (e.g., Root Mean Squared Error (RMSE)), we evaluate several interpretability techniques to gain understanding on the inner functioning of the DL models deployed. Taking as reference the RMSE both topologies show similar values. Nonetheless, by analyzing the resulting interpretability maps, we find that the simplest model fails to capture a realistic physics-based input-output link, whilst the complex one describes a local pattern, characteristic of downscaling. In climate change scenarios, where weather extremes are exacerbated, erroneous patterns can lead to highly biased projections. Therefore, including interpretability techniques as a diagnostic of model functioning in the evaluation process can help us to better select and design them. |
Jose González-Abad, Jorge Baño-Medina, José Manuel Gutiérrez |
Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networks Click to read abstractNumerical simulators are essential tools in the study of natural fluid-systems, but their performance often limits application in practice. Recent machine-learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we introduce MultiScaleGNN, a novel multi-scale graph neural network model for learning to infer unsteady continuum mechanics in problems encompassing a range of length scales and complex boundary geometries. We demonstrate this method on advection problems and incompressible fluid dynamics, both fundamental phenomena in oceanic and atmospheric processes. Our results show good extrapolation to new domain geometries and parameters for long-term temporal simulations. Simulations obtained with MultiScaleGNN are between two and four orders of magnitude faster than those on which it was trained. |
Mario A Lino, Stathi Fotiadis, Anil Anthony Bharath, Chris Cantwell |
Street-Level Air Pollution Modelling with Graph Gaussian Processes Click to read abstractAccurately predicting air quality levels at a fine resolution is a critical task to ensuring the public's health is not at risk. In this work, we construct a graph representation of the road network in Mitcham, London, and model nitrogen dioxide levels using a Gaussian process defined on the vertices of our graph. We introduce a heteroscedastic noise process into our model to capture the complex variations that exist in nitrogen dioxide observations. Defining our model in this way offers superior predictive performance to its spatial analogue. Further, a graph representation allows us to infer the air pollution exposure that an individual would experience on a specific journey and their subsequent risk. We demonstrate this approach for the district of Mitcham, London. |
Thomas Pinder, Kathryn Turnbull, Christopher Nemeth, David S Leslie |
Multimodel Ensemble Predictions of Precipitation using Bayesian Neural Networks Click to read abstractMultimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN's superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification. |
Ming Fan, Dan Lu, Deeksha Rastogi |
A weakly supervised framework for high-resolution crop yield forecasts Click to read abstractPredictor inputs and label data for crop yield forecasting are not always available at the same spatial resolution. We propose a deep learning framework that uses high resolution inputs and low resolution labels to produce crop yield forecasts for both spatial levels. The forecasting model is calibrated by weak supervision from low resolution crop area and yield statistics. We evaluated the framework by disaggregating regional yields in Europe from parent statistical regions to sub-regions for five countries (Germany, Spain, France, Hungary, Italy) and two crops (soft wheat and potatoes). Performance of weakly supervised models was compared with linear trend models and Gradient-Boosted Decision Trees (GBDT). Higher resolution crop yield forecasts are useful to policymakers and other stakeholders. Weakly supervised deep learning methods provide a way to produce such forecasts even in the absence of high resolution yield data. |
Dilli R Paudel, Diego Marcos, Allard de Wit, Hendrik Boogaard, Ioannis N Athanasiadis |
Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulator Click to read abstract Subsurface simulations use computational models to predict the flow of fluids (e.g., oil, water, gas) through porous media. These simulations are pivotal in industrial applications such as petroleum production, where fast and accurate models are needed for high-stake decision making, for example, for well placement optimization and field development planning. Classical finite difference numerical simulators require massive computational resources to model large-scale real-world reservoirs. Alternatively, streamline simulators and data-driven surrogate models are computationally more efficient by relying on approximate physics models, however they are insufficient to model complex reservoir dynamics at scale. |
Tailin Wu, Qinchen Wang, Yinan Zhang, Rex Ying, Kaidi Cao, Rok Sosic, Ridwan Jalali, Hassan Hamam, Marko Maucec, Jure Leskovec |
Practical Advances in Short-Term Spectral Wave Forecasting with SWRL Net Click to read abstractRapid, accurate wave forecasts are critical to coastal communities and nearshore research. Observational data assimilation improves predictive skill, but is difficult to implement in current adjoint variational systems. Machine learning offers an alternative. Here, a previously proposed framework SWRL Net (Mooneyham et al. 2020) is applied to an array of buoys along the U. S. West Coast to quantify the effect of training data size, determine the impacts of transfer learning using archived wave prediction hindcasts, and evaluate the potential skill on recent wave forecasts. Results across buoy locations show diminishing returns for training data sets greater than 5-years, with error reductions of 10-60%. Experiments trained with shorter (1-year) forecast records have higher error, but the application of transfer learning using wave hindcasts substantially improves model performance. |
Chloe Dawson, Noah Reneau, Brian Hutchinson, Sean Crosby |
FourCastNet: A Data-driven Model for High-resolution Weather Forecasts using Adaptive Fourier Neural Operators Click to read abstractFourCastNet, short for Fourier Forecasting Neural Network, is a global data-driven weather forecasting model that provides accurate short to medium-range global predictions at $0.25^{\circ}$ resolution. FourCastNet accurately forecasts high-resolution, fast-timescale variables such as the surface wind speed, precipitation, and atmospheric water vapor. It has important implications for planning wind energy resources, predicting extreme weather events such as tropical cyclones, extra-tropical cyclones, and atmospheric rivers. FourCastNet matches the forecasting accuracy of the ECMWF Integrated Forecasting System (IFS), a state-of-the-art Numerical Weather Prediction (NWP) model, at short lead times for large-scale variables, while outperforming IFS for variables with complex fine-scale structure, including precipitation. FourCastNet generates a week-long forecast in less than 2 seconds, orders of magnitude faster than IFS. The speed of FourCastNet enables the creation of rapid and inexpensive large-ensemble forecasts with thousands of ensemble-members for improving probabilistic forecasting. We discuss how data-driven deep learning models such as FourCastNet are a valuable addition to the meteorology toolkit to aid and augment NWP models. |
Jaideep Pathak, Shashank Subramanian, Peter Harrington, Sanjeev Raja, Ashesh K Chattopadhyay, Morteza Mardani, Thorsten Kurth, David M. Hall, Zongyi Li, Kamyar Azizzadenesheli, Pedram Hassanzadeh, Karthik Kashinath, Anima Anandkumar |
Learning latent representations for operational nitrogen response rate prediction Click to read abstractLearning latent representations has aided operational decision-making in several disciplines. Its advantages include uncovering hidden interactions in data and automating procedures which were performed manually in the past. Representation learning is also being adopted by earth and environmental sciences. However, there are still subfields that depend on manual feature engineering based on expert knowledge and the use of algorithms which do not utilize the latent space. Relying on those techniques can inhibit operational decision-making since they impose data constraints and inhibit automation. In this work, we adopt a case study for nitrogen response rate prediction and examine if representation learning can be used for operational use. We compare a Multilayer Perceptron, an Autoencoder, and a dual-head Autoencoder with a reference Random Forest model for nitrogen response rate prediction. To bring the predictions closer to an operational setting we assume absence of future weather data, and we are evaluating the models using error metrics and a domain-derived error threshold. The results show that learning latent representations can provide operational nitrogen response rate predictions by offering performance equal and sometimes better than the reference model. |
Christos Pylianidis, Ioannis N Athanasiadis |
Neural Operator with Regularity Structure for Modeling Dynamics Driven by SPDEs Click to read abstract Stochastic partial differential equations (SPDEs) are significant tools for modelling dynamics in many areas including atmospheric sciences and physics. |
Peiyan Hu, Qi Meng, Bingguang Chen, Shiqi Gong, Yue Wang, Wei Chen, Rongchan Zhu, Zhiming Ma, Tie-Yan Liu |
Hurricane Forecasting: A Novel Multimodal Machine Learning Approach Click to read abstractThis paper describes a novel machine learning (ML) framework for tropical cyclone intensity and track forecasting, combining multiple ML techniques and utilizing diverse data sources. Our multimodal framework, called Hurricast, efficiently combines spatial-temporal data with statistical data by extracting features with deep-learning encoder-decoder architectures and predicting with gradient-boosted trees. We evaluate our models in the North Atlantic and Eastern Pacific basins on 2016-2019 for 24-hour lead time track and intensity forecasts and show they achieve comparable mean absolute error to current operational forecast models while computing in seconds. Furthermore, the inclusion of Hurricast into an operational forecast consensus model could improve over the National Hurricane Center's official forecast, thus highlighting the complementary properties with existing approaches. In summary, our work demonstrates that utilizing machine learning techniques to combine different data sources can lead to new opportunities in tropical cyclone forecasting. |
Léonard Boussioux, Cynthia Zeng, Théo J Guenais, Dimitris Bertsimas |
GRASP EARTH: Intuitive Software for Discovering Changes on the Planet Click to read abstractDetecting changes on the Earth, such as urban development, deforestation, or natural disaster, is one of the research fields that is attracting a great deal of attention. One promising tool to solve these problems is satellite imagery. However, satellite images require huge amount of storage, therefore users required to set Area of Interests first, which was not suitable for detecting potential areas for disaster or development. To tackle with this problem, we develop the novel tool, namely GRASP EARTH, which is the simple application based on Google Earth Engine. GRASP EARTH allows us to handle satellite imagery easily and it has used for disaster monitoring and monitoring urban development. |
Waku Hatakeyama, Shiro Kawakita, Ryohei Izawa, Masanari Kimura |
Imbalance-Aware Learning for Deep Physics Modeling Click to read abstractIn various fields of natural science, there exists a high demand for accurate simulations of physical systems. For example, the weather forecasting requires a large-scale simulation of physical systems described by partial differential equations (PDEs). To reduce the computational cost, recent studies have attempted to build a coarse-grained model of the systems by using deep learning. Many training strategies for deep learning have developed for images or natural languages, but they are not necessarily suited for physical systems. A physical system demonstrates similar phenomena in most points (e.g., sunny days) but exhibits a drastic behavior occasionally (e.g., typhoons). Roughly speaking, a physical system dataset suffers from the class imbalance, whereas previous studies have rarely focused on this aspect. In this paper, we propose an imbalance-aware loss for learning physical systems, which resolves the class imbalance in a physical system dataset by focusing on the hard-to-learn parts. We evaluated the proposed loss using physical systems described by PDEs, namely the Cahn-Hilliard equation and the Korteweg-de Vries (KdV) equation. The experimental results demonstrate that models trained using the proposed loss outperform baseline models with a large margin. |
Takahito Yoshida, Takaharu Yaguchi, Takashi Matsubara |
Machine learning based surrogate modelling and parameter identification for wildfire forecasting Click to read abstractSimulating wildfire propagation in near real-time is difficult due to the high computational cost and inappropriate choices of physics parameters used in the forecasting models. In this work, we first proposed a data-model integration scheme for fire progression forecasting, that combines deep learning models: reduced-order modelling, recurrent neural network (Long-Short-Term Memory) and data assimilation techniques. Capable of integrating real-time satellite observations, the deep learning-based surrogate model run about 1000 times faster than the Cellular Automata model used to forecast wildfires in real world scenarios. We then addressed the bottleneck of efficient physics parameter estimation by developing a novel inverse approach, relying on data assimilation in a reduced order space. Both the fire prediction and the parameter estimation approaches are tested over recent massive wildfire events in California with satellite observation from MODIS and VIIRS to adjust the fire forecasting in near real-time. |
Sibo Cheng, Rossella Arcucci |
Machine Learning For Benthic Taxon Identification Click to read abstractWhere seabed substrate is rocky, comprising of bedrock, boulders and cobbles, sampling and analysis of benthic ecosystems often relies on still images and video from underwater cameras. Processing benthic imagery to generate ecosystem information typically involves manual interpretation and annotation, which is a time consuming and expensive process and prone to human errors and biases. Machine learning can step in here to assist, if not fully replace manual annotation. Here, we develop an object detection model using Faster R-CNN to identify various epibenthic species from a high energy marine site with a rocky substrate. The model achieves an overall F1-score of 66.28% across 7 different benthic species. The work is a significant step in identifying various learnings and challenges associated with data in non-ideal conditions and we suggest methods to further improve the existing framework. |
Aiswarya Vellappally, Mckenzie Love, Freya Watkins, Song Hou, Tim Jackson-Bue |
Interpretable Climate Change Modeling with Progressive Cascade Networks Click to read abstractTypical deep learning approaches to modeling high-dimensional data often result in complex models that do not easily reveal a new understanding of the data. Research in the deep learning field is very actively pursuing new methods to interpret deep neural networks and to reduce their complexity. An approach is described here that starts with linear models and incrementally adds complexity only as supported by the data. An application is shown in which models that map global temperature and precipitation to years are trained to investigate patterns associated with changes in climate. |
Charles Anderson, Jason Stock, David Anderson |
Conditional Emulation of Global Precipitation with Generative Adversarial Networks Click to read abstract Climate models encode our knowledge of the Earth system, enabling research on the earth’s future climate under alternative assumptions of how human-driven climate forcings, especially greenhouse gas emissions, will evolve. One important use of climate models is to estimate the impacts of climate change on natural and societal systems under these different possible futures. Unfortunately, running many simulations on existing models is extremely computationally expensive. |
Alexis Ayala, Chris Drazic, Seth Bassetti, Eric Slyman, Brenna Nieva, Piper Wolters, Kyle Bittner, Claudia Tebaldi, Ben Kravitz, Brian Hutchinson |
Deep Learning-Based Surrogate Modelling of Thermal Plumes for Shallow Subsurface Temperature Approximation Click to read abstractClimate control of buildings makes up a significant portion of global energy consumption, with groundwater heat pumps providing a suitable alternative. To prevent possibly negative interactions between heat pumps throughout a city, city planners have to optimize their layouts in the future. We develop a novel data-driven approach for building small-scale surrogates for modelling the thermal plumes generated by groundwater heat pumps in the surrounding subsurface water. Building on a data set generated from 2D numerical simulations, we train a convolutional neural network for predicting steady-state subsurface temperature fields from a given subsurface velocity field. We show that compared to existing models ours can capture more complex dynamics while still being quick to compute. The resulting surrogate is thus well-suited for interactive design tools by city planners. |
Raphael Leiteritz, Kyle Davis, Miriam Schulte, Dirk Pflüger |
Improving remote monitoring of carbon stock in tropical forests with machine learning, a case study in Indonesian Borneo Click to read abstractOne of the most effective approaches to mitigating climate change is to monitor the carbon stock in the tropical rainforests. However, biomonitoring of carbon in the forests is expensive and challenging due to inaccessibility. To improve carbon stock monitoring and the evaluation of fine-scale forest loss, we established a rapid, automatic, and cost-efficient generalized machine learning framework that uses diverse remote sensing data and satellite imagery to accurately estimate aboveground carbon density, at fine-grained resolution (tens of meters), in remote tropical rainforests. The study area first focused on rainforests in Indonesian Borneo. In our preliminary tests on 80 sites in Indonesian Borneo, our machine learning models were capable of producing ACD estimates with R2 of 0.7-0.8, which is a significant improvement from the comparable works (0.5-0.6 at best). This machine learning framework will be used to facilitate further carbon stock modeling in other forest regions (e.g. Brazil) as well as for the general purpose of climate change mitigation. |
Andrew Chamberlin, Krti Tallam, Zac Yung-Chun Liu, Giulio De Leo |
Development and Statistical Analysis of an Automated Meteor Detection Pipeline for GOES Weather Satellites Click to read abstractThe Geostationary Lightning Mapper (GLM) instrument onboard the GOES 16 and 17 weather satellites has been shown to be capable of detecting bolides (very bright meteors) in the Earth's atmosphere. Due to its large, continuous field of view and immediate public data availability, GLM provides a unique opportunity to detect a large variety of bolides, including those in the 0.1 to 3 m diameter range that complements current ground-based bolide detection systems, which are typically sensitive to smaller objects. Our goal is to generate a large catalog of calibrated bolide light curves to provide an unprecedented data set for three purposes: 1) to inform meteor entry models on how incoming bodies interact with the atmosphere, 2) to infer the pre-entry properties of the impacting bodies and 3) to statistically analyse bolide impact populations across the globe. We have deployed a machine learning based bolide detection and light curve generation pipeline on the NASA Advanced Supercomputer Facility. Detections are promptly published on a publicly available website, https://neo-bolide.ndc.nasa.gov. The pipeline has now been operational for almost 3 years and we have amassed a catalogue of over 3300 bolides. We first summarise the end-to-end development life cycle of the machine learning based bolide detection pipeline. We then present a statistical analysis of the bolides detected and assess the reliability of the automated detection pipeline. |
Jeffrey C Smith, Robert Morris, Randolph Longenbaugh, Alexandria Clark, Jessie Dotson, Nina McCurdy, Christopher Henze |
Inferring Antarctica’s Geology with a Variation of Information Inversion and Machine Learning Click to read abstractAntarctic geothermal heat flow has often been derived indirectly from geophysical data with assumptions about a simplified and undifferentiated lithosphere, which resulted in weakly constrained and inconsistent models. From other continents, we know that thermal parameters and heat flow can exhibit large spatial variations depending on geology and tectonic history. Combining gravity and magnetic data in a joint inversion approach yields information on the crustal structure of Wilkes Land, East Antarctica, and possible geological features become more evident. Both datasets are combined through a coupling method which increases the mutual information to get similar and statistically compatible inversion results. Therefore, we minimize data misfit and variation of information under the coupling constraint. The results show matching features of high magnitude density and susceptibility anomalies. Prominent structures are visible in NE – SW direction along the edge of the Mawson craton and at the presumed Australo-Antarctic and Indo-Antarctic terrane boundary. Applying the same method to Australia, formerly connected to Wilkes Land, we can exploit the much better-known geology there and identify coherent structures along the adjacent margins. The inverted parameter relationship between susceptibility and density can be used as input for machine learning techniques to define a spatially variable heat production map, which in turn would lead to improved heat flow estimates. For this, we rely on existing petrophysical and geochemical databases to correlate and confine thermal parameters with our results. |
Mareen Lösing, Max Moorkamp, Jörg Ebbing |
DRIFT-NCRN: A Benchmark Dataset For Drifter Trajectory Prediction Click to read abstractInfluenced by complex interactions at the intersection of air and water, the fate of objects floating in the ocean is difficult to predict even a few days into the future (DARPA-FFT, 2021). Despite the complexity of long-term drifter trajectory forecasting, accurate predictions are critically important for missions such as search and rescue, ecological studies, and disaster remediation. Inspired by the DARPA Forecasting Floats in Turbulence (FFT) Challenge (DARPA-FFT, 2021), we present an open-source machine learning benchmark dataset for measuring progress in ocean trajectory modeling based on a collation of drifter trajectories and archival weather and ocean forecasts. Given the recent success in deep generative models (Ravuri et al., 2021; Erichson et al., 2019; Sosanya & Greydanus, 2022) for forecasting physical processes, we hope that a formal dataset will enable further development of models tuned for the complexities of drifter trajectory forecasting. In addition to introducing benchmarks for drifter forecasting, we provide baseline solutions built off of OpenDrift (Dagestad et al., 2018) an open-source software package for modeling the fate of objects in the ocean or atmosphere. |
Johanna Hansen, Khalil Virji, Travis Manderson, David Meger, Gregory Dudek |
Detection of southern sea otters (Enhydra lutris nereis) from aerial imaging on the Monterey Peninsula Click to read abstractThe Southern sea otter (Enhydra lutris nereis) is a keystone predator and a protected marine mammal that inhabits the California coast and beyond. Current methods to study otters are expensive, inaccurate, and inefficient. To improve the use of resources for government officials, ecologists, and other researchers, we are proposing an auto-detection algorithm using drone aerial imagery as inputs. Using 842 images of sea otters from Monterey Bay and 1018 background images extracted from other open course oceanographic publications, we labeled, clustered, and augmented images to train YOLOv5 with a modified architecture for tiny objects. The resulting model with a 75% F1-score and 76% mAp_0.2:0.5. Future work includes adding background images from newly acquired datasets, using a GAN model to generate images, and using a two-stage detector to improve results. |
Margaret Daly |
APOGEE Net: An expanded spectral model of both low mass and high mass stars Click to read abstractWe train a convolutional neural network, APOGEE Net, to predict Teff, logg, and, for some stars, [Fe/H], based on the APOGEE spectra. This is the first pipeline adapted for these data that is capable of estimating these parameters in a self-consistent manner not only for low mass stars, (such as main sequence dwarfs, pre-main sequence stars, and red giants), but also high mass stars with Teff in excess of 50,000 K, including hot dwarfs and blue supergiants. The catalog of ~650,000 stars presented in this paper allows for a detailed investigation of the star forming history of not just the Milky Way, but also of the Magellanic clouds, as different type of objects tracing different parts of these galaxies can be more cleanly selected through their distinct placement in Teff-logg parameter space than in previous APOGEE catalogs produced through different pipelines. |
Dani Sprague, Connor Culhane, Marina Kounkel, Richard Olney, Kevin Covey, Brian Hutchinson |
A multi-modal representation of El Nino Southern Oscillation Diversity Click to read abstractThe most dominant mode of oceanic climate variability on an interdecadal scale is the El Ni~no Southern Oscillation (ENSO). ENSO events are characterized by anomalous sea surface temperatures (SSTs) in the equatorial Pacific affecting global climate, ecosystem, and society. The spatial structure and dynamics of SST fields associated to ENSO however show strong variability between different events, known as ENSO diversity. Whether this diversity consists of distinct types or merely a continuous process is to date an open question. Using Gaussian mixture variational autoencoders, we analyze the multi-modality of the non-linear low dimensional representation of SST anomalies in the tropical Pacific. We show that hard classification approaches are not suitable to describe ENSO diversity. Analyzing the low dimensional representations allows us to identify two main factors describing the spatial variability of ENSO, namely the average maximum temperature anomaly and the zonal gradient. We suggest a weighting of ENSO events based on these factors to yield more expressive composites that describe the variability of ENSO. |
Jakob Schlör, Bedartha Goswami |
Explaining Unsupervised Detections of Natural Hazards from Multispectral Satellite Image Time-Series Click to read abstract Data acquired by satellites with low revisit periods are crucial for detecting and tracking changes in land cover due to natural hazards globally and accelerating decision-making for disaster mitigation. The multispectral aspect of such datasets allows capturing rich information unique to a given type of change and can be viewed as a signature of the change, enabling its use for detecting and distinguishing changes. However, the large volume of such datasets and the variations in change types and their signatures necessitates the use of unsupervised approaches without prior knowledge of these signatures. Moreover, for assisting domain scientists and transparently informing hazard mitigation strategies, explaining these detections are also vital. |
Srija Chakraborty |
Geospatial Deep Learning Technique to Detect and Classify Geo-structure Failures in Mississippi Click to read abstractGeo-structures built on expansive clay, such as highway slopes in MS, are vulnerable to soil moisture variations and impacted by the increasing trend of high-intensity rainfall events. Early Identification of vulnerable or failing assets is crucial to strategize repairs and maintenance activities. Therefore, the first step of geotechnical asset management is to compile an inventory of the geostructures. Furthermore, frequent geo-structure health monitoring is crucial to avert risks and ensure asset longevity. Remote sensing-based infrastructure monitoring techniques have grown in popularity lately. However, identifying the vulnerable geostructures still requires boots on ground inspection. Such manual inspection after each weather event is expensive and impractical when quick action is needed. There is a need to automate the Geotechnical asset management methodology. To this end, this study used deep learning models integrated with ArcGIS Pro to detect and classify failed highway slopes in central MS. The failures studied included excessive deformations, shallow slides, sinkholes, etc. Training sample chips were first created by identifying failed slopes within Uncrewed Aerial Vehicle (UAV) based orthomosaic rasters and satellite imagery data. Comparative tests with different object detection and classification models with varying epochs were executed and documented. The results proved promising and assured capabilities of expanding the methodology to other infrastructure assets. The model can be run after each rainfall event to quickly spot any new slope instabilities. This innovative technology will ensure a quick inventory of failed and vulnerable geo-structures and help strategize maintenance and repair funds allocation. The geospatial deep learning methodology developed in this study is valuable for structural health monitoring and will help streamline Geotechnical Asset Management. |
Rakesh Salunke, Mohammad Sadik Khan |
Monitoring a High-Arctic food web from space with machine learning Click to read abstractLong-term monitoring of northern ecosystems is necessary to address the challenges posed by climate change and evolving human needs and stressors. Such efforts to survey wildlife in hostile and remote areas can however be hindered by several logistical challenges. A notable example is the lockdown imposed by COVID-19 in 2020-2021, which has had tremendous impacts on research activities, especially for long-term monitoring projects. This was particularly the case in the Canadian Arctic, where Northern authorities drastically restricted travel within and outside each territory. Gaps in time series can limit our understanding of ecosystem functioning and jeopardize our ability to detect population trends. To cope with such exceptional situations and limit the loss of data, alternative monitoring strategies should be explored. We propose a machine learning pipeline to monitor from space a High-Arctic food web composed of the Arctic fox, the Greater Snow Goose, the Snowy Owl, the brown lemming, and the collared lemming. We first trained a Faster R-CNN neural network model to detect snow geese on WorldView-3 satellite images of Bylot Island (Nunavut), home to the world's largest Greater Snow Goose breeding colony. A mean F1-score of >90% is achieved on all of the six vegetation types found in Bylot, which suggests that our model is able to generalize well over the entire study area. Our pipeline then leverages the structuring role of the Greater Snow Goose within the food web to infer some key parameters on the remaining species. Notably, we are able to infer snowy owls nest density and lemming abundance. We successfully validate each individual step of our monitoring pipeline by comparing our estimates with historical field data. To our knowledge, our approach is one of the first of its kind that effectively combines ecological knowledge with machine learning algorithms in order to obtain a method that could represent a realistic alternative to Arctic field work. |
Catherine Villeneuve, Éliane Duchesne, Marie-Christine Cadieux, Gilles Gauthier, Joël Bêty, Pierre Legagneux, Audrey Durand |
Atmosphere Session
All times are in PDT
| Start time | End time | Type | Title | Authors |
|---|---|---|---|---|
| 11:00 am | 11:05 am | -- | Introduction to Session | William Chapman |
| 11:05 am | 11:25 am | Featured Talk (20 min) | FourCastNet: A Data-driven Model for High-resolution Weather Forecasts using Adaptive Fourier Neural Operators Click to read abstractFourCastNet, short for Fourier Forecasting Neural Network, is a global data-driven weather forecasting model that provides accurate short to medium-range global predictions at $0.25^{\circ}$ resolution. FourCastNet accurately forecasts high-resolution, fast-timescale variables such as the surface wind speed, precipitation, and atmospheric water vapor. It has important implications for planning wind energy resources, predicting extreme weather events such as tropical cyclones, extra-tropical cyclones, and atmospheric rivers. FourCastNet matches the forecasting accuracy of the ECMWF Integrated Forecasting System (IFS), a state-of-the-art Numerical Weather Prediction (NWP) model, at short lead times for large-scale variables, while outperforming IFS for variables with complex fine-scale structure, including precipitation. FourCastNet generates a week-long forecast in less than 2 seconds, orders of magnitude faster than IFS. The speed of FourCastNet enables the creation of rapid and inexpensive large-ensemble forecasts with thousands of ensemble-members for improving probabilistic forecasting. We discuss how data-driven deep learning models such as FourCastNet are a valuable addition to the meteorology toolkit to aid and augment NWP models. |
Jaideep Pathak, Shashank Subramanian, Peter Harrington, Sanjeev Raja, Ashesh K Chattopadhyay, Morteza Mardani, Thorsten Kurth, David M. Hall, Zongyi Li, Kamyar Azizzadenesheli, Pedram Hassanzadeh, Karthik Kashinath, Anima Anandkumar |
| 11:25 am | 11:35 am | Regular Talk (10 min) | Street-Level Air Pollution Modelling with Graph Gaussian Processes Click to read abstractAccurately predicting air quality levels at a fine resolution is a critical task to ensuring the public's health is not at risk. In this work, we construct a graph representation of the road network in Mitcham, London, and model nitrogen dioxide levels using a Gaussian process defined on the vertices of our graph. We introduce a heteroscedastic noise process into our model to capture the complex variations that exist in nitrogen dioxide observations. Defining our model in this way offers superior predictive performance to its spatial analogue. Further, a graph representation allows us to infer the air pollution exposure that an individual would experience on a specific journey and their subsequent risk. We demonstrate this approach for the district of Mitcham, London. |
Thomas Pinder, Kathryn Turnbull, Christopher Nemeth, David S Leslie |
| 11:35 am | 11:45 am | Regular Talk (10 min) | Trainable Wavelet Neural Network for Non-Stationary Signals Click to read abstractThis work introduces a wavelet neural network to learn a filter-bank specialized to fit non-stationary signals and improve interpretability and performance for digital signal processing. The network uses a wavelet transform as the first layer of a neural network where the convolution is a parameterized function of the complex Morlet wavelet. Experimental results, on both simplified data and atmospheric gravity waves, show the network is quick to converge, generalizes well on noisy data, and outperforms standard network architectures. |
Jason Stock, Charles Anderson |
| 11:45 am | 11:55 am | Regular Talk (10 min) | Neural Operator with Regularity Structure for Modeling Dynamics Driven by SPDEs Click to read abstractStochastic partial differential equations (SPDEs) are significant tools for modelling dynamics in many areas including atmospheric sciences and physics. Neural Operators, generations of neural networks with capability of learning maps between infinite-dimensional spaces, are strong tools for solving parametric PDEs. However, they lack of ability to modeling stochastic PDEs which usually have poor regularity \footnote{Roughly speaking, regularity describes the smoothness of a function.} due to the driving noise. As the theory of regularity structure has achieved great successes in the analysis of SPDEs and provides the concept \emph{model} that well-approximate SPDEs' solutions, we propose the Neural Operator with Regularity Structure (NORS) which incorporates the models for modeling dynamics driven by SPDEs. We conduct experiments on various of SPDEs including the dynamic $\Phi^4_1$ model and the 2d stochastic Navier-Stokes equation, and the results demonstrate that the NORS is resolution-invariant, efficient, and can achieve one order of magnitude lower error with a modest amount of data. |
Peiyan Hu, Qi Meng, Bingguang Chen, Shiqi Gong, Yue Wang, Wei Chen, Rongchan Zhu, Zhiming Ma, Tie-Yan Liu |
| 11:55 am | 12:00 pm | Lightning Talk (5 min) | Convolutional autoencoders for spatially-informed ensemble post-processing Click to read abstractEnsemble weather predictions typically show systematic errors that have to be corrected via post-processing. Even state-of-the-art post-processing methods based on neural networks often solely rely on location-specific predictors that require an interpolation of the physical weather model's spatial forecast fields to the target locations. However, potentially useful predictability information contained in large-scale spatial structures within the input fields is potentially lost in this interpolation step. Therefore, we propose the use of convolutional autoencoders to learn compact representations of spatial input fields which can then be used to augment location-specific information as additional inputs to post-processing models. The benefits of including this spatial information is demonstrated in a case study of 2-m temperature forecasts at surface stations in Germany. |
Sebastian Lerch, Kai L Polsterer |
| 12:00 pm | 12:10 pm | Regular Talk (10 min) | Testing Interpretability Techniques for Deep Statistical Climate Downscaling Click to read abstractDeep Learning (DL) has recently emerged as a promising Empirical Statistical Downscaling perfect-prognosis technique (ESD-PP), to generate high-resolution fields from large-scale climate variables. Here, we analyze two state-of-the-art DL topologies for ESD-PP of different levels of complexity over North America. Besides classical validation leaning on accuracy metrics (e.g., Root Mean Squared Error (RMSE)), we evaluate several interpretability techniques to gain understanding on the inner functioning of the DL models deployed. Taking as reference the RMSE both topologies show similar values. Nonetheless, by analyzing the resulting interpretability maps, we find that the simplest model fails to capture a realistic physics-based input-output link, whilst the complex one describes a local pattern, characteristic of downscaling. In climate change scenarios, where weather extremes are exacerbated, erroneous patterns can lead to highly biased projections. Therefore, including interpretability techniques as a diagnostic of model functioning in the evaluation process can help us to better select and design them. |
Jose González-Abad, Jorge Baño-Medina, José Manuel Gutiérrez |
| 12:10 pm | 12:30 pm | Author Panel | Q&A Session | |
| 12:30 pm | 1:00 pm | Breakout Room | Atmosphere Session Networking Event |
Sensors and Sampling Session
All times are in PDT
| Start time | End time | Type | Title | Authors |
|---|---|---|---|---|
| 12:30 pm | 12:45 pm | Session Keynote Talk | Connecting With A Restored Wetland Via A Large-Scale Multimodal Sensor Deployment Click to read abstractStarting a decade ago, the Responsive Environments Group at the MIT Media Lab began to develop and deploy different types of sensors in a soon-to-be-retired cranberry bog in Plymouth MA. This grew into the backbone of the Tidmarsh Living Observatory, which streams data from over a hundred diverse sensors at what is now a MA Audubon Wildlife Sanctuary. This talk will overview the sensor infrastructure and describe several applications that we have built atop it that include machine learning for real-time wildlife identification, manifestation and interpretation of the data in a virtual ‘Digital Twin’ avatar landscape, dynamically separating audio from a dispersed microphone array into localized foreground and background representations, and new ’sensory enhancing' interfaces designed to augment the visitor experience. |
Joseph Paradiso Click to read bioJoe Paradiso is the Alexander W. Dreyfoos (1954) Professor in Media Arts and Sciences at the MIT Media Lab, where he directs the Responsive Environments group and serves as the associate academic head. He received his PhD in Physics from MIT in 1981 and a BSEE from Tufts University in 1977, and joined the Media Lab in 1994 after developing spacecraft control and diverse sensor systems at Draper Laboratory and high-energy physics detectors at ETH Zurich and CERN Geneva. Much of his current research explores how sensor networks augment and mediate human experience, interaction and perception. This encompasses wireless sensing systems, wearable and body sensor networks, energy harvesting and power management for embedded sensors, ubiquitous/pervasive computing and the Internet of Things, human-computer interfaces, virtual/augmented reality, space-based systems, and interactive music/media. He has written over 300 articles and papers in these areas. In his spare time, he enjoys designing/building electronic music synthesizers, composing electronic soundscapes, and seeking out edgy and unusual music while traveling the world |
| 12:45 pm | 12:50 pm | Session Keynote Talk | Q&A with Joseph Paradiso | Joseph Paradiso |
| 12:50 pm | 12:55 pm | Lightning Talk (5 min) | Meta-Learning and Self-Supervised Pretraining for Storm Event Imagery Translation Click to read abstractRecent advances in deep learning, in particular enabled by hardware advances and big data, have provided impressive results across a wide range of computational problems such as computer vision, natural language, or reinforcement learning. Many of these improvements are however constrained to problems with large-scale curated data-sets which require a lot of human labor to gather. Additionally, these models tend to generalize poorly under both slight distributional shifts and low-data regimes. In recent years, emerging fields such as meta-learning or self-supervised learning have been closing the gap between proof-of-concept results and real-life applications of machine learning by extending deep-learning to the semi-supervised and few-shot domains. We follow this line of work and explore spatio-temporal structure in a recently introduced image-to-image translation problem for storm event imagery in order to: i) formulate a novel multi-task few-shot image generation benchmark in the field of AI for Earth and Space Science and ii) explore data augmentations in contrastive pre-training for image translation downstream tasks. We present several baselines for the few-shot problem and discuss trade-offs between different approaches. |
Ileana Rugina, Rumen R Dangovski, Mark Veillette, Pooya Khorrami, Brian Cheung, Olga Simek, Marin Soljacic |
| 12:55 pm | 1:00 pm | Lightning Talk (5 min) | Reinforcement Learning State Estimation for High-Dimensional Nonlinear Systems Click to read abstractHigh-dimensional nonlinear systems such as atmospheric or oceanic flows present a computational challenge for data assimilation (DA) algorithms such as Kalman filters. A potential solution is to rely on a reduced-order model (ROM) of the dynamics. However, ROMs are prone to large errors, which negatively affects the accuracy of the resulting forecast. Here, we introduce the reinforcement learning reduced-order estimator (RL-ROE), a ROM-based data assimilation algorithm in which the correction term that takes in the measurement data is given by a nonlinear stochastic policy trained through reinforcement learning. The flexibility of the nonlinear policy enables the RL-ROE to compensate for errors of the ROM, while still taking advantage of the imperfect knowledge of the dynamics. We show that the trained RL-ROE is able to outperform a Kalman filter designed using the same ROM, and displays robust estimation performance with respect to different reference trajectories and initial state estimates. |
Saviz Mowlavi, Mouhacine Benosman, Saleh Nabi |
| 1:00 pm | 1:15 pm | Author Panel | Q&A Session | |
| 1:15 pm | 1:45 pm | Breakout Room | Sensors & Sampling Session Networking Event |
Hydrosphere Session
All times are in PDT
| Start time | End time | Type | Title | Authors |
|---|---|---|---|---|
| 1:30 pm | 1:40 pm | Regular Talk (10 min) | Learning Directed Structure for Multi-Output Gaussian Processes with the AcyGP Model Click to read abstractMulti-output Gaussian processes (MOGPs) have been widely used to model small geographic and oceanographic data sets, because of their ability to provide confidence estimates for predictions. Causal relationships in oceanographic data mean that certain variables are primarily influenced by a small number of others, but existing MOGPs learn correlations between outputs that are actually unrelated, leading to significantly reduced predictive accuracy. We introduce the AcyGP model, which composes latent GPs using a directed acyclic graph (DAG) structure that is learned from the data. The algorithm prevents spurious correlations by only introducing inter-output correlations when improvement in likelihood justifies the increase in structure complexity. Evaluation of the AcyGP model demonstrates state of the art predictive performance on real geographic and oceanographic data. |
Benjamin J Ayton, Richard Camilli, Brian C Williams |
| 1:40 pm | 1:50 pm | Regular Talk (10 min) | Multimodel Ensemble Predictions of Precipitation using Bayesian Neural Networks Click to read abstractMultimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN's superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification. |
Ming Fan, Dan Lu, Deeksha Rastogi |
| 1:50 pm | 1:55 pm | Lightning Talk (5 min) | Unsupervised Downscaling of Sea Surface Height with Deep Image Prior Click to read abstractOceanographic observations exist with different spatio-temporal resolutions and can be assimilated at various precision. The availability of numerous numerical simulations like ocean re-analysis make supervised machine learning appealing to deal with scale-related inverse problems. However data assimilation at finest resolutions using detailed oceanographic models is computationally intensive and building an exhaustive database may not be practical. Here we investigate the deep image prior method to downscale sea surface height observation and characterize estimation uncertainty in a fully-unsupervised manner. To do so, we set up a twin experiment using high resolution simulation from the NEMO Ocean engine and up-scale degraded data with multiple factors. Finally we give further perspectives of the method and make the link with data assimilation. |
Arthur Filoche, Théo Archambault, Dominique Béréziat, Anastase Charantonis |
| 1:55 pm | 2:00 pm | Lightning Talk (5 min) | Comparing Loss Representations for SAR Sea Ice Concentration Charting Click to read abstractSea ice charts, an important tool for navigation in the Arctic, are to this day manually drawn by professional ice analysts. The primary descriptor of the charts -- the Sea Ice Concentration (SIC) - indicates the ratio of ice to open-water in an area. Automating the SIC chart production is desired but the optimal representation of the corresponding machine learning task is ambivalent. Here, we explore it with either regressional or classification objective, each with two different (weighted) loss functions: Mean Square Error and Binary Cross-Entropy, and Categorical Cross-Entropy and the Earth Mover's Distance, respectively. While all perform well, the regression-based models achieve higher numerical similarity to the ground truth, whereas classification results in more visually pleasing and consistent charts. Weighting the loss functions improves the performance for intermediate classes at expense of open-water and fully-covered sea ice areas. |
Andrzej S Kucik, Andreas Stokholm |
| 2:00 pm | 2:05 pm | Lightning Talk (5 min) | Practical Advances in Short-Term Spectral Wave Forecasting with SWRL Net Click to read abstractRapid, accurate wave forecasts are critical to coastal communities and nearshore research. Observational data assimilation improves predictive skill, but is difficult to implement in current adjoint variational systems. Machine learning offers an alternative. Here, a previously proposed framework SWRL Net (Mooneyham et al. 2020) is applied to an array of buoys along the U. S. West Coast to quantify the effect of training data size, determine the impacts of transfer learning using archived wave prediction hindcasts, and evaluate the potential skill on recent wave forecasts. Results across buoy locations show diminishing returns for training data sets greater than 5-years, with error reductions of 10-60%. Experiments trained with shorter (1-year) forecast records have higher error, but the application of transfer learning using wave hindcasts substantially improves model performance. |
Chloe Dawson, Noah Reneau, Brian Hutchinson, Sean Crosby |
| 2:05 pm | 2:30 pm | Author Panel | Q&A Session | |
| 2:30 pm | 3:00 pm | Breakout Room | Hydrosphere Session Networking Event |
Paper only
Dissipative Hamiltonian Neural Networks: Learning Dissipative and Conservative Dynamics Separately, Samuel J Greydanus
Click to read abstract
Understanding natural symmetries is key to making sense of our complex and ever-changing world. Recent work has shown that neural networks can learn such symmetries directly from data using Hamiltonian Neural Networks (HNNs). But HNNs struggle when trained on datasets where energy is not conserved. In this paper, we ask whether it is possible to identify and decompose conservative and dissipative dynamics simultaneously. We propose Dissipative Hamiltonian Neural Networks (D-HNNs), which parameterize both a Hamiltonian and a Rayleigh dissipation function. Taken together, they represent an implicit Helmholtz decomposition which can separate dissipative effects such as friction from symmetries such as conservation of energy. We train our model to decompose a damped mass-spring system. Then we apply it to two real-world datasets including a large ocean current dataset where decomposing the velocity field yields scientific insights.
Ecology Session
All times are in PDT
| Start time | End time | Type | Title | Authors |
|---|---|---|---|---|
| 2:30 pm | 2:50 pm | Invited Talk (20 min) | Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning Click to read abstractI will summarize our work into automatically identifying, counting, and describing wild animals in camera-trap images with deep learning. The focus of the talk will be both on what has gone well in our efforts, as well as open challenges that, if we can solve, will dramatically improve our ability to study and conserve natural ecosystems and the animals within them. |
Jeff Clune |
| 2:50 pm | 3:00 pm | Regular Talk (10 min) | An interpretable machine learning model for advancing terrestrial ecosystem predictions Click to read abstractWe apply an interpretable Long Short-Term Memory (iLSTM) network for land-atmosphere carbon flux predictions based on time series observations of seven environmental variables. iLSTM enables interpretability of variable importance and variable-wise temporal importance to the prediction of targets by exploring internal network structures. The application results indicate that iLSTM not only improves prediction performance by capturing different dynamics of individual variables, but also reasonably interprets the different contribution of each variable to the target and its different temporal relevance to the target. This variable and temporal importance interpretation of iLSTM advances terrestrial ecosystem model development as well as our predictive understanding of the system. |
Dan Lu, Daniel Ricciuto, Siyan Liu |
| 3:00 pm | 3:05 pm | Lightning Talk (5 min) | A weakly supervised framework for high-resolution crop yield forecasts Click to read abstractPredictor inputs and label data for crop yield forecasting are not always available at the same spatial resolution. We propose a deep learning framework that uses high resolution inputs and low resolution labels to produce crop yield forecasts for both spatial levels. The forecasting model is calibrated by weak supervision from low resolution crop area and yield statistics. We evaluated the framework by disaggregating regional yields in Europe from parent statistical regions to sub-regions for five countries (Germany, Spain, France, Hungary, Italy) and two crops (soft wheat and potatoes). Performance of weakly supervised models was compared with linear trend models and Gradient-Boosted Decision Trees (GBDT). Higher resolution crop yield forecasts are useful to policymakers and other stakeholders. Weakly supervised deep learning methods provide a way to produce such forecasts even in the absence of high resolution yield data. |
Dilli R Paudel, Diego Marcos, Allard de Wit, Hendrik Boogaard, Ioannis N Athanasiadis |
| 3:05 pm | 3:10 pm | Lightning Talk (5 min) | Invertible neural networks for E3SM land model calibration and simulation Click to read abstractWe apply an invertible neural network (INN) for E3SM land model calibration and simulation with eight parameters at the Missouri Ozark AmeriFlux forest site. INN provides bijective (two-way) mappings between inputs and outputs, thus it can solve probabilistic inverse problems and forward approximations simultaneously. We demonstrate INN's inverse and forward capability in both synthetic and real-data applications. Results indicate that INN produces accurate parameter posterior distributions similar to Markov Chain Monte Carlo sampling and it generates model outputs close to the forward model simulations. Additionally, both the inverse and forward evaluations in INN are computationally efficient which allows for rapid integration of observations for parameter estimation and fast model predictions. |
Dan Lu, Daniel Ricciuto, Jiaxin Zhang |
| 3:10 pm | 3:30 pm | Author Panel | Q&A Session | |
| 3:30 pm | 4:00 pm | Breakout Room | Ecology Session Networking Event |
Panel Discussion
3:30 pm - 4:30 pm PDT
Topic: Model interpretability in the Earth and Space Sciences. We will discuss matters such as where the most promising and/or urgent Earth Science applications lie, what the current state-of-the-art is with regards to model interpretability, and where the field is heading. Audience members are welcome to ask questions via Rocket Chat our the AI for Earth Science Slack channel.
Panelists:
Leilani Gilpin: Leilani H. Gilpin is an Assistant Professor in the Department of Computer Science and Engineering at UC Santa Cruz. Her research focuses on the design and analysis of methods for autonomous systems to explain themselves. Her work has applications to robust decision-making, system debugging, and accountability. Her current work examines how generative models can be used in iterative XAI stress testing.
Andrew Ross: Dr. Ross is a postdoctoral fellow at NYU researching how to improve ocean and climate models with hopefully-interpretable ML methods, working under Laure Zanna as part of M²LInES. Previously, he did his PhD in interpretable ML at Harvard University with Finale Doshi-Velez.
Antonios Mamalakis: Dr. Mamalakis is a postdoctoral researcher at the Department of Atmospheric Science of Colorado State University, working with professors Imme Ebert-Uphoff and Elizabeth Barnes. His research focuses on the application of machine learning (ML) and ML interpretability methods to climate problems, on climate predictability and teleconnections, climate change impacts, and hydrology. Dr Mamalakis holds a PhD in Civil and Environmental Engineering from the University of California, Irvine, and a MSc and a diploma from the University of Patras, Greece.
Moderators:
Professor Karianne Bergen, Brown University
Dr. Natasha Dudek, McGill University and Mila