Data, Analysis, and Software in Heliophysics

DASH ran October 9-11, 2023 at JHU/APL in Laurel MD

This was the inaugural workshop for data science and software in Heliophysics.

DASH serves as a forum for scientists and software developers to present and discuss algorithms, software, and data systems used in the acquisition, reduction, analysis, and dissemination of data for Heliophysics, including space and ground-based measurements as well as models. The meeting connects practitioners across institutions, and international participation is key to success. All ranges of experience are welcome. The program contains invited and contributed talks (with virtual participation possible), as well as posters (in-person only). Presentations and posters are published in a Zenodo Community. Note that sessions aim to avoid 'death by powerpoint' and emphasize sharing and discussion. We are intending this meeting to become an annual event.

DASH ran October 9-11, followed by the co-located Oct 12-13 International Heliophysics Data Environment Alliance (IHDEA) annual meeting (see the IHDEA agenda) All talk videos and slides are referenced below. Attendees can still generate a DOI for their slides or posters via our Zenodo Collection instructions. We wish to thank NASA for funding DASH, and the NSF for providing travel stipends for people attending DASH.

The official sessions and schedule are below, including links to session descriptions and all media. The group photos are also available for both the onsite group photo and the online Zoom capture. For a summary of the meeting, we have a chatGPT summary of DASH.

"Schedule at a Glance"

Monday "Data"

Opening Plenary talks- Perspectives on the DASH Domain: Laura Hayes, Alisdair Davey, Baptiste Cecconi, Tai-Yin Huang
Cloud Computing for Heliophysics
Modern Data Pipeline Strategies
Data Access Interfaces and Services

Tuesday "Analysis"

Optimizing ML SWx Modeling and Forecasting through Improved Data Sets and Metrics
Computational notebooks in heliophysics
Interoperability between Python Packages (PyHC)
Unconference Topics 1, 2, & 3

Wednesday "Software"

Full Schedule with links to all media

Date	Time	Session #	Topic	Speaker	In Person / Virtual	Video recording	Slides	Title
Mon	9:20-9:30	P-intro	Welcome to DASH	Jon Vandegriff	onsite	DASH-000.mp4	via Zenodo	Welcome to DASH
Mon	9:30-9:45	P.01	Plenary 1	Laura Hayes	onsite	DASH-001.mp4	via Zenodo	Navigating Through the Maze of Heliophysics Data Diversity
Mon	9:45-10:00	P.02	Plenary 2	Alisdair Davey	virtual	DASH-002.mp4	via Zenodo	VSO / DKIST Perspectives on the DaSH environment
Mon	10:00-10:15	P.03	Plenary 3	Baptiste Cecconi	onsite	DASH-003.mp4	via Zenodo	Open Science Challenges in Heliophysics
Mon	10:15-10:30	P.04	Plenary 4: NSF	Tai-Yin Huang	onsite	DASH-004.mp4	local file	NSF 23-141: IOS Planning Workshops
Mon	10:30-11:00	Break
Mon	11:00-11:10	1.01	Cloud	William Fawcett	virtual	DASH-101.mp4	local file	A Scientific Cloud Computing Platform form Ingestion and Processing of SDO Data
Mon	11:10-11:20	1.02	Cloud	Christopher Jeschke	onsite	DASH-102.mp4	local file	HelioCloud: Infrastructure for big and open science
Mon	11:20-11:30	1.03	Cloud	Chris Pankratz	onsite	DASH-103.mp4	via Zenodo	Advancements in Space Weather Prediction Technologies (SWx TREC)
Mon	11:30-11:40	1.04	Cloud	Michael Wiltberger	onsite	DASH-104.mp4	via Zenodo	Tools for CGS Model Analysis and Cloud Based Accessibility
Mon	11:40-11:50	1.05	Cloud	Matthew Lesko	onsite	DASH-105.mp4	via Zenodo	CCMC: AWS Cloud Computing Successes and Challenges
Mon	11:50-12:00	1.06	Cloud	Umar Salman	onsite	DASH-106.mp4	via Zenodo	A Hybrid, Hybrid Appoach to Data Analysis Using Kubernetes and Cloud Technologies
Mon	12:00-12:10	1.07	Cloud	Bryan Harter	onsite	DASH-107.mp4	via Zenodo	Transitioning to the Cloud
Mon	12:10-12:30	Discussion	Cloud			DASH-199-QandA.mp4
Mon	12:30-2:00	(Lunch)
Mon	2:00-2:10	2.01	Pipelines	Alysa Derks	onsite	DASH-201.mp4	local file	Building Modern Data Pipelines for the World's Largest Solar Telescope
Mon	2:10-2:20	2.02	Pipelines	Chris Lowder	virtual	DASH-202.mp4	via Zenodo	Punchbowl: A Data Processing Pipeline from a 4-satellite constellation
Mon	2:20-2:30	2.03	Pipelines	Gabriel Dima	onsite	DASH-203.mp4	local file	From White Light to Ultraviolet (CCOR and SUVI)
Mon	2:30-2:40	2.04	Pipelines	Mike Shumko	onsite	DASH-204.mp4	local file	Unifying a Diverse Ecosystem of Auroral All-Sky Imager Data with aurora-asi-lib
Mon	2:40-2:50	2.05	Pipelines	Brad Trantham	onsite	DASH-205.mp4	via Zenodo	Building Next Generation Ground Data Software
Mon	2:50-3:30	Discussion	Pipelines			DASH-299-QandA.mp4
Mon	3:30-4:00	Break
Mon	4:00-4:05	3.01	Data Access	Mark Parsons	onsite	DASH-301.mp4	via Zenodo	How to (begin to) be FAIR
Mon	4:05-4:10	3.02	Data Access	Bob Weigel	onsite	DASH-302.mp4	local file	Heliophysics Data API (HAPI)
Mon	4:10-4:15	3.03	Data Access	Robert Candey	onsite	DASH-303.mp4	via Zenodo	Overview of the NASA CDAWeb data browsing
Mon	4:15-4:20	3.04	Data Access	Jonathan Paul Cook	onsite	DASH-304.mp4	via Zenodo	ESA Heliophysics Archives Interoperability and Data Access Enhancements
Mon	4:20-4:25	3.05	Data Access	Baptiste Cecconi	onsite	DASH-305.mp4	via Zenodo	Data Access Interfaces and Services (IVOA)
Mon	4:25-4:30	3.06	Data Access	Chris Lindholm	onsite	DASH-306.mp4	via Zenodo	LaTiS Middleware for Interoperable Data Access
Mon	4:30-4:35	3.07	Data Access	Alex Chartier	onsite	DASH-307.mp4	via Zenodo	FAIR Access to Heliophysics Data: SuperDARN Case Study
Mon	4:35-4:40	3.08	Data Access	Carrie Gonzalez	onsite	DASH-308.mp4	via Zenodo	Challenges in serving data using the HAPI Interface
Mon	4:40-4:45	3.09	Data Access	Christian Steigies	onsite	DASH-309.mp4	via Zenodo	NMDB data access challenges and capabilities
Mon	4:45-4:50	3.1	Data Access	Ryan McGranaghan	onsite	DASH-310.mp4	(no file available)	HelioWeb
Mon	4:50-5:30	Discussion	Data Access			DASH-399-QandA.mp4

Tue	9:00-9:06	4.01	ML	Eric Winter	onsite	DASH-401.mp4	local file	Physics-Informed Neural Networks for MHD
Tue	9:06-9:12	4.02	ML	Savvas Raptis	onsite	DASH-402.mp4	via Zenodo	Discovering patterns, imbalanced classification & boundary surfaces
Tue	9:12-9:18	4.03	ML	Yang Chen	virtual	DASH-403.mp4	via Zenodo	Statistical methods for solar flare prediction
Tue	9:18-9:24	4.04	ML	Ndifreke Nyah	virtual	DASH-404.mp4	local file	Bidirectional Learning of Multi-steps Temporal and Lag Sequence of Active Regions
Tue	9:24-9:30	4.05	ML	Paul Wright	virtual	DASH-405.mp4	via Zenodo	ARCAFF: Active Region Classification and Flare Forecasting
Tue	9:30-9:36	4.06	ML	Zhenguang Huang	onsite	DASH-406.mp4	via Zenodo	An Open-source Solar Wind Prediction Tool Based on MHD Simulations
Tue	9:36-9:42	4.07	ML	Jaime Landeros	onsite	DASH-407.mp4	via Zenodo	Research to Operation Visualization for WSA Coronal and Solar Wind Prediction
Tue	9:42-9:48	4.08	ML	Matthew Finley	onsite	DASH-408.mp4	via Zenodo	PCA and OC-SVMs for In-Situ Feature Extraction through Anomaly Detection
Tue	9:48-9:54	4.09	ML	Raphael Attie	onsite	DASH-409.mp4	local file	Finding the pixel in the haystack: brute-force versus ML-based approach
Tue	9:54-10:00	4.1	ML	Karin Muglach	onsite	DASH-410.mp4	local file	A Benchmark Data Set for Coronal Hole Detections
Tue	10:00-10:30	Discussion	ML			DASH-499-QandA.mp4
Tue	10:30-11:00	Break
Tue	11:00-11:15	5.01	Notebooks	Shawn Polson	onsite	DASH-501.mp4	local file	Lessons Learned Publishing the First Executable Paper in Heliophysics
Tue	11:15-11:30	5.02	Notebooks	Jack Wang	onsite	DASH-502.mp4	local file	Assessment of thermospheric models in NASA/CCMC ecosystem
Tue	11:30-11:45	5.03	Notebooks	Eric Grimes	onsite	DASH-503.mp4	local	Computational Notebooks for accessing and analyzing data at the SPDF
Tue	11:45-12:00	5.04	Notebooks	Jan Gieseler	onsite	DASH-504.mp4	via Zenodo	Providing Tools for the Analysis of SEPs from Jupyter Notebooks - SERPENTINE
Tue	12:00-12:03	5.05	Notebooks	Min-Yang Chou	onsite	DASH-505.mp4	local file	NASA CCMC Model Validation Efforts Towards Open Science
Tue	12:03-12:30	Discussion	Notebooks			DASH-599-QandA.mp4
Tue	12:30-2:00	lunch
Tue	2:00-2:04	6-intro	PyHC
Tue	2:04-2:12	6.02	PyHC	Marcus Hughes	onsite	DASH-602.mp4	via Zenodo	Interoperability of PUNCH software in the Python ecosystem
Tue	2:12-2:20	6.03	PyHC	Jim Lewis	onsite	DASH-603.mp4	via Zenodo	PySPEDAS, AstroPy, and coordinate transforms
Tue	2:20-2:26	6.04	PyHC	Albert Shih	onsite	DASH-604.mp4	via Zenodo	The SunPy coordinates framework
Tue	2:26-2:32	6.05	PyHC	Angeline Burrell	onsite	DASH-605.mp4	local file	Geomagnetic Coordinate Systems
Tue	2:32-2:38	6.06	PyHC	Bob Weigel	onsite	DASH-606.mp4	Zenodo DOI	hyform and Coordinate Transform Standards
Tue	2:38-2:46	6.07	PyHC	Jonathan Niehof	onsite	DASH-606.mp4	via Zenodo	SpacePy Coordiante Transformations
Tue	2:46-3:30	Discussion	PyHC			DASH-699-QandA.mp4
Tue	3:30-4:00	Break
Tue	4:00-5:30	Unconference 1	Broadening participation in open source projects			DASH-U001.mp4
Tue	4:00-5:30	Unconference 2	Sharing code and results			DASH-U002.mp4
Tue	4:00-5:30	Unconference 3	Collecting links to open-source data/tools/etc

Wed	9:00-9:10	7	Open Source	Short Posters		DASH-700.mp4	local file	Helionauts; HERMES; HelioSwarm; Sunxspex; ARTS web interface
Wed	9:10-9:20	7.01	Open Source	Damian Barrous-Dume	virtual	DASH-701.mp4	via Zenodo	Open Science in Action: SWxSOC's Role
Wed	9:20-9:30	7.02	Open Source	Christopher Bard	onsite	DASH-702.mp4	via Zenodo	MARBLE: How to make an open science global magnetospheric code?
Wed	9:30-9:40	7.03	Open Source	Chiu Wiegand	onsite	DASH-703.mp4	via Zenodo	Open-Source Process and Experience at NASA, the CCMC Story
Wed	9:40-9:50	7.04	Open Source	Rebecca Ringuette	onsite	DASH-704.mp4	via Zenodo	Open Source Software in the Spectrum of Open Science
Wed	9:50-10:00	7.05	Open Source	Josh Steele	onsite	DASH-705.mp4	via Zenodo	Pushing into Open Science at APL
Wed	10:00-10:30	7-discussion	Open Source			DASH-799-QandA.mp4
Wed	9:00-9:02	8-intro
Wed	9:02-9:09	8.01	Portals	Robert Candey	onsite	DASH-801.mp4	via Zenodo	Comparisons: Science Discovery Engine (SDE)
Wed	9:09-9:16	8.02	Portals	Eric Donovan	onsite	DASH-802.mp4	(no file available)	Swarm-Aurora & AuroraX
Wed	9:16-9:23	8.03	Portals	Eelco Doornbos	virtual	DASH-803.mp4	via Zenodo	Space Weather Timeline Viewer
Wed	9:23-9:30	8.04	Portals	Giuseppe Romeo	virtual	DASH-804.mp4	(no file available)	Multi-Mission 3D Orbit Plotter
Wed	9:30-9:37	8.05	Portals	Masha Kuznetsova	onsite	DASH-805.mp4	(no file available)	CCMC: A Portal to Modeling Capbilities in Heliophysics Community
Wed	9:37-9:44	8.06	Portals	Lutz Rastaetter	onsite	DASH-806.mp4	(no file available)	Interactive Framework to Support Open Model-Data Validation Efforts at the CCMC
Wed	9:44-9:51	8.07	Portals	Ryan McGranaghan	onsite	DASH-807.mp4	(no file available)	The simplicity on the other side of complexity
Wed	9:51-10:30	8-discussion	Portals			DASH-899-QandA.mp4
Wed	9:00-9:10	9.01	Corona	Gabe Dima	onsite	DASH-901.mp4	(no file available)
Wed	9:10-9:35	9.02-9.13	Corona
Wed	9:35-10:30
Wed	10:30-11:00	Break
Wed	11:00-12:30	Wrapup and Conclusions				DASH-999WrapUp.mp4

We look forward to seeing you at DASH 2024!

Point of contact: jon.vandegriff@jhuapl.edu. Logistics: Both DASH and IHDEA were be held on the APL campus in Laurel, MD in Building 201 (directions here). You can also access the original 2023 DASH announcement.