On the Fly and On the Flight: Scientific Data Analysis Beyond the Beamline @PyConAU
On the Fly and On the Flight: Scientific Data Analysis Beyond the Beamline  @PyConAU
Uploaded September 2025 | Updated September 2026, 6 minutes ago
(Melanie Hampel) At synchrotron facilities, researchers use high-energy X-rays to uncover the structure and chemistry of materials — from batteries to biological systems. These experiments generate vast amounts of complex, high-dimensional data, and scientists need flexible tools, interactive exploration, and smart automation to make sense of it all. In this talk, we present a Python-based data processing suite designed to support X-ray spectroscopy workflows: from generating immediate data products to inform critical decisions during limited beamtime, to in-depth reprocessing off-site — or even offline.

The suite is built around a processing library that uses `xarray` for intuitive multi-dimensional data handling and provides reproducible, transparent analysis pipelines via command-line tools and Jupyter notebooks for coding-affine users. It also includes a `PyQt`-based desktop GUI that enables domain scientists to interactively explore their data and fine-tune processing steps without the need for prior programming experience.

We'll explore how Python libraries like `xarray`, `pyqtgraph`, and `typer` take the processing of raw experimental data from low-level wrangling in multiple dimensions to high-level exploration in intuitive interfaces. By providing different levels of balance between automation and user control we enable scientists with all levels of programming experience to create insightful datasets — whether they're at the beamline, back at their home institution, or already on the plane to the next conference.

pretalx.com/pycon-au-2025/talk/7BZ8PQ

python, pycon, australia, programming, conference, technical, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science

Videos licensed as CC-BY-NC-SA 4.0

PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python.

Licensed as CC BY-NC-SA - creativecommons.org/licenses/by-nc-sa/4.0

Produced by Next Day Video Australia: https://nextdayvideo.com.au

Fri Sep 12 11:40:00 2025 at Ballroom 2
On the Fly and On the Flight: Scientific Data Analysis Beyond the BeamlineTransitioning from VB to Python – Mapping a 6 month journeyThe Neurospicy Toolbox: A Guide for Educators - Maddie Mackey (PyCon AU 2026)Vibe-Check Your Vibe Code: Surviving the Era of Agentic Open Source DependenciesWalking the Tree of Life – Adventures in Phylogenetics - Jack Reichelt (Pycon AU 2024)Your Python container is 90% stuff you didnt ask for - Scott Norris (PyCon AU 2026)Data & AI Track Opening - Nic Crouch, Jack Skinner (PyCon AU 2025)MicroPython: The best bits! - Matt Trentini (Pycon AU 2024)Explore, annotate, and analyse multidimensional image data with napariThe 20-Year Port: from PhD project to polished professional Python packagingReducing the Oops Factor: Pipelines for a Secure Python Development LifecycleFrom On-Prem to the Cloud and Back Again - Luke (PyCon AU 2026)
PyCon AU |

On the Fly and On the Flight: Scientific Data Analysis Beyond the Beamline

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER