ESG4Stars project launched

On October 5-6, the ESG4Stars project was launched. ESG4stars aims to reduce the environmental impact of research infrastructures.

The kick-off meeting and the project’s first General Assembly was a combined event on Monday and Tuesday, then used the remaining three days of the week to directly start working on the first project tasks.

Kick-off meeting

The kick-off meeting started with in-person presentations for all work streams (Community, Data, Compute) and packages within the project.

These spawned immediate and productive discussions within and across work streams, and it was great to see a lot of interaction between project participants from the first day!

ESG4Stars goals

Day 2 of the meeting brought invited guest presentations about topics adjacent to what this project is trying to do:

• Dominik Schweisgut from the Exascale Algorithm Engineering research group at the Karlsruhe Institute of Technology (KIT) told us about “Carbon-Aware Mapping and Scheduling for Deadline-Constrained Workflows”.
• Philipp Thamm from the research group Knowledge Management in Bioinformatics at the Humboldt-Universität zu Berlin gave a talk about his work on “Nf-PEAK: Process-Based Energy Attribution for Nextflow Workflows on Kubernetes Clusters”.
• Joachim Wolff, bioinformatics researcher at Hannover Medical School, talked about his experience with “Agent-Driven Modernization of High-Throughput Genomic Tools”.

Both Dominik and Philipp are members of FONDA, a research programme (CRC 1404) for studying “Foundations of Workflows for Large-Scale Scientific Data Analysis” funded by the Deutsche Forschungsgemeinschaft. 

Collaborative working days

The three remaining days of the week were meant to give project participants the chance to start work in the different streams directly and with face-to-face collaboration. They turned out to be very intense and productive days that yielded progress across all project streams, and helped all participants to find their place in the project and to define how they want to work together.

Here’s an incomplete list of what was done over the three days:

• set up an ESG4Stars project board to facilitate further collaboration and add some first issues to it
• define queries to extract tool-specific compute and memory metrics from Galaxy server databases
• use these queries to produce preliminary lists of tools that could be prime targets for optimisation. A so-called hotspots catalogue of tools to optimise is among the first milestones the project aims to achieve and a prerequisite for a lot of further planned work. It was, therefore, encouraging to see that even the preliminary version appears to identify real efficiency bottlenecks that also seem to be suitable for substantial optimization.
• advance work on Galaxy’s job cache
• discuss some of the complexities around offering temporary storage classes on Galaxy instances that don’t offer any yet
• better define the needs of the bioimaging community, in particular, in terms of Galaxy’s support for the Zarr data format
• release a first version of a new energy usage dashboard for Galaxy Europe’s compute
• do some first outreach by advertising our upcoming workshop on sustainable research computing with Galaxy

At this impressive speed of progress, we are looking ahead with a lot of confidence to the coming 36 months of this project and to everything we can achieve together.

A really big THANK YOU to all participants for making this possible!