Open-source observability for Nextflow on your HPC cluster

Callisto Labs builds open tools for running bioinformatics workflows on on-premise clusters — Slurm, Apptainer, shared filesystems, air-gapped environments. Self-hosted, no cloud required, no vendor lock-in.

nf-prometheus

A Nextflow plugin that exports workflow and task metrics to Prometheus and Grafana — built HPC-first, with an export mode that needs no network connectivity from the head job at all.

Per-process scheduler queue wait — the number your login-node squeue never aggregates for you
Requested vs. used resources (CPUs, peak RSS) per process
Run status and task counts, live during the run
Three export modes: textfile collector (air-gapped friendly), Pushgateway (live), HTTP /metrics (classic scrape)
A ready-to-import Grafana dashboard, zero dependencies beyond the JDK, Apache 2.0

About

I'm Mario Callisto, a software engineer (JVM: Scala, Java, Groovy) working on tooling for scientific workflows on European on-premise HPC.

I'm open to remote software development collaborations around workflow tooling — plugins, integrations, monitoring.

Find me on GitHub, the Seqera community forum and nf-core Slack — or write to mario@callistolabs.eu.