FONDA Spark filesystem word count
Workflow
Overview
FONDA Responsible researcher
- Soeren Becker Alumni
subproject
- S1: Testbeds and Repositories Subproject
Run Metadata
workflow runs
Reproducibility
workflow code link
input datasets used
trace types
- Spark event log, Kubernetes object snapshots and pod logs, Prometheus resource metrics, Kepler energy counters, checksums, and output validation
trace data format
- JSON Lines, JSON, plain text, Kubernetes YAML, and Turtle
Execution Environment
workflow engine
- Apache Spark Workflow Engine
language
- Python Language
compute cluster
- FONDA Cluster Compute Cluster
backend
- Kubernetes Backend