Data and Artifacts¶

The pipeline works with two categories of data: experiment data (input configurations that define what to simulate) and artifacts (intermediate and final files produced by each stage).

• Experiment Data: Repository structure, configuration files, and how data is sourced in cloud vs local mode
• Pipeline Artifacts: Builder, runner, and output artifacts with schema details

Next Steps¶

• Pipeline Stages: How each stage processes data
• Execution Modes: Cloud vs local data sourcing
• Storage Abstraction: Storage API details