Forge
Active Development
Forge: Forge is a local-first execution engine for declarative data pipelines. It reads bounded CSV files and cursor-paginated REST APIs, processes records in batches, and writes them to PostgreSQL. Pipeline versions are immutable, while execution state, checkpoints, and batch receipts are stored durably. If a worker stops after PostgreSQL commits a batch but before the control checkpoint advances, the next worker reconciles the stored receipt before continuing.
Forge validates each manifest before publication and stores it as an immutable version with a checksum. Each execution therefore runs from the exact definition it was created with.