Python ETLMediumofficialBenchmark eligiblepro
Incremental upsert and deletes
The job uses MAX(updated_at) incorrectly and ignores deletions. Target must match source after insert/update/delete batches. Checkpoint only after commit.
| Field | Detail |
|---|---|
| Creator | PipelineArena |
| Version | 2.0.0 |
| Time | 50 min |
| Scored checks | 12 |
Objective
Target equals source after two ticks; deletes propagate; second empty run is a no-op.
| # | Success condition |
|---|---|
| 1 | Deletes applied |
| 2 | Unchanged rows not duplicated |
| 3 | Checkpoint advances only after commit |
| 4 | Empty second run: identical checksum |
| # | Visible instruction |
|---|---|
| 1 | Read checkpoint.json and the two extract ticks. |
| 2 | Apply inserts/updates/deletes. |
| 3 | Write checkpoint after a successful transaction. |
Scoring checks the leftover tables or files, replay safety, and seeded variations — not the exact syntax you used. Check implementation is never shown to participants.
Signed-in workspace: Open in app