Python ETLHardofficialBenchmark eligiblepro
Stream a large CSV
pandas.read_csv() of the whole file is killed. Stream or chunk. Aggregates in the hidden tests must still match.
| Field | Detail |
|---|---|
| Creator | PipelineArena |
| Version | 2.0.0 |
| Time | 55 min |
| Scored checks | 15 |
Objective
Complete under the RSS cap; aggregates match; no full-frame read.
| # | Success condition |
|---|---|
| 1 | Peak RSS under the hidden cap |
| 2 | Group aggregates match |
| 3 | No single DataFrame of the full file |
| # | Visible instruction |
|---|---|
| 1 | Stream or read in chunks. |
| 2 | Write batches to Postgres. |
| 3 | Do not raise the container memory limit. |
Scoring checks the leftover tables or files, replay safety, and seeded variations — not the exact syntax you used. Check implementation is never shown to participants.
Signed-in workspace: Open in app