Python ETLHardofficialBenchmark eligiblepro
Stream a large CSV
pandas.read_csv() of the whole file is killed. Stream or chunk. Aggregates in the hidden tests must still match.
| Field | Detail |
|---|---|
| Creator | PipelineArena · expert |
| Version | 2.0.0 |
| Time | 55 min |
| Credits | 6 |
| Completion | 0% · 0.0 rating |
| Hidden tests | 3 |
Objective
Complete under the RSS cap; aggregates match; no full-frame read.
| # | Success condition |
|---|---|
| 1 | Peak RSS under the hidden cap |
| 2 | Group aggregates match |
| 3 | No single DataFrame of the full file |
| # | Visible instruction |
|---|---|
| 1 | Stream or read in chunks. |
| 2 | Write batches to Postgres. |
| 3 | Do not raise the container memory limit. |
Hidden tests score the final tables or files, not the exact syntax you used. Test implementation is never shown to participants.
Signed-in workspace: Open in app