Core concept

Sort-based shuffle default. Push-based shuffle in 3.2+ (server-side merging).

Advertisement

How it works

Shuffle is #1 perf killer. Skew makes worse.

Advertisement

Trade-offs + gotchas

Every job with wide deps.