Core concept
Salting: add random prefix to skewed keys → split.
Advertisement
How it works
Silent perf killer. Long-running skewed tasks.
Advertisement
Trade-offs + gotchas
Detected via Spark UI task duration variance.
Salting: add random prefix to skewed keys → split.
Silent perf killer. Long-running skewed tasks.
Detected via Spark UI task duration variance.