Core concept

Rename cost on S3 (no true rename). Committer critical for correctness.

Advertisement

How it works

Default committer wrong on S3. Slow list ops.

Advertisement

Trade-offs + gotchas

Every Spark on S3 (AWS, cloud).