Core concept

Ephemeral compute clusters read/write persistent object storage. Cheap + elastic.

Advertisement

How it works

Object storage latency higher. Rename cost (S3 has no rename). Committer choice critical.

Advertisement

Trade-offs + gotchas

All cloud Hadoop. Storage-compute separation.