Core concept

spark.sql("ANALYZE TABLE t COMPUTE STATISTICS FOR ALL COLUMNS")
Advertisement

How it works

Stats stale after big data changes.

Advertisement

Trade-offs + gotchas

Multi-way join queries.