Core concept

df.selectExpr("user.name", "tags[0]", "explode(items) as item")
Advertisement

How it works

Nested pushdown improving. Perf varies.

Advertisement

Trade-offs + gotchas

JSON-shaped data. Denormalized nested schemas.