Core concept

case class Person(name: String, age: Int)
val ds: Dataset[Person] = df.as[Person]
Advertisement

How it works

Case class encoding cost. Some perf overhead vs DataFrame.

Advertisement

Trade-offs + gotchas

Scala + type safety. Domain models.