Why it matters
MLlib is legacy but you'll encounter it. Understanding shapes reading old code.
Advertisement
The architecture
RDD-based: uses old RDD API.
Superseded by spark.ml.
Advertisement
How it works end to end
Some MLlib features not in spark.ml.
Interop: MLlib RDD ↔ spark.ml DataFrame conversion.
Migration: incremental to spark.ml.