Core concept

foreachBatch for arbitrary write logic per micro-batch.

Advertisement

How it works

Exactly-once semantics via idempotent sinks + checkpointing.

Advertisement

Trade-offs + gotchas

Every streaming job needs sink.