Core concept

Channels (memory, file, Kafka) buffer between source + sink. Fault tolerance built in.

Advertisement

How it works

Overtaken by Kafka + Kafka Connect. Flume less flexible + slower to evolve.

Advertisement

Trade-offs + gotchas

Legacy log pipelines. Simple file-to-HDFS forwarding.