Why Kafka is fast and durable: the log, zero-copy, batching and replication
Kafka isn't 'fast' in the low-latency sense; it's built for throughput: an append-only log with sequential I/O, zero-copy, writes to the page cache without fsync, cheap consumers thanks to offsets, client-side batching and compression, partitions and consumer groups. Then durability: replication, ISR, the high watermark, acks, min.insync.replicas and unclean leader election.