System Design

System Design

Rate limiters, circuit breakers, sharding, real-system blueprints.

99Articles
99Topics covered
Articles in this category

All 99 articles, sorted alphabetically

Advertisement
ARTICLE · 01

System Design: Rate Limiting

Read article
ARTICLE · 02

System Design: Circuit Breaker Pattern - AICassindra

Deep dive into the Circuit Breaker pattern for building resilient distributed systems.

Read article
ARTICLE · 03

Bloom Filters

Bloom Filters

Read article
ARTICLE · 04

The Saga Pattern: Managing Distributed Transactions

The Saga Pattern: Managing Distributed Transactions

Read article
ARTICLE · 05

System Design: Load Balancing - AICassindra

Deep dive into Load Balancing strategies, algorithms, and implementation patterns in distributed systems.

Read article
ARTICLE · 06

Airbnb Architecture

How Airbnb runs search, availability, pricing, and payments across 6M+ listings.

Read article
ARTICLE · 07

Airbnb Smart Pricing Architecture

The ML system that suggests nightly prices to hosts across millions of listings.

Read article
ARTICLE · 08

Alipay Super-App Architecture

China's other super-app: mobile payments + credit + wealth management at 1.3B users.

Read article
ARTICLE · 09

Amazon Shopping Cart Architecture

How Amazon keeps carts consistent across sessions, devices, and unavailable items.

Read article
ARTICLE · 10

API Gateway Architecture

The gateway pattern: single entry for many services + built-in auth, rate-limit, transform.

Read article
ARTICLE · 11

API Gateway Patterns

Backend for Frontend, response aggregation, and cross-cutting concerns at the edge.

Read article
ARTICLE · 12

API Versioning Strategies

How to evolve APIs without breaking existing clients.

Read article
ARTICLE · 13

ATM End-to-End Architecture

From card insertion to cash dispense: every service, network hop, and reconciliation step.

Read article
ARTICLE · 14

Autocomplete / Typeahead Architecture

Prefix trees, ranking, and sub-100ms latency for search suggestions.

Read article
ARTICLE · 15

Bulkhead Pattern

How to prevent one slow service from starving all thread pools.

Read article
ARTICLE · 16

Cache Aside vs Write-Through vs Write-Behind

The three cache-integration patterns, when each wins, and their consistency tradeoffs.

Read article
ARTICLE · 17

Cache Invalidation Strategies

TTL, write-through invalidation, versioning, and pub/sub. Trade freshness vs load.

Read article
ARTICLE · 18

Cache Stampede Prevention

The problem: hot key expires, 1000 concurrent requests slam the DB. Three solutions.

Read article
ARTICLE · 19

CDN Architecture

How content delivery networks minimize latency by caching close to users.

Read article
ARTICLE · 20

CDN Cache Hierarchy

Multi-tier caching that turns global content into local responses.

Read article
ARTICLE · 21

CDN Architecture

How a modern CDN uses anycast + edge compute to serve billions of requests globally.

Read article
ARTICLE · 22

Circuit Breaker Pattern

The three states + how to configure for your traffic + failure profile.

Read article
ARTICLE · 23

CQRS + Event Sourcing Architecture

Split writes (commands) from reads (queries), persist events instead of state.

Read article
ARTICLE · 24

Credit Card Payment Flow Architecture

The complete authorization + capture + settlement flow across acquirer, network, and issuer.

Read article
ARTICLE · 25

Database Sharding Architecture

How to split a table across N databases, with routing + rebalancing.

Read article
ARTICLE · 26

Designing a Real-Time Chat System (1M concurrent users)

End-to-end architecture for a WhatsApp-scale chat system, from connection layer to message storage.

Read article
ARTICLE · 27

Designing an API Gateway

Routing auth rate-limit observability in one tier.

Read article
ARTICLE · 28

Designing a Distributed Cache (Memcached/Redis-style)

Consistent hashing replication and eviction policies.

Read article
ARTICLE · 29

Designing an Event-Driven Order System

State machine, idempotency, and the recovery story.

Read article
ARTICLE · 30

Designing a Feature Flag System

Targeting, rollout, kill switch, and audit.

Read article
ARTICLE · 31

Designing a File Upload Service (S3-style)

Resumable uploads multipart deduplication and lifecycle policies.

Read article
ARTICLE · 32

Designing a Metrics Aggregation System

Time-series ingest pre-aggregation and downsampling.

Read article
ARTICLE · 33

Designing a Notification Service

Push email SMS multi-channel fan-out with retries.

Read article
ARTICLE · 34

Designing a Payment System

Idempotency keys ledger reconciliation and PCI scope.

Read article
ARTICLE · 35

Designing a Quota System

Token bucket, sliding window, distributed counters.

Read article
ARTICLE · 36

Designing Search at Scale

Inverted index, ranking, freshness, personalization.

Read article
ARTICLE · 37

Designing Search Autocomplete

Trie-based prefix matching with personalization.

Read article
ARTICLE · 38

Designing Uber Dispatch System

Geo-indexing matchmaking and surge pricing.

Read article
ARTICLE · 39

Designing a URL Shortener (TinyURL-scale)

Hashing collision strategies database choice and analytics.

Read article
ARTICLE · 40

Designing YouTube Recommendation Ranking

Two-tower retrieval candidate generation and learning-to-rank.

Read article
ARTICLE · 41

Directory-Based Sharding

Explicit key-to-shard mappings for maximum flexibility and per-tenant isolation.

Read article
ARTICLE · 42

Discord Architecture

How Discord handles millions of concurrent voice channels + huge text servers with low latency.

Read article
ARTICLE · 43

Distributed Cache Architecture

How a horizontally-scaled cache handles millions of keys across N nodes, with the resharding strategy.

Read article
ARTICLE · 44

Distributed Cache Consistency Models

Strong vs eventual consistency options for distributed caches, with fault behavior.

Read article
ARTICLE · 45

DNS System Architecture

The distributed lookup system that turns names into IPs, with caching + zone hierarchy.

Read article
ARTICLE · 46

DoorDash Architecture

How DoorDash coordinates customers, restaurants, and Dashers with real-time dispatch.

Read article
ARTICLE · 47

Dropbox File Sync Architecture

How Dropbox syncs files across devices with delta sync + block-level dedup.

Read article
ARTICLE · 48

Elasticsearch Cluster Architecture

How Elasticsearch distributes an index across nodes with sharding + replication.

Read article
ARTICLE · 49

Email Delivery Architecture

How email gets from sender to recipient through anti-spam gauntlets.

Read article
ARTICLE · 50

Event-Driven Microservices Architecture

How services communicate via events instead of synchronous calls, with the failure modes.

Read article
ARTICLE · 51

Facebook Messenger Architecture

Meta's messenger stack: MySQL-derived TAO + custom binary protocol + optional Signal E2E.

Read article
ARTICLE · 52

Real-Time Fraud Detection System Architecture

How payment platforms score millions of transactions/second in under 100ms.

Read article
ARTICLE · 53

Geo-Partitioning

Sharding by geography for compliance + user latency wins.

Read article
ARTICLE · 54

Google Drive + Docs Real-Time Collaboration Architecture

Operational Transformation and CRDTs behind multi-user document editing.

Read article
ARTICLE · 55

Google Maps Real-Time Traffic Architecture

How aggregated GPS pings from billions of phones become live traffic overlays.

Read article
ARTICLE · 56

Google Search Architecture

How Google indexes 100B+ pages and returns relevant results in <200ms.

Read article
ARTICLE · 57

Grab Architecture

Grab's evolution from ride-hailing to rides + food + payments + more across 8 countries.

Read article
ARTICLE · 58

GraphQL Architecture

Query language, resolvers, N+1 problem, and DataLoader patterns.

Read article
ARTICLE · 59

gRPC + Protobuf Architecture

How gRPC delivers 10x smaller payloads and streaming across languages.

Read article
ARTICLE · 60

Hash Sharding

Hash-based sharding: mechanics, hotspot avoidance, rebalancing tradeoffs.

Read article
ARTICLE · 61

iCloud Sync Architecture

How Apple keeps notes, photos, contacts, and messages in sync across every Apple device.

Read article
ARTICLE · 62

Idempotency Key Pattern

How idempotency keys enable safe retries without duplicate charges or double-writes.

Read article
ARTICLE · 63

iMessage Architecture

How iMessage delivers end-to-end encrypted messages across Apple devices using APNs + cloud sync.

Read article
ARTICLE · 64

Instagram Feed Generation Architecture

Photo + video feed with ranking, stories, and reels at Facebook-scale infrastructure.

Read article
ARTICLE · 65

Kafka Partition Architecture

How Kafka's partition model scales throughput and delivers ordered messages within a key.

Read article
ARTICLE · 66

L4 vs L7 Load Balancer Architecture

Where each operates in the stack, decision points, and when to use which.

Read article
ARTICLE · 67

LinkedIn Architecture

How LinkedIn serves 1B members with a mix of Kafka, Espresso, and Voldemort at Microsoft-scale infra.

Read article
ARTICLE · 68

Meta Threads Architecture

How Threads launched in 5 days by leveraging Instagram's infrastructure.

Read article
ARTICLE · 69

PayPal P2P Architecture

How PayPal processes billions of P2P transfers with balance-based ledger + bank integration.

Read article
ARTICLE · 70

Range Sharding

Range-based sharding for time-series, geo queries, and ordered scans.

Read article
ARTICLE · 71

Rate Limiter Architecture

Two canonical rate limiter algorithms, side by side, with an inline architecture diagram.

Read article
ARTICLE · 72

Rate Limiting Strategies Compared

Token bucket, leaky bucket, fixed window, sliding window — when each one is wrong.

Read article
ARTICLE · 73

Recommendation System Architecture

Two-tower models, candidate generation, ranking, and serving at 200M+ user scale.

Read article
ARTICLE · 74

Reddit Architecture

How Reddit ranks 100K+ subreddit posts and comments with the classic hot algorithm.

Read article
ARTICLE · 75

REST API Design Deep Dive

Resource modeling, verb semantics, versioning, and hypermedia for real REST APIs.

Read article
ARTICLE · 76

Robinhood Trading Architecture

Zero-commission mobile-first trading and the payment-for-order-flow economics.

Read article
ARTICLE · 77

Amazon S3 Object Storage Internals

How S3 achieves 11 nines durability + infinite scale via erasure coding + partition placement.

Read article
ARTICLE · 78

Saga Pattern for Distributed Transactions

Long-running business transactions via compensating steps instead of 2PC.

Read article
ARTICLE · 79

Service Discovery Patterns

How microservices find each other in dynamic infrastructure.

Read article
ARTICLE · 80

Service Mesh Architecture

How a sidecar-based mesh separates business logic from cross-cutting concerns.

Read article
ARTICLE · 81

Shard Rebalancing Strategies

How to move data safely when adding, removing, or splitting shards.

Read article
ARTICLE · 82

Signal Protocol Architecture

How Signal's double ratchet gives forward secrecy and post-compromise recovery per message.

Read article
ARTICLE · 83

Slack Architecture

How Slack indexes billions of messages and delivers real-time updates to workspaces of thousands.

Read article
ARTICLE · 84

Snapchat Ephemeral Messaging Architecture

How Snapchat delivers self-destructing messages while enabling stories, filters, and multi-user features.

Read article
ARTICLE · 85

Spotify Music Streaming Architecture

How Spotify serves 100M+ tracks with personalized recommendations to 500M+ users.

Read article
ARTICLE · 86

Stock Exchange Matching Engine Architecture

How order matching engines process millions of orders/second with strict fairness + latency guarantees.

Read article
ARTICLE · 87

Stripe Payment Platform Architecture

How Stripe abstracts card networks, banks, and payment methods behind a clean API.

Read article
ARTICLE · 88

Telegram Architecture

Telegram's proprietary transport and its cloud-chat model that keeps messages accessible from any device.

Read article
ARTICLE · 89

TikTok Architecture

The For You Page algorithm and its real-time signal loop.

Read article
ARTICLE · 90

Twitter Timeline Generation Architecture

The fan-out patterns that make timelines feel real-time while scaling to hundreds of millions of users.

Read article
ARTICLE · 91

Uber Ride Matching Architecture

How Uber matches millions of riders to nearby drivers in seconds via geospatial indexing.

Read article
ARTICLE · 92

UPI Architecture

How UPI (Unified Payments Interface) processes 10B+ transactions/month via NPCI + Payment Service Providers.

Read article
ARTICLE · 93

Vector Search at Scale

How vector databases (Pinecone, Weaviate, pgvector) find nearest neighbors across billions of embeddings.

Read article
ARTICLE · 94

Video Streaming Architecture

How video-on-demand delivers adaptive quality to millions from a mesh of caches.

Read article
ARTICLE · 95

Website Hosting Architecture

The complete stack behind a modern static website with HTTPS, CDN, and DNS.

Read article
ARTICLE · 96

WeChat Super-App Architecture

How WeChat runs chat, payments, and 3M mini-apps inside a single app with 1.3B users.

Read article
ARTICLE · 97

WhatsApp Architecture

How WhatsApp delivers ~100 billion messages/day with end-to-end encryption and offline handling.

Read article
ARTICLE · 98

YouTube Architecture

How YouTube ingests, transcodes, stores, and delivers 4B+ hours of video daily.

Read article
ARTICLE · 99

Zoom Video Conferencing Architecture

How Zoom achieves low-latency multi-party video via SFU + regional data centers.

Read article