Partitioning & Sharding: Overview
Module: Schema Design & Advanced DDL
Difference between partitioning (vertical split) and sharding (horizontal split across servers)
Three partitioning strategies: range, list, and hash partitioning with real use cases
How partition pruning makes queries 10-100x faster by skipping irrelevant partitions
Sharding strategies and how Instagram, Discord, and Uber distribute data across servers
When to partition (single server, 100M+ rows) vs when to shard (multiple servers, billions of rows)
Partition maintenance: adding, dropping, and archiving old partitions
Sharding challenges: cross-shard queries, rebalancing, and maintaining consistency
Real-world decision framework for choosing partition keys and shard keys
Difference between partitioning (vertical split) and sharding (horizontal split across servers)
Three partitioning strategies: range, list, and hash partitioning with real use cases
How partition pruning makes queries 10-100x faster by skipping irrelevant partitions
Sharding strategies and how Instagram, Discord, and Uber distribute data across servers
When to partition (single server, 100M+ rows) vs when to shard (multiple servers, billions of rows)
Partition maintenance: adding, dropping, and archiving old partitions
Sharding challenges: cross-shard queries, rebalancing, and maintaining consistency
Real-world decision framework for choosing partition keys and shard keys