Some interesting system design papers:
- Dynamo: Amazon’s high availability key value store
- Google file system
- Chubby lock service
- Kafka – a distributed messaging system for log processing
- MapReduce – Simplified data processing for large clusters
- Bigtable a distributed storage system for structured data
- Cockroach DB: The resilient Geo-Distributed SQL Database
- On designing and deploying internet-scale services
- Raft: In search of an understandable consensus algorithm
- Paxos made simple and here is a blog that someone has written which explains paxos better
- Cap twelve years later
- SWIM: Scalable weakly consistent infection style process group membership protocol
- Hints for computer system design
- Big ball of mud
- Out of Tarpit
- No silver bullet, essence and accident in software engineering
- Harvest, Yield, and Scalable Tolerant Systems
- Dapper – a large scale distributed systems tracing infrastructure
- Large scale cluster management with Borg
- Mesos: A platform for fine grained resource sharing in data center
- Gorilla: A Fast, Scalable, In-Memory Time Series Database
- Ambry: LinkedIn’s Scalable Geo-Distributed Object Store
- Facebook RocksDB Experience
- Finding a needle in Haystack: Facebook’s photo storage
- Scaling Memcache at Facebook
- PNUTS: Yahoo!’s Hosted Data Serving Platform
- Maglev: A Fast and Reliable Software Network Load Balancer
- Erlang at Facebook
- Prefix Hash Tree An Indexing Data Structure over Distributed Hash Tables
- SVE: Distributed Video Processing at Facebook Scale
- Gossiping in Distributed Systems
Companies Engineering Blogs
Other Interesting Blogs
InfoQ Achitecture & Design Talks
Various design articles related to high scalability
https://www.facebook.com/atscaleevents/events
https://engineering.fb.com/2020/08/24/production-engineering/scaling-services-with-shard-manager/
https://engineering.fb.com/category/production-engineering/
https://engineering.fb.com/2021/08/11/open-source/time-appliance/
https://engineering.fb.com/2019/06/06/data-center-engineering/twine/