Skip to content

Instantly share code, notes, and snippets.

@anilpai
Last active March 22, 2024 16:28
Show Gist options
  • Star 16 You must be signed in to star a gist
  • Fork 9 You must be signed in to fork a gist
  • Save anilpai/0da860c8295668571c4fa9fc07638e1c to your computer and use it in GitHub Desktop.
Save anilpai/0da860c8295668571c4fa9fc07638e1c to your computer and use it in GitHub Desktop.
Grokking Advanced System Design LInks
Dynamo: How to Design a Key-value Store?
Amazon’s Dynamo : https://www.allthingsdistributed.com/2007/10/amazons_dynamo.html
Eventually Consistent : https://www.allthingsdistributed.com/2007/12/eventually_consistent.html
Bigtable : https://research.google/pubs/pub27898/
DynamoDB : https://www.allthingsdistributed.com/2012/01/amazon-dynamodb.html
CRDT : https://en.wikipedia.org/wiki/Conflict-free_replicated_data_type
A Decade of Dynamo : https://www.allthingsdistributed.com/2017/10/a-decade-of-dynamo.html
Riak : https://docs.riak.com/riak/kv/2.2.0/learn/dynamo/
Dynamo Architecture : https://www.youtube.com/watch?v=w96lLsbI1q8
Dynamo: A flawed architecture : https://news.ycombinator.com/item?id=915212
Cassandra: How to Design a Wide-column NoSQL Database?
Bigtable : https://research.google/pubs/pub27898/
Dynamo : http://www.read.seas.harvard.edu/~kohler/class/cs239-w08/decandia07dynamo.pdf
Datastax docs : https://docs.datastax.com/en/dse/6.8/dse-arch/datastax_enterprise/dbArch/archTOC.html
Tombstones common problems : https://opencredo.com/blogs/cassandra-tombstones-common-issues/
The Phi Accrual Failure Detector : http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.80.7427&rep=rep1&type=pdf
Cassandra introduction video : https://www.coursera.org/lecture/cloud-applications-part2/2-3-1-cassandra-introduction-olmpu
Kafka: How to Design a Distributed Messaging System?
Confluent Docs : https://docs.confluent.io/current/kafka/design.html#ak-design
New York Times use case : https://www.confluent.io/blog/publishing-apache-kafka-new-york-times/
Kafka Summit : https://www.confluent.io/resources/kafka-summit-san-francisco-2019/
Kafka Acks Explained : https://medium.com/better-programming/kafka-acks-explained-c0515b3b707e
Kafka as distributed log : https://www.youtube.com/watch?v=ElilYxUOjOQ
Minimizing Kafka Latency : https://www.confluent.io/blog/configure-kafka-to-minimize-latency/
Kafka internal storage : https://thehoard.blog/how-kafkas-storage-internals-work-3a29b02e026
Exactly-Once semantics : https://www.confluent.io/blog/exactly-once-semantics-are-possible-heres-how-apache-kafka-does-it/
Split-brain : https://techthoughts.typepad.com/managing_computers/2007/10/split-brain-quo.html
Chubby: How to Design a Distributed Locking Service?
Chubby paper : https://research.google/pubs/pub27897/
Chubby architecture video : https://www.youtube.com/watch?v=PqItueBaiRg
Chubby vs. ZooKeeper : https://www.youtube.com/watch?v=zokwJeukDrI
Hierarchical Chubby : https://www.scs.stanford.edu/17au-cs244b/labs/projects/bohn_dauterman.pdf
Bigtable : https://research.google/pubs/pub27898/
Google File System : https://research.google/pubs/pub51/
GFS: How to Design a Distributed File Storage System?
GFS paper : https://research.google/pubs/pub51/
Bigtable : https://research.google/pubs/pub27898/
GFS: Evolution on Fast-forward : https://queue.acm.org/detail.cfm?id=1594206
HDFS: How to Design a Distributed File Storage System?
HDFS paper : https://storageconference.us/2010/Papers/MSST/Shvachko.pdf
HDFS High Availability (HA)architecture : https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html
Apache HDFS Architecture : https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html
Distributed File Systems: A Survey : http://ijcsit.com/docs/Volume%205/vol5issue03/ijcsit20140503234.pdf
BigTable: How to Design a Wide-column Storage System?
BigTable : https://research.google/pubs/pub27898/
SSTable : https://medium.com/databasss/on-disk-io-part-3-lsm-trees-8b2da218496f
Dynamo : https://www.allthingsdistributed.com/2007/10/amazons_dynamo.html
Cassandra : https://cassandra.apache.org/
HBase : https://hbase.apache.org/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment