Reading list

I really like to read engineering blogs from companies whose product I admire/use the most in my day to day life, its the best way to understand how the engineering teams at the top tech companies function and how they build scalable systems.

It also helps me build a strong intuition for system design interviews as I get to know each and every pros and cons of components I will be using.

1. Netflix (@netflix)

1.1. Microservices

• Netflix Conductor : https://netflixtechblog.com/netflix-conductor-a-microservices-orchestrator-2e8d4771bf40

• The netflix api re-architecture : https://netflixtechblog.com/engineering-trade-offs-and-the-netflix-api-re-architecture-64f122b277dd

• Load shedding : https://netflixtechblog.com/keeping-netflix-reliable-using-prioritized-load-shedding-6cc827b02f94

• Making api more resilient : https://netflixtechblog.com/keeping-netflix-reliable-using-prioritized-load-shedding-6cc827b02f94

1.2. Streaming

• Content Popularity for Open connect : https://netflixtechblog.com/content-popularity-for-open-connect-b86d56f613b

• Video encoding at scale : https://netflixtechblog.com/high-quality-video-encoding-at-scale-d159db052746

• Data compression for large scale streaming : https://netflixtechblog.com/data-compression-for-large-scale-streaming-experimentation-c20bfab8b9ce

1.3. Architecture

• Creating scalable offers platform : https://netflixtechblog.com/growth-engineering-at-netflix-creating-a-scalable-offers-platform-69330136dd87

1.4. Infra related

• Extracting image metadata at scale : https://netflixtechblog.com/extracting-image-metadata-at-scale-c89c60a2b9d2

2. Uber (@Uber)

2.1. Architecture :

• Service oriented : https://www.uber.com/en-IN/blog/service-oriented-architecture/

• Push Platform : https://www.uber.com/en-IN/blog/real-time-push-platform/

• Multi tenancy architecture : https://www.uber.com/en-IN/blog/multitenancy-microservice-architecture/

2.2. API:

Uber's api gateway : https://www.uber.com/en-IN/blog/architecture-api-gateway/

3. Aribnb

• 3.1. Avoiding double payments in distributed payments system : https://medium.com/airbnb-engineering/avoiding-double-payments-in-a-distributed-payments-system-2981f6b070bb

• 3.2. Knowledge Access and retrieval at scale : https://medium.com/airbnb-engineering/scaling-knowledge-access-and-retrieval-at-airbnb-665b6ba21e95

• 3.3. Promotion and communication platform : https://medium.com/airbnb-engineering/airbnbs-promotions-and-communications-platform-6266f1ffe2bd

4. Hotstar

• 4.1. Re-Architecting apps for scale : https://blog.hotstar.com/re-architecting-apps-for-scale-d4639b91e0c3

• 4.2. Pubsub for 50M(scale) : https://blog.hotstar.com/building-pubsub-for-50m-concurrent-socket-connections-5506e3c3dabf

5. Incident.io (@incident_io)

• Debugging deadlocks in postgres : https://incident.io/blog/debugging-deadlocks-in-postgres

• Choosing right postgres indexes : https://incident.io/blog/choosing-the-right-postgres-indexes

• Time, timezones and scheduling : https://incident.io/hubs/building-on-call/time-time-zones-and-scheduling

• data habits help build a data culture : https://incident.io/blog/how-data-habits-help-build-a-data-culture

6. Tailscale ()

• Perfomance : https://tailscale.com/blog/peer-relays-international-networks

• Tailscale GitHub Action v4 : https://tailscale.com/blog/github-action-v4

• identity provider for scale : https://tailscale.com/blog/building-tsidp

• Better auth : https://tailscale.com/blog/workload-identity-beta

• NAT learnings : https://tailscale.com/blog/nat-traversal-improvements-pt3-looking-ahead

7. Discord ()

• How discord resizes 150 million images with go and c++ : https://discord.com/blog/how-discord-resizes-150-million-images-every-day-with-go-and-c

• How discord indexes trillions of messages : https://discord.com/blog/how-discord-indexes-trillions-of-messages

8. Twitter ()

• Kafka as storage system : https://blog.x.com/engineering/en_us/topics/infrastructure/2020/kafka-as-a-storage-system

• Twitter metricsdb : https://blog.x.com/engineering/en_us/topics/infrastructure/2019/metricsdb

• Storing and retrieving millions of ad impressions per second at scale : https://blog.x.com/engineering/en_us/topics/infrastructure/2021/storing-and-retrieving-millions-of-ad-impressions-per-second

• Distributed log : https://blog.x.com/engineering/en_us/topics/infrastructure/2015/building-distributedlog-twitter-s-high-performance-replicated-log-servic

9. Dropbox

• Infrastructure : https://dropbox.tech/infrastructure/infrastructure-update-pushing-the-edges-of-our-global-performance

• Intelligent DNS based load balancing at Dropbox : https://dropbox.tech/infrastructure/intelligent-dns-based-load-balancing-at-dropbox

• Cross shard transactions at 10 million requests per second : https://dropbox.tech/infrastructure/cross-shard-transactions-at-10-million-requests-per-second

• Immproving the performance of full text search : https://dropbox.tech/infrastructure/improving-the-performance-of-full-text-search