Trade-off and numbers cheat sheet

A one-page reference: latency numbers, availability maths, capacity formulas and the standard trade-offs, for quick revision.

On the roadmap:Interview Ready · step 1: The interview method

Lesson 3 of 4 · 9 min read · quiz · exercise

Round numbers worth remembering

These are approximate orders of magnitude, enough for estimates (exact figures vary by hardware and year).

OperationRough time
CPU cache or memory readnanoseconds to about 100 ns
Read 1 MB sequentially from memorytens of microseconds
SSD random readaround 100 microseconds
Round trip within a data centrearound 0.5 ms
Read 1 MB sequentially from SSDaround 1 ms
Disk seek (hard disk)around 10 ms
Round trip, same continenttens of ms
Round trip, across oceans100 ms and above

Take-aways: memory is far faster than disk, disk faster than network across regions; avoid unneeded round trips; sequential access beats random.

Powers and sizes

UnitApproximate size
1 KBa thousand bytes (a short text)
1 MBa million bytes (a photo, a small document)
1 GBa billion bytes
1 TBa thousand GB
1 PBa thousand TB
Seconds per dayabout 86,400 (use about 100,000 for quick maths)
Seconds per monthabout 2.6 million
Seconds per yearabout 31.5 million

Quick capacity formulas

  • Requests per second (average) = requests per day / 86,400. Peak = average times a peak factor (2 to 5).
  • Storage = records per day times bytes per record times days retained (times replication factor).
  • Bandwidth = requests per second times average response size.
  • Servers = peak requests per second / requests per second one server handles, plus headroom.
  • Cache size = hot working set (often 20 percent of data serves 80 percent of reads).
  • Connections (for chat or streaming) = concurrent users; memory per connection times that gives a first estimate.

Example: 10 million users, each posting 2 items a day of 1 KB: 20 million items a day, about 230 writes per second, 20 GB a day, about 7 TB a year before replication.

Availability maths

AvailabilityDowntime per yearPer month (30 days)
99%about 3.65 daysabout 7.2 hours
99.9%about 8.8 hoursabout 43 minutes
99.99%about 53 minutesabout 4.3 minutes
99.999%about 5.3 minutesabout 26 seconds

Components in series multiply (two 99.9% parts in a chain give about 99.8%); components in parallel (redundant) improve availability: failure needs both to fail. This is why redundancy across zones helps and long dependency chains hurt.

The standard trade-offs

Figure SDA-INT-03-1 · Trade-offs to name in every design · © forcsguy.com

ChoiceOption AOption B
Data modelRelational: constraints, transactionsNoSQL: flexible, easier horizontal scale
ScalingVertical: simple, limitedHorizontal: scalable, more complex
ReplicationSynchronous: safer, slowerAsynchronous: faster, may lose data on failover
FeedsFan-out on write: fast reads, heavy writesFan-out on read: cheap writes, slow reads
DeliveryAt-least-once plus idempotencyAt-most-once for loss-tolerant data
CachingCache-aside: simple, risk of stalenessWrite-through: fresher, slower writes
ConsistencyStrong: easy to reason aboutEventual: available and fast
CommunicationSynchronous calls: simpleAsynchronous messages: resilient, harder to trace
ArchitectureMonolith: simple to startMicroservices: independent scaling and teams, more operations
ID generationSequential: sortable, coordinationRandom (UUID): no coordination, poor locality

Patterns to reach for

ProblemPattern
Reads overwhelm the databaseCache, read replicas, CDN
Writes overwhelm one databaseSharding, queues to smooth bursts, LSM-based stores
Hot keyReplicate, split the key, local caching
Slow external dependencyTimeout, bulkhead, circuit breaker, queue
Duplicate deliveriesIdempotency keys, deduplication
Cross-service transactionSaga with compensation
Need history or auditEvent log, event sourcing
Unique "does this exist" checks at scaleBloom filter in front of storage
Even spread when nodes changeConsistent hashing
OverloadRate limit, load shed, backpressure

Final checks before you finish an answer

  • Requirements and scale stated; numbers used.
  • Main flow and data model clear.
  • Bottlenecks and single points of failure named, with mitigations.
  • Failures, consistency and security discussed.
  • Monitoring and next steps mentioned.
  • Trade-offs spoken aloud.

Real-world reading

Check your understanding

Question 1 of 3

0 correct so far

Roughly how long does a round trip within one data centre take compared with a cross-continent round trip?

© 2026 forcsguy.com. Original lesson text and diagrams. Books and sites linked above belong to their authors.