KT is in beta: iPhone →Android & web →

System Design for Software Interviews: Start Here

Katy & TheoEpisode 6 of The Machines Are Learning7 min

The Machines Are LearningEpisode 67 min · Katy & Theo
0:00-6:36

In the app you can ask Katy about anything mid-episode, then it picks back up.

A candidate gave the right answer three times and still got rejected. Here's what the round actually grades.

Transcript

Katy

Minute twenty-two of a senior backend interview. The candidate, writing under the name Grace Banda, is staring at her own diagram realizing she's just given the panel three different answers to the same question in five minutes.

Theo

Three different wrong answers?

Katy

No. That's the thing. Every one of them was technically defensible. The recruiter told her later, quote, "your technical answer was strong." She still got rejected.

Theo

Okay, so what on earth is this round actually grading?

Katy

That's the question. And if you're about to sit one of these, the answer is not what you think it is.

Theo

Start me at zero. What even happens in a system design interview?

Katy

Someone hands you a deliberately vague, enormous problem. Jackson Gabbard, who ran these at Facebook, gives a real example: design a mobile app logging infrastructure for five hundred million monthly active users. Handle app start, stop, errors. That's it. That's the whole prompt.

Theo

That's not a question, that's a department.

Katy

Right. And Hello Interview is blunt about it: these are not about getting to a single right answer. For many questions there are many right answers. The interviewer is watching how you navigate a complex problem, reason about trade-offs, and communicate.

Theo

Do I get one of these if I'm fresh out of school?

Katy

Mostly no. Most entry-level roles skip it. Mid-level, it starts showing up. At senior level it's the norm, and it carries disproportionate weight in the whole evaluation.

Theo

Disproportionate how?

Katy

Here's how. A candidate writing at johal dot in got the full rubric after a Meta loop. Ninety-two percent on coding. Ninety-five percent behavioral. System design... forty-eight.

Theo

And that one number sinks it?

Katy

That one number sank a package he describes as five hundred thousand dollars. And look at the breakdown, because it's instructive. Architecture diagram: ninety-one percent, against a target of seventy. The picture was beautiful.

Theo

So where'd he bleed out?

Katy

Throughput and capacity planning: twenty-two percent. Trade-off analysis: thirty-five. Targets were eighty plus.

Theo

Twenty-two on capacity. Meaning the numbers.

Katy

Meaning the numbers. He'd read that a certain Redis setup did a hundred and twenty-four thousand events per second and sized sixteen shards off that. Benchmarked it afterwards. That figure was total throughput across all shards, not per shard. Real number per shard, about twenty-four thousand.

Theo

So his design was off by... what, five times?

Katy

His sixteen shards covered about nineteen percent of what he needed. The pretty diagram was drawing a system that could not exist.

Theo

Okay, that stings. But that's arithmetic, I can fix arithmetic. Grace's failure sounds scarier, because she was right.

Katy

She was. The interviewer asked her to go deeper on cross-region replication. She gave a clean answer: write local first, replicate async to a partner region, partner serves reads if local goes down. Done. She should have stopped.

Theo

She didn't stop.

Katy

She explained why async over sync. Then the latency cost of sync. Then what if the partner region is the one that fails. Then she started questioning her own earlier choice of write quorum. Each thread was reasonable. Collectively, the panel had no idea what she actually believed.

Theo

Hang on. That feels unfair. Isn't surfacing trade-offs literally the thing they said they wanted?

Katy

It's the sharpest tension in the whole format, and I think the recruiter's line nails it. Paraphrased: "Your stated answers were good. We were not sure they were the answers you actually held."

Theo

Oof. Conviction, not just correctness.

Katy

And the recruiter's verdict: senior level requires that you can defend a call without re-arguing it. In her own postmortem, she says she'd shown them an engineer who'd relitigate the path mid-implementation.

Theo

So how does a beginner not do either of those things?

Katy

Use a framework. The Grokking material lays out a repeatable one: clarify requirements, functional and non-functional. Estimate scale, traffic, storage, bandwidth. Define the API. Design the data model. Sketch the high-level architecture. Then deep dive on one or two components, and name the bottlenecks.

Theo

Estimate scale is step two. Before the drawing.

Katy

Before the drawing. That's the twenty-two percent, right there, in the right order.

Theo

And the patterns everyone talks about?

Katy

Small reusable set. Caching, sharding, replication, consistency models, messaging. The pitch from Design Gurus is sharp: a memorized answer does not survive the first follow-up question. A pattern does. And Hello Interview warns interviewers are actively hunting memorizers, by doubting your answers and probing your reasoning.

Theo

Is any company doing this better than vague prompts?

Katy

Two I'd flag. Google SRE built a format called Non-Abstract Large Systems Design, where the whole point is credible numbers at scale. And Cockroach Labs added a "choose your own" round where you just discuss a system you actually built.

Theo

Revolutionary idea, asking someone about their job.

Katy

They said it visibly raised candidate confidence going into the rest of the loop.

Theo

So the payoff. What is the round grading?

Katy

Whether you can take a fog of a problem, cut it into pieces, do the arithmetic honestly, pick a path... and then stand on it.

Theo

And stop talking.

Katy

And stop talking. Grace's answer was load-bearing the first time. She just kept hitting it with a hammer to prove it was.

Sources

Katy and Theo researched this episode from these sources.

  1. System Design in a Hurry | Hello Interview System Design in a Hurry
  2. design-gurus/grokking-system-design
  3. Updating your engineering interview to make better hiring decisions
  4. Introduction to the System Design Interview - Aced (formerly Exponent)
  5. Interviewing for Systems Design Skills
  6. The Sysdesign Round Where I Talked Myself Out of an Offer | Community | CodeSnatch
  7. Architecture and Systems Design Interviews | Jackson Gabbard's Blog
  8. Grokking Courses: The Original Interview Prep Series by Arslan Ahmad | Design Gurus
  9. Postmortem: How a Failed System Design Interview Cost Me a $500k Offer from Meta in 2026 — johal.in