Production engineering interview guide

What each question is actually testing, what a strong answer contains, and the specific wrong answers that sound right.

What should a good CI pipeline optimise for?CI

Tests · Whether the candidate treats CI as a feedback system with a latency budget, or as a list of tasks that must all be run.

How would you deploy a change you believe is risky?Strategies

Tests · Whether the candidate reasons about blast radius and reversibility before reasoning about mechanism, and whether they can say what would make them stop.

How do you rename a heavily used database column with no downtime?Migrations

Tests · Whether the candidate understands that during any rollout two versions of the code run against one database, and can sequence changes so both are always valid.

Why would you use Kubernetes?Kubernetes

Tests · Whether orchestration is treated as a requirement to be established, or as the thing production is assumed to mean.

A deployment just raised the error rate to 20%. What do you do?Incidents

Tests · Whether the candidate reduces user impact before seeking understanding, and whether they can run the response as a coordinated activity rather than as a debugging session.

Why use Infrastructure as Code?IaC

Tests · Whether the candidate can name the operational properties it buys, rather than describing it as the modern way to do things.

"Our backup job succeeds every day." Are we safe?DR

Tests · Whether the candidate separates the backup from the restore, and connects both to a recovery objective and an actual procedure.

Why might CPU-based autoscaling fail for an API service?Autoscaling

Tests · Whether the candidate can identify what actually saturates first, and whether they treat autoscaling as a control loop with lag rather than as elasticity.

Where should production secrets live?Secrets

Tests · Whether the candidate reasons about the whole lifecycle — issuance, delivery, rotation, revocation, audit — rather than about where to hide a string.

How do you decide between rolling back and rolling forward?Safety

Tests · Whether the candidate has a decision rule that survives time pressure, and whether they know what makes rollback unavailable.

Production is degraded and "nothing changed". Where do you start?Debugging

Tests · Whether the candidate treats "nothing changed" as a claim to be tested, and whether they have an ordered search rather than a hunch.

Staging passed. What does that actually tell you?Environments

Tests · Whether the candidate knows the limits of pre-production evidence and can say what only production can reveal.

Why build the artifact once and promote it, rather than building per environment?Artifacts

Tests · Whether the candidate connects artifact identity to the ability to reason about what is running and what was tested.

What makes a build reproducible, and why would you care?Builds

Tests · Whether the candidate can enumerate the inputs a build depends on, including the ones that are invisible.

A rolling deploy drops a small number of requests every time. Why?Containers

Tests · Whether the candidate understands the process and signal model inside a container and the timing relationship between routing and termination.

What makes an alert worth waking someone for?Alerting

Tests · Whether the candidate designs alerts from user impact and required action, and treats noise as a reliability problem rather than an annoyance.

What does a postmortem need to produce, and what is "the root cause"?Postmortems

Tests · Whether the candidate can hold contributing factors rather than a single cause, and whether the outputs actually change the system.

What separates a runbook that helps at 3am from one that does not?Readiness

Tests · Whether the candidate writes procedures for a tired stranger with partial information, and knows what a runbook must not contain.

Who should be able to log into production, and how?Access

Tests · Whether the candidate can reconcile least privilege with the reality that emergencies require access, without pretending either away.

What is the difference between a deployment and a release?Release

Tests · Whether the candidate can separate moving code to production from exposing behaviour to users, and can use that separation deliberately.

Why do configuration changes cause outages as often as code changes?Config

Tests · Whether the candidate treats configuration as a deployable with its own blast radius, testing and rollback story.

How much spare capacity should a service run with?Capacity

Tests · Whether the candidate can derive headroom from failure requirements rather than picking a comfortable number.

How do you know the artifact running in production is the one you built?Supply Chain

Tests · Whether the candidate can reason about the path from dependency to running process as attack surface, and about what a scanner finding actually means.

What makes an internal platform succeed rather than become another queue?Platform

Tests · Whether the candidate treats the platform as a product with users, and can distinguish a guardrail from a gate.

What should you automate, and what should stay human?Automation

Tests · Whether the candidate can identify toil precisely and recognises that automating a misunderstood process scales the mistake.

Every instance has a pool of 20 database connections. What is wrong with that plan?Operations

Tests · Whether the candidate reasons about a shared, finite resource across the whole fleet rather than per instance.