Automation & Toil

Reducing manual, repetitive, automatable work — and the trap of automating something you do not understand, which scales mistakes faster than it scales work.

How to Automate Something

Repeated manual task, then understand, then standardise, then automate, then monitor the automation — in that order, because skipping a step moves the failure rather than removing it.

Q · A task keeps being done by hand. What is the correct sequence for turning it into automation that is safer than the hand version?
The Automation Trap

Do not automate what you do not understand. Bad automation does not make mistakes less likely — it makes them faster, wider and more confident.

Q · What exactly goes wrong when you automate a procedure you have not understood?
Toil

Manual, repetitive, automatable operational work that scales with the service and leaves nothing behind — and the "scales with the service" part is what makes it toil rather than just work.

Q · Which operational work is genuinely worth engineering away, and which work only feels like it should be?
Cron Jobs in Production

Six failure modes that scheduled work has and request handling does not: duplicate execution, missed execution, overlap, timezones, long-running jobs, and no observability at all.

Q · A job runs on a schedule. What are all the ways that goes wrong, given that nobody is watching it?
Job Scheduler Reliability

Five questions that decide whether scheduled work survives real infrastructure: can it run twice, can it overlap, what if the machine dies, can it retry, is it idempotent.

Q · Under what guarantees is my scheduled work actually running, and does the job hold up under the ones I actually have?