Skip to content
BENIBIX Learn

Toil

Infrastructure📟 ReliabilityService Levels

Also known as Operational Toil, Toil (SRE), Manual Ops Work

The same hand work, done again and again, that a script could do.

Think of it like

Think of it like washing the same dishes by hand each night. A machine could do it for you.

Example

Every Monday, Jack clears a full disk by hand on six servers. He spends one afternoon writing a script, and the weekly job is gone.

Why it matters

Toil grows with the service, but the team does not. Left alone, it eats all the time for real fixes.

Definition

Toil is the manual, repeated work of keeping a service running that a machine could do instead. Restarting a stuck job by hand each week is toil. It brings no lasting value, and it grows as the service grows. Teams try to cap it, so there is time left to build real fixes. A well known book on running services sets a goal of keeping it under half of each engineer's time.
Toil is the grey part of the week. The goal is to keep it under the halfway line.

Common mistake

Calling all ops work toil. Planning, writing reviews and fixing new problems are real work.

Key takeaways

  1. 1
    Manual and repeated. The same steps again and again.
  2. 2
    No lasting value. Nothing is better afterwards.
  3. 3
    Cap it. Keep it under half the time.