Accepted "a person enters this by hand" in a procedure without asking why
Office work
- Situation
- The AI is working through an office procedure, and the manual says "from here, the staff member enters this by hand."
- What the AI did
- Following the manual, it planned to hand that step to a staff member. In fact, it could have finished the same work itself by using a different method it had access to.
- How to ask next time (the operator's example)
- "Even if the manual says a person does it, write out in one line the assumption behind that. Check whether a different method would let you do it yourself before deciding to ask a person. Keep any step where a person judges and approves."
- One question to ask
- Does the assumption behind "a person does this" still hold?
- Check it yourself
- Ask the AI why the step is manual: no API, needs a login, needs a signature, or needs judgment. Approval and signature steps stay with a person; for the rest, ask about an export, an API, or a command-line tool.
- AI used (month)
- Claude Code (2026-09)
- Times this mistake was recorded
- once
- Source
- The operator's work records (the details were changed to a different task)