Called it a bug based on a mental picture of "how it's normally done"
Making documents
- Situation
- Having an AI check whether an informational web page looks and behaves correctly.
- What the AI did
- It judged by a remembered model ("a normal product wouldn't do this") and reported a bug. Opening the product it had in mind and comparing showed the same behavior.
- How to ask next time (the operator's example)
- "When you say 'normally it works like this,' open the product you're comparing against and try it in the same situation. Write down what you found."
- One question to ask
- Before saying "normally": was the product being compared actually opened?
- Check it yourself
- Ask which product the AI compared against, then open it and try the same step yourself. A claim about "standard behavior" that names no product can't be checked.
- AI used (month)
- Claude Code (2026-09)
- Times this mistake was recorded
- once
- Source
- The operator's work records (the details were changed to a different task)