Home / Defined terms / automation bias
3.7 · Behaviourautomation bias
The tendency of a person to accept a machine recommendation because it came from the machine, or to stop looking for evidence once the system has produced an answer.
What it means here
The tendency of a person to accept a machine recommendation because it came from the machine, or to stop looking for evidence once the system has produced an answer.
EU AI Act Article 14(4)(b) requires the oversight measures to help the person remain aware of this tendency.
How to use it
Test for it. A review that always accepts the system output is nominal oversight, whatever the policy says.
The term appears in the register wherever the distinction changes what a person must do. A policy that uses the word without the distinction is a policy that cannot be tested. The unit pages link back to this definition so the reader can check the meaning before signing a row.
The units that use it
Every unit in the register is written to be testable, which means the terms in it have to be concrete. Start with the register, then read the unit that carries the term in its requirement. If the term is still unclear after that, the row is not ready to sign.