No. #54

Automation Bias
- Overreliance on Automated Systems

Automation bias occurs when individuals favor suggestions from automated decision-making systems over contradictory information without automation. This can affect how products are designed and used, potentially leading to overreliance on automation at the expense of human judgment.

Read more on Wikipedia

Product example

Users ignoring their own intuition or external signs of error when using GPS navigation, leading to mistakes.

Empathy tips

1

Balance Automation and Human Judgment

Design systems that balance automation with opportunities for human judgment.

2

Highlight Limits of Automation

Educate users about the limits of automation and the importance of remaining engaged.

3

Error Reporting Mechanisms

Implement mechanisms for users to report errors or discrepancies in automated systems.

4

User Training

Provide training for users on when to trust automation and when to rely on their own judgment.

Need an empathic partner?

Anna Lundqvist portrait
Anna Lundqvist
UX & AI ethics expert driving better products and smarter teams.
Eddy Salzmann portrait
Eddy Salzmann
Design lead crafting seamless products and mentoring design teams.
Ola Möller portrait
Ola Möller
Facilitator helping organisations see the big picture and take action.