No. #54
Automation Bias
- Overreliance on Automated Systems
Automation bias occurs when individuals favor suggestions from automated decision-making systems over contradictory information without automation. This can affect how products are designed and used, potentially leading to overreliance on automation at the expense of human judgment.
Read more on WikipediaProduct example
Users ignoring their own intuition or external signs of error when using GPS navigation, leading to mistakes.
Empathy tips
1
Balance Automation and Human Judgment
Design systems that balance automation with opportunities for human judgment.
2
Highlight Limits of Automation
Educate users about the limits of automation and the importance of remaining engaged.
3
Error Reporting Mechanisms
Implement mechanisms for users to report errors or discrepancies in automated systems.
4
User Training
Provide training for users on when to trust automation and when to rely on their own judgment.
Need an empathic partner?
Anna Lundqvist
UX Designer and AI Ethics Strategist guiding innovative product development and educational workshops
Eddy Salzmann
Design lead and team culture
enthusiast driving products and
design processes
Ola Möller
Founder of MethodKit who has a
passion for organisations and
seeing the big picture