No. #39

Insensitivity to Sample Size
- Disregarding the Role of Scale

Insensitivity to sample size is the tendency to underweight or ignore the size of a sample when evaluating the reliability of data or evidence. This can lead to overconfidence in findings from small datasets or pilot studies in product development.

Read more on Wikipedia

Product example

A team may make broad product decisions based on feedback from a very small user group, assuming it's representative of the entire user base.

Empathy tips


Highlight Sample Size Importance

Emphasize the importance of sample size in data analysis and decision-making.


Scale Up Research

Ensure that user research involves sufficiently large and representative samples.


Data Literacy Training

Train teams in data literacy, focusing on the importance of sample size.


Review and Validation

Regularly review and validate findings with larger data sets to ensure accuracy.

Need an empathic partner?

Anna Lundqvist portrait
Anna Lundqvist
UX Designer and AI Ethics Strategist guiding innovative product development and educational workshops
Eddy Salzmann portrait
Eddy Salzmann
Design lead and team culture enthusiast driving products and design processes
Ola Möller portrait
Ola Möller
Founder of MethodKit who has a passion for organisations and seeing the big picture
Hire us