Differentiating between bias and noise

Imagine four different targets - each shot by eight guns.

• Target 1 has eight holes closest to the bullseye - showing low bias and low noise.
• Target 2 has eight holes close together but above the bullseye - demonstrating high bias but low noise.
• Target 3 has eight holes widely distributed around the bullseye, showing low bias and high noise.
• Target 4 has eight holes widely distributes, showing high noise and bias. 

• Individual differences, such as the tendency to judge targets roughly or harshly.
• Using vague or imprecise judgement scales.
• Random variation in the order judges views evidence.

How to reduce noise:

• Apply a uniform set of decision rules...