A sample is meant to give a reliable picture of the whole. With customer conversations, that rarely works. The conversations that matter most are uncommon, so they seldom end up in the selection. Think of a customer threatening to cancel, a recurring fault or an agent explaining a procedure incorrectly.
The coach’s choice also plays a role. Whoever selects the conversations often picks the long ones or the ones with a complaint. That gives a distorted view of how an agent performs. For the agent, it also feels unfair. One difficult call can weigh heavily in an evaluation that rests on five conversations.
Finally, there is a delay between the conversation and the feedback. A coach often listens back days or weeks later. By then, the agent barely remembers the call, and a problem with a new product or a new way of working has already occurred hundreds of times.