The Things You Trust Are the Things That Betray You

Eight of seventeen. In a 2013 study, seventeen chess experts, with an average rating of 2223, were shown a position that had a good move in it and a better one. Eight of them played the good one and missed the better. Almost all of them said afterwards that the good move was the first thing they thought of.

These were not weak players having a bad day. The move was good, and that is the problem with it. It was good enough to feel finished.

// the crux

Experience hands you the first answer with the feeling of already being checked.

// in one breath
  • Eight experts out of seventeen, and what their eyes were doing while they looked for something better.
  • Why the speed that makes you good is the same mechanism that stops you looking.
  • Three small habits for the moment an answer arrives too easily, offered as habits and not as findings.

What Experience Is

Experience is a store of answers that worked. The more of them you hold, the faster you get, and speed is what we pay seniority for. Show a good engineer a failing system and the cause often arrives before the question is finished.

The same mechanism has a cost, and psychologists gave it a name before software had one. The Einstellung effect, from the German for a set or an attitude, is what happens when a familiar solution blocks a better one. Players in the chess study knew a standard way through the position. It worked. It was not the best.

The part I find hardest to shrug off is what their eyes did. Sheridan and Reingold tracked where the players looked. Those who played the familiar move kept returning to the same part of the board for the whole time they were thinking. The experts who found the better move looked at that region less and less as the minutes passed. The answer they already had was not hidden from them. It was holding their attention.

An earlier study, by Bilalić, McLeod and Gobet, found the effect with a familiar checkmate in five moves and a better one in three. I take that detail from Sheridan and Reingold's account of it, not from the original paper.

The Trade Hiding in Your Seniority

Erik Dane, a management researcher, made the wider argument in 2010. As people gain expertise in a domain, their mental structures for it become more stable, which he calls cognitive entrenchment. Stability is why they are fast and right. It is also why they find it harder to adapt, to solve a problem in a new way, or to see that the domain has moved. He also argues the cost is not fixed: it depends on the task and on where attention goes, and it can be worked around.

I read that as the most honest sentence in the literature on seniority. You do not get the speed without the stiffness. They are one thing, seen from two sides.

In engineering the stiffness has familiar shapes. The architecture that worked on the last system, proposed on the next one before anyone has stated the constraints. The incident that looks like the last incident, so the runbook for the last one gets run. The design review where the most experienced person speaks first and the room spends its time deciding whether to disagree.

None of these is a failure of competence. Each one is competence arriving early.

The Other Half of the Bombers

I have written before about the planes that did not come back: the clean record that proves only what survived, and the data you do not have because nobody was left to report it. That essay is about evidence you lack.

This one is about the opposite problem. Nothing is missing. You already hold an answer, and it is the answer that is in the way. A clean record misleads you from outside. Your own experience misleads you from inside, and from inside it feels like judgment.

Three Habits, Offered as Habits

I cannot point to a study that proves these work, so I will not pretend one exists. They follow from what the chess players showed, and from Dane's point that attention can be steered.

Ask for the second answer before you defend the first. When a solution arrives fast, write down one other, however weak. The aim is not to switch. It is to make your eyes leave the first one for a moment, which is exactly what the experts who found the better move did.

Name what would make you wrong. Invert the problem: instead of asking why the answer is right, ask what would have to be true for it to fail, and go and look there. An answer that arrived with the feeling of being checked has usually never been asked.

Put one person in the room who has not seen the last system. A newcomer's question is a free outside view, and the part of a senior person's job that is easiest to neglect is to want one. It is also what mastery as a moving target looks like in a team: a standing willingness to be the one who is out of date.

// the part worth keeping

The speed that makes you good is the same speed that stops you looking. You cannot give it up, so build a pause where it can be spent.

// carry forward

The evidence you are missing is told in The Planes That Didn't Come Back. The habit of looking for the failure first is in Invert the Problem.

// continue exploring