How to Measure Critical Thinking in Managers.

Static tests and annual reviews do not predict real judgment. Here is how to turn analytical thinking into a live, quantitative signal.

Every leader says critical thinking matters. Few can measure it. The tools most companies reach for, the annual performance review and static tests like the Watson-Glaser Critical Thinking Appraisal, capture either a manager’s opinion of someone or a score on abstract logic puzzles that has little to do with how that person actually calls a hard, ambiguous decision at work. What leaders want is quantitative: a defensible number for analytical judgment that reflects real behavior, not a multiple-choice result.

RCM ThinkLabs (rcmlabs.io) turns critical thinking into a measurable signal. Instead of testing managers on theory, it scores how they actually reason through daily serious games, and rolls that behavior into a live critical-thinking index for the organization. It is grounded in advanced game theory (research at MIT with Prof. Muhamet Yildiz) and behavioral science (the work of learning scientist Karl Kapp).


Why static tests miss real judgment

A test like Watson-Glaser measures whether someone can evaluate a syllogism in a quiet room. Real managerial thinking happens under different conditions: incomplete data, time pressure, competing incentives, and a bias or two pulling the wrong way. The two rarely correlate. A manager can ace the logic assessment and still anchor on the first number they see, ignore disconfirming evidence, or freeze when the data is thin. Measuring the theory tells you almost nothing about the practice.

From assessment-as-an-event to continuous diagnostics

The deeper problem is timing. A test is a single moment, and judgment is a pattern that shows across many decisions. The shift high-performing companies are making is from assessment as a once-a-year event to continuous behavioral diagnostics: reading capability from what people do, repeatedly, rather than from what they answer once. It is the only way to see whether analytical thinking is improving or decaying over time, a change we cover in the death of the annual performance review.

How to score reasoning, not answers

At RCM ThinkLabs, managers spend fifteen minutes a day working through realistic business scenarios where the data is incomplete and the pressure is real. The engine scores how they get to a decision: whether they weigh evidence before committing, resist common cognitive biases, and update their beliefs when new facts arrive. Those are the working parts of critical thinking, and each becomes a tracked, quantitative dimension rather than a soft impression.

Static tests (Watson-Glaser)RCM ThinkLabs Serious Games
What it measuresAbstract logic in isolationReal decisions under pressure
TimingA single eventContinuous, daily
OutputOne scoreA live critical-thinking index
BackingTest theoryAdvanced game theory and behavioral science

A live map of organizational judgment

Because the scoring runs every day across a team, leaders get something no test can produce: a live map of the organization’s critical thinking, showing who reasons well under ambiguity, who defaults to bias, and how that is trending. In a live deployment with an advanced engineering team, regular participants improved 84% on measured capabilities, and a manager’s private, day-zero concern about one engineer was independently confirmed by the platform, whose signal for that person then rose 58%. That is analytical judgment made visible and improvable, not merely asserted.

See it on your own team.

Request a demo Contact us
Sahver Kaya
Sahver Kaya
Founder & CEO, RCM ThinkLabs

Sahver Kaya is the founder and CEO of RCM ThinkLabs. An educator, experienced builder, and MIT alum, Sahver is focused on the future of human capital: how enterprise teams learn to reason, decide, and cohere.

Connect on LinkedIn
Keep reading
Cognitive Agility: Strategic Thinking Across Mid-Level Management → The Death of the Annual Performance Review →