The short version
The problem usually isn't the questions. It's that people answer strategically, and nobody ever sees what happened to last year's answers.
Engagement scores are the most-quoted and least-trusted numbers in most companies. Leaders present them in board meetings and privately suspect they mean nothing. That suspicion is usually well founded, though not for the reason people assume.
Four failure modes
- 1Strategic answering. If last year's honest answers produced a workshop instead of a change, people learn to answer the way that costs them least.
- 2Sentiment without behavior. "I feel valued" is a mood; "I raised a concern this month and something happened" is an event.
- 3Aggregation. A healthy team and a failing team average out to a fine department score.
- 4No closed loop. Nothing erodes survey validity faster than a survey with no visible consequence.
Measure events, not feelings
The most reliable culture data already exists in your operations. How long does it take for bad news to reach a decision-maker? How many decisions get reversed after the fact because the right person wasn't in the room? How often does a project get stopped rather than quietly starved?
If a metric can't be gamed by being pleasant, it's probably a better culture metric than the one you're using.
Make the loop visible
- Publish what you heard within two weeks, in plain language, including the parts you don't plan to act on.
- Name the two things you will change and the owner for each.
- Report on them by name at the next all-hands, before anyone asks.
Do that twice and your survey data will get sharper on its own, because answering honestly will finally have a payoff.
Related resource
Culture Health Score
A short assessment that scores how your culture is actually operating — and emails you the full report.
Get the Culture Health Score