How can you tell whether a dashboard is honest?
Ask when it last told you something you did not want to hear. A report that has never surprised anyone or sent them away with an awkward action is not evidence of health.
Blog
If your dashboard only carries good news, it is fiction
Because bad numbers get questioned and removed while good ones never get checked, so over time the report drifts towards green without anyone being dishonest. I once reviewed a website reported as converting at 2%, where one mis-attributed referral source meant the real figure was 0.4%. An honest dashboard carries fewer numbers, each with an owner and a decision, shows rates with their volumes, keeps at least one uncomfortable metric, and is audited now and then by someone who did not build it.
I once reviewed a website that converted at 2%. Respectable, healthy, comfortably above benchmark. Everyone involved was reasonably pleased with it.
Except it did not convert at 2%. One mis-attributed referral source was flattering the number five times over. The real figure was 0.4%, and the difference between those two numbers was years of decisions made about a website that was working, when the truth was a website that was not.
Nobody had lied. That is what makes this worth writing about.
Dashboards drift towards flattery
Here is my unpopular position: left alone, every dashboard in every organisation drifts towards good news, and this happens without a single person doing anything dishonest.
The mechanism is just selection, applied gently, over time. A metric that turns bad gets questioned, investigated and then often, quite reasonably, removed: "bounce rate isn't really meaningful for us anyway". A metric that looks good is never questioned, so it stays. Configuration errors that flatter, like my mis-attributed referral, go unexamined for years, because nobody audits a number they like. Errors that insult get found in a week. Run that filter every month for three years and you have a wall of green that no one decided to fake.
Add the human layer and the drift accelerates. The person presenting the dashboard is usually the person responsible for the numbers on it. The agency compiling the report is paid by its results. Even internally, nobody gets promoted for making the metrics look worse, including the people who made them more accurate. Everyone in the chain is rewarded when the screen is green, so the screen finds its way to green.
Reassurance is not the job
The corrosive part is not any single wrong number. It is what the wall of green does to an organisation: it switches off curiosity. Why would you dig into a website that converts at 2%? The dashboard's answer to every hard question becomes "things are fine", and slowly the dashboard stops being an instrument and becomes an anaesthetic.
A dashboard's job is not to reassure you. It is to tell you where you are wrong while it is still cheap to fix. A report that has never once surprised you, never sent anyone away with an awkward action, never contradicted the room's assumptions, is not evidence of health. It is evidence that the instrument is broken, or that nobody is reading it as an instrument.
The 0.4% figure, for what it is worth, turned out to be the most useful number that firm had seen in years. It reopened questions that 2% had closed, and the work that followed had a target that was real. Honest numbers feel worse and are worth more. That trade never changes.
What an honest dashboard looks like
Fewer numbers, each with an owner and a decision attached. If nobody can say what would change if a metric moved, the metric is decoration, and decoration is where fiction breeds. Denominators on everything, because rates without volumes are how 3 enquiries from 150 visits becomes "2% and above benchmark". At least one number you would rather not look at, kept deliberately: cost per real enquiry, complaints, the channel that is not working. And an occasional audit by someone who did not build the tracking and does not benefit from its story, because the flattering errors are precisely the ones insiders never find.
None of this is technically hard. GA4 will tell you the truth if the configuration lets it. The hard part is wanting it to.
The question for your next meeting
When the dashboard comes round this month, ask one thing: when did this last tell us something we did not want to hear?
If the room goes quiet, you are not looking at your performance. You are looking at a story about it, and someone, eventually, will pay full price to find out how the story ends.
Questions people ask
Why should a conversion rate be shown with its volume?
Because a rate on its own hides the scale. 3 enquiries from 150 visits is 2%, and can be presented as comfortably above benchmark.
Not sure where to start?
Most clients begin with a conversation. No pitch, no hard sell.
Just a straightforward discussion about where you are and whether I can help.
Book a free 30-minute call