Data Literacy Is a Leadership Competency, Not a Technical Skill
Why is data literacy a leadership issue rather than a technical one?
Data literacy is a leadership issue because leaders make the highest-stakes decisions in an organization, and when those decisions are informed by data they cannot interrogate, they are either trusting blindly or performing data-drivenness without the competency to practice it.
I presented a quarterly revenue dashboard to an executive team. One chart showed a 15% revenue increase. The chart used a truncated y-axis that started at $8M instead of $0, making a modest increase look dramatic. I did this intentionally as a test. Not one executive questioned the visualization. The chart was misleading, and it went unchallenged because the people reviewing it lacked the literacy to detect the distortion.
This is not an edge case. According to data literacy research, fewer than 25% of business leaders can confidently interpret common statistical concepts (correlation vs. causation, sample size significance, confidence intervals). Yet these same leaders make million-dollar decisions based on reports that rely on these concepts.
What does executive data illiteracy actually cost?
Executive data illiteracy costs organizations through three channels: misallocated resources (investing in initiatives justified by misinterpreted data), unchallenged bad analysis (accepting flawed methodology because no one in the room can identify the flaw), and data theater (performing data-drivenness without substance).
I tracked 12 executive decisions over 6 months that were explicitly described as “data-driven.” In 4 cases, the data did not actually support the decision. In 2 of those, the analysis contained methodological errors (survivorship bias in one, confounding variables in another) that a statistically literate leader would have caught. The combined budget of those 4 misaligned decisions was $1.2 million. Not all of it was wasted, but the data-driven label gave them unearned confidence.
The Goodhart’s Law dynamic is amplified by data-illiterate leadership. When leaders cannot evaluate metrics critically, they optimize for the number rather than the reality the number is supposed to represent. Every misguided optimization starts with an executive who cannot question the metric they are optimizing.
How should organizations develop leadership data literacy?
Organizations should develop leadership data literacy through three practices: mandatory metric interrogation training (3-4 hours), regular “chart challenge” exercises in leadership meetings, and requiring every data-driven recommendation to include methodology disclosures.
- Metric interrogation training: A 4-hour workshop that teaches leaders to ask five questions about any metric: How is it calculated? What data does it include and exclude? What could make it go up without anything actually improving? What is the margin of error? And what would change this metric that has nothing to do with what we are trying to measure? I have delivered this workshop to 3 executive teams. Post-workshop, metric-related questions in leadership meetings increased by 200%
- Chart challenge exercises: In monthly leadership meetings, present one intentionally misleading chart and challenge the team to identify the distortion. This builds pattern recognition for common visualization tricks: truncated axes, cherry-picked timeframes, missing baselines, and scale manipulation. After 6 months, one team’s ability to identify misleading charts improved from 20% to 75%
- Methodology disclosures: Every data-driven recommendation must include a one-page methodology disclosure: data sources, time period, known limitations, and alternative interpretations. This forces analysts to be honest and gives leaders the information needed to evaluate claims. The epistemology of metrics becomes a practical leadership concern, not just a philosophical one
What changes when leaders become data literate?
When leaders become data literate, the quality of organizational data use improves at every level because leadership sets the standard for rigor, and data teams shift from “making pretty dashboards” to “providing honest analysis,” which is a fundamentally different and more valuable function.
According to Harvard Business Review’s research on data literacy programs, organizations that invest in executive data literacy see a 3x improvement in the quality of data-informed decisions within 12 months. The mechanism is straightforward: when leaders ask better questions, data teams produce better answers. The stakeholder communication as information design challenge becomes easier when stakeholders can actually process the information.
An executive who cannot interrogate a metric is as handicapped as an executive who cannot read a balance sheet. Both are making decisions about things they do not understand. The difference is that financial literacy has been a leadership expectation for decades. Data literacy is just now being recognized as equally fundamental. Organizations that develop it first will make better decisions. Those that do not will continue to perform data-drivenness while decisions are made by intuition dressed in charts.