Data as a Mirror: See and Know the System (Learning Entry 1: What Counts as Data?)

What Counts as Data? (It’s More Than Numbers)

By: Mandi Kopischke

February Series: Data as a Mirror: See and Know the System

Estimated read time: ~8 minutes 

What We Call Data Shapes How It Feels

When educators hear the word data, many picture spreadsheets, benchmarks, and dashboards, the kind I remember staring at late one evening, wondering why my gut sense of what was happening in my classroom felt invisible in the numbers. Scores color-coded red, yellow, and green. Percentages compared across classrooms, grades, or years.

Those numbers matter, but they are not the whole story, and much of the evidence is already happening, often unnoticed. When data is narrowly defined as only numbers, it can feel technical, distant, and even threatening. This feeling can limit one's ability to notice and act on the richness already around them.

Data as Human Experience: Contextual, Relational, and Real

Every day in schools, educators collect data long before a spreadsheet appears. We notice which students hesitate before entering the room, like the quiet student in my own class who only spoke after someone invited her into the conversation. We hear whose voices dominate group work and whose ideas are ignored. We observe patterns in behavior, engagement, questions asked, and questions avoided. We feel pauses and silences that signal comfort or discomfort. We listen to families describe their experiences navigating school systems. We feel the energy shift after a routine change or a community event.

This is the unspoken, observed, and anecdotal data of daily practice. When intentionally reflected on, it becomes the qualitative data of our system.

The challenge in many systems is not that educators aren’t using data. It’s that they’ve been taught to discount much of what they already know, unless it comes with numbers attached. Bryk and colleagues (2015) remind us that information only becomes meaningful when interpreted within the lived experience, routines, and relationships of a system. Numbers alone can’t explain why something is happening; they require context, relationships, and professional judgment to make sense.

Safir and Dugan (2021) call this broader evidence base street data: the stories, observations, identity markers, and relational patterns that reveal how systems are experienced—particularly by students and communities historically marginalized by traditional data practices. Street data is not “soft.” It is equity-centered evidence that surfaces what numbers often obscure. When leaders treat data as purely technical, they unintentionally narrow the field of vision. When leaders treat data as human, they expand it. A test score may show a decline. Street data asks:

• Who is being most affected?
• What conditions are shaping this experience?
• Whose voices are missing from our interpretation?

When Data Feels Heavy

When numerical data is positioned as the most legitimate, or only allowable, form of evidence, several patterns emerge across schools and districts:

• Educators wait to act until they have “enough data,” even when early signs are visible.
• Teams debate interpretations instead of exploring meaning.
• Professional instincts are quietly set aside in favor of compliance.
• Conversations become about justification rather than learning.

Research on sensemaking (Weick, 1995) and organizational learning (Argyris & Schön, 1978) shows that people make meaning through interaction, reflection, and shared interpretation. When systems restrict what counts as data, they restrict learning itself.

The narrowing also has equity implications. Ladson-Billings (1995) and Hammond (2015) remind us that culturally responsive decision-making requires attending to belonging, engagement, identity, and access. These elements that cannot be captured by numbers alone. If leaders want to understand how students experience school, they must look beyond performance indicators to relational and contextual evidence.

Leadership & Practice Lens: Noticing as Data

Rather than replacing numerical data, effective leaders broaden the ecosystem of evidence they consider. In human-centered data systems, leaders intentionally attend to multiple strands at once:

• Quantitative data: assessments, attendance, progress monitoring
• Qualitative data: student work, conversations, reflections, family input
• Behavioral data: engagement patterns, routines, participation, transitions
• Contextual data: community needs and voice, staffing shifts, policy changes, timing

Each strand strengthens the others. Numbers help identify patterns. Stories help explain them. Observations guide next steps. Context adds meaning to both. Leaders foster psychological safety (Edmondson, 1999) when they model curiosity, invite sharing, and honor diverse perspectives. By valuing multiple forms of evidence, leaders signal that professional noticing and relational insight are essential parts of the work, not optional extras. Before leaders ask teams to analyze or act, they can begin with a simpler move: structured noticing.

System & Structure Lens: A Small Tool that Protects Thinking

Downloadable Tool: “What Are We Noticing?” — A Data Noticing Protocol
This one-page protocol supports teams in reflecting on patterns in student learning, relationship dynamics in classrooms, contextual factors, and questions that emerge from observations.

In my experience coaching leadership teams, I’ve seen how even five minutes of individual reflection can surface insights no one anticipated, and build shared understanding before a single chart is opened. This work can be guided by the Liberating Structure 1-2-4-ALL, ensuring that individual insights, small group discussion, and whole-team meaning-making all contribute to shared understanding.

The protocol invites teams to notice:

• Patterns in student learning and engagement
• Relational dynamics and classroom routines
• Contextual factors influencing current conditions
• Questions emerging from observations

Used consistently, this approach elevates diverse perspectives, surfaces human-centered data, and prepares teams for deeper inquiry before jumping to conclusions.

Reflect. Connect. Grow.

Reflect (individual sense-making):

• Where does data in your system feel heavier than it should?
• What emotions surface first when data is introduced?

Connect (system patterning):

• Who currently carries the responsibility for noticing and interpreting data?
• What patterns repeat when clarity is missing?

Grow (intentional direction without urgency):

• What small structural shift could protect thinking while supporting human-centered data?
• Where might slowing down actually move us forward?

Looking Ahead

Broadening what counts as data is not about lowering standards or avoiding accountability. It is about strengthening decision-making by grounding it in how systems are actually experienced.

In the next post in this series, The Leader’s Role: Asking Better Questions, we’ll explore how leadership questions shape whether data becomes a tool for learning or a source of fear. And in the final post, we’ll examine how data literacy rooted in curiosity, not compliance, can belong to every educator.

Data doesn’t drive improvement on its own. People do.

When leaders honor the full ecosystem of evidence: numbers, stories, behaviors, interactions, and even silence, data becomes not something done to educators, but something built with them.

References
Argyris, C., & Schön, D. A. (1978). Organizational learning: A theory of action perspective. Addison-Wesley.
Bryk, A. S., Gomez, L. M., Grunow, A., & LeMahieu, P. G. (2015). Learning to improve: How America’s schools can get better at getting better. Harvard Education Press.
Edmondson, A. C. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350–383.
Hammond, Z. (2015). Culturally responsive teaching and the brain. Corwin.
Ladson-Billings, G. (1995). Toward a theory of culturally relevant pedagogy. American Educational Research Journal, 32(3), 465–491.
Safir, S., & Dugan, J. (2021). Street data: A next-generation model for equity, pedagogy, and school transformation. Corwin.
Weick, K. E. (1995). Sensemaking in organizations. Sage.

This week’s Leadership Knowledge Commons learning entry is written by guest author, Mandi Kopischke (former school social worker, classroom teacher, mentor coach, and team leader; now a regional school advocate). Mandi brings a grounded, human-centered lens to the work. Check out her leader and learner profile!