Measurement validity: are we measuring what the label says?

A label can sound broader than the observation underneath it. When we read a result, we want to find out how the concept named in the headline became something recorded in the study.

Counted objects, enlarged meaning

Imagine an invented family project in which someone counts the number of items on a hallway shelf and labels the result “how welcoming our home is.”

The count can describe the items on that shelf. The label introduces a much broader idea. It does not tell us whether visitors felt welcome, whether family members could use the space or whether some objects were deliberately displayed.

Even if two people agree exactly on the item count, that agreement does not establish the broader interpretation. They could consistently count the same thing while still not measuring the concept named on the sheet.

Unpack the label in three lines

You can examine one claim without evaluating an entire questionnaire:

• Named concept: what does the writer say they are measuring?
• Recorded information: what was actually asked, counted or observed?
• Supported interpretation: what evidence connects the two?

For the fictional shelf sheet, the first line says “welcoming,” the second says “number of objects,” and the third remains unanswered. It would be more accurate to rename the sheet “items on the hallway shelf” than to pretend the count settles everybody's experience of the home.

Perspectives reveal different questions

A child might see a favorite drawing among those objects. A grandparent may care about space to put a bag. An adult might want the shelf to hold keys where they can find them. A partner might like the display exactly as it is.

Those views do not prove a particular measure valid or invalid in research. They show why our invented broad label has not yet identified which question it means to answer. We can discuss the shelf without scoring the household's character.

When reading an ADHD-related report

Locate the methods behind the outcome name. Note the instrument, task or observation described and which interpretation the authors actually support. If the article only gives a headline, you may need the full report before filling the third line.

This page does not validate a clinical scale, interpret someone's score or suggest replacing a professional assessment with a homemade record. It also does not claim that a single short definition covers every form of validity.

Our reading task is to keep the measured thing and its proposed meaning connected visibly. A precise, modest label is preferable to an appealing interpretation that the available information has not established.

Source

[1] Office of Research Integrity. Module 4: Methods of Information Collection — Section 2:2. Office of Research Integrity, U.S. Department of Health and Human Services. No page-specific publication date stated. Accessed September 6, 2026. Section 2.2 Accuracy (Validity), definition and opening paragraphs, retrieved lines 20–27. Supports the adjacent attributed claim. All illustrative scenes, numbers and optional note formats are original inventions, not source findings.

Related guides

• measurement reliability
• research protocol
• effect size
• evidence