Uploaded November 2020 | Updated September 2026, 2 weeks ago
About the speaker
For details about the speaker, please see jessicakayflake.com
About the talk
Questionable measurement practices (QMPs) are decisions researchers make that raise doubts about the validity of the measures, and ultimately the validity of study conclusions. They make it impossible to evaluate a wide range of potential validity threats to the study’s conclusions. I will demonstrate that psychology is plagued by a measurement schmeasurement attitude: QMPs are common, offer a stunning source of researcher degrees of freedom, pose a serious threat to cumulative psychological science, but are largely ignored. I will review a list of questions researchers and consumers of scientific research can consider to identify and avoid QMPs. Transparent answers to these measurement questions promote rigorous research, allow for thorough evaluations of a study’s inferences, and are necessary for meaningful replication studies.
About RIOT Science Club
The RIOT Science Club gives talks/workshops on Reproducible, Interpretable, Open & Transparent Science.
Slides and/or recordings of all past and future RIOTS Clubs are stored on our Open Science Framework Page: osf.io/8y7h2/. You can also subscribe to our mailing list, to receive regular information on upcoming talks and workshops, any local events and vacancies for positions in open and reproducible research.
You can also find us on Twitter @riotscienceclub.
If you would like to give a talk or workshop for The RIOTS Club, please email riotscienceclub@kcl.ac.uk.
About the speaker
For details about the speaker, please see jessicakayflake.com
About the talk
Questionable measurement practices (QMPs) are decisions researchers make that raise doubts about the validity of the measures, and ultimately the validity of study conclusions. They make it impossible to evaluate a wide range of potential validity threats to the study’s conclusions. I will demonstrate that psychology is plagued by a measurement schmeasurement attitude: QMPs are common, offer a stunning source of researcher degrees of freedom, pose a serious threat to cumulative psychological science, but are largely ignored. I will review a list of questions researchers and consumers of scientific research can consider to identify and avoid QMPs. Transparent answers to these measurement questions promote rigorous research, allow for thorough evaluations of a study’s inferences, and are necessary for meaningful replication studies.
About RIOT Science Club
The RIOT Science Club gives talks/workshops on Reproducible, Interpretable, Open & Transparent Science.
Slides and/or recordings of all past and future RIOTS Clubs are stored on our Open Science Framework Page: osf.io/8y7h2/. You can also subscribe to our mailing list, to receive regular information on upcoming talks and workshops, any local events and vacancies for positions in open and reproducible research.
You can also find us on Twitter @riotscienceclub.
If you would like to give a talk or workshop for The RIOTS Club, please email riotscienceclub@kcl.ac.uk.
