Uploaded May 2020 | Updated September 2026, 1 week ago
p-hacking is the misuse and abuse of p-values and results in being fooled by false positives. Some forms of p-hacking are obvious, but other are much more subtle. In this video, we talk about two forms of p-hacking and how to avoid them.
NOTE: This StatQuest assumes that you are already familiar with p-values, if not check out:
p-values: What they are and how to interpret them: youtu.be/vemZtEM63GY
How to calculate p-values: youtu.be/JQc3yx0-Q9E
Also, if you'd like to learn more about FDR, check out the 'Quest: youtu.be/K8LQSvtjcEo
For a complete index of all the StatQuest videos, check out:
statquest.org/video-index
If you'd like to support StatQuest, please consider...
Patreon: patreon.com/statquest
...or...
YouTube Membership: youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
statquest.org/statquest-store
...or just donating to StatQuest!
paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
twitter.com/joshuastarmer
0:00 Awesome song and introduction
0:28 Simple example of p-hacking
2:21 p-hacking defined
2:38 Multiple testing problem explained
7:29 Using FDR to compensate for multiple testing
8:52 A subtle form of p-hacking
11:26 Power analysis to prevent p-hacking
12:12 Summary of concepts
#statquest #pvalue
p-hacking is the misuse and abuse of p-values and results in being fooled by false positives. Some forms of p-hacking are obvious, but other are much more subtle. In this video, we talk about two forms of p-hacking and how to avoid them.
NOTE: This StatQuest assumes that you are already familiar with p-values, if not check out:
p-values: What they are and how to interpret them: youtu.be/vemZtEM63GY
How to calculate p-values: youtu.be/JQc3yx0-Q9E
Also, if you'd like to learn more about FDR, check out the 'Quest: youtu.be/K8LQSvtjcEo
For a complete index of all the StatQuest videos, check out:
statquest.org/video-index
If you'd like to support StatQuest, please consider...
Patreon: patreon.com/statquest
...or...
YouTube Membership: youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
statquest.org/statquest-store
...or just donating to StatQuest!
paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
twitter.com/joshuastarmer
0:00 Awesome song and introduction
0:28 Simple example of p-hacking
2:21 p-hacking defined
2:38 Multiple testing problem explained
7:29 Using FDR to compensate for multiple testing
8:52 A subtle form of p-hacking
11:26 Power analysis to prevent p-hacking
12:12 Summary of concepts
#statquest #pvalue
