Uploaded May 2025 | Updated November 2026, 3 hours ago
Studying psychology? My intro psych tutorials are becoming courses with practice questions. Sign up for 10% off when they open: 👉 voovostudy.com/s/MFnWE
In this video I explain the concept of statistical significance, including alpha levels, probability values (p-values) and the critical region or rejection region of a comparison distribution.
Practice Questions & Sample Answers
- What does it mean to say that a result is "statistically significant"?
A result being statistically significant means that the test statistic has reached a threshold for how unlikely it is to occur by chance when the null hypothesis is true, and this means that the null hypothesis can be rejected as the best explanation for what has been observed.
- What does the alpha-level refer to?
The alpha level sets the threshold for reaching significance and indicates the long-run probability that a result would occur by chance. For example, an alpha level of .05 would indicate a 5% probability of reaching a result at least as extreme as what was observed.
- What is the difference between a one-tailed, or directional test, and a two-tailed, or non-directional test?
A one-tailed or directional test places the entire critical region in one tail of the comparison distribution for the test statistic, while a two-tailed (nondirectional) test splits the alpha-level across both tails, allowing for rejection of the null hypothesis if a result is sufficiently extreme in either direction.
- What is the most common alpha-level used in psychological research, and what does it mean if a test statistic falls in the critical region for this alpha-level?
Most psychological research uses an alpha level of .05, and when a test statistic result falls beyond the threshold for this level the result can be considered significant and the null hypothesis can be rejected.
- What is the difference between single-event and long-run probability, and why is this important for interpreting the results of an individual study?
Single event probability refers to the probability of a particular isolated event occurring, while long-run probability refers to the expected probability of an event over many trials. It's important to remember that p-values refer to long-run probability if a study were repeated many times, and can't tell us the single-event probability for observing a particular result in a single study.
- What is the difference between statistical vs. practical significance? Why is this important when interpreting results?
Statistical significance just refers to mathematical criteria for how unlikely a result is based on the expected long-run probability, while practical significance refers to the meaning and impact of an effect. This is important to remember because an intervention can lead to a statistically significant result without necessarily indicating an effect has practical applications.
Studying psychology? My intro psych tutorials are becoming courses with practice questions. Sign up for 10% off when they open: 👉 voovostudy.com/s/MFnWE
In this video I explain the concept of statistical significance, including alpha levels, probability values (p-values) and the critical region or rejection region of a comparison distribution.
Practice Questions & Sample Answers
- What does it mean to say that a result is "statistically significant"?
A result being statistically significant means that the test statistic has reached a threshold for how unlikely it is to occur by chance when the null hypothesis is true, and this means that the null hypothesis can be rejected as the best explanation for what has been observed.
- What does the alpha-level refer to?
The alpha level sets the threshold for reaching significance and indicates the long-run probability that a result would occur by chance. For example, an alpha level of .05 would indicate a 5% probability of reaching a result at least as extreme as what was observed.
- What is the difference between a one-tailed, or directional test, and a two-tailed, or non-directional test?
A one-tailed or directional test places the entire critical region in one tail of the comparison distribution for the test statistic, while a two-tailed (nondirectional) test splits the alpha-level across both tails, allowing for rejection of the null hypothesis if a result is sufficiently extreme in either direction.
- What is the most common alpha-level used in psychological research, and what does it mean if a test statistic falls in the critical region for this alpha-level?
Most psychological research uses an alpha level of .05, and when a test statistic result falls beyond the threshold for this level the result can be considered significant and the null hypothesis can be rejected.
- What is the difference between single-event and long-run probability, and why is this important for interpreting the results of an individual study?
Single event probability refers to the probability of a particular isolated event occurring, while long-run probability refers to the expected probability of an event over many trials. It's important to remember that p-values refer to long-run probability if a study were repeated many times, and can't tell us the single-event probability for observing a particular result in a single study.
- What is the difference between statistical vs. practical significance? Why is this important when interpreting results?
Statistical significance just refers to mathematical criteria for how unlikely a result is based on the expected long-run probability, while practical significance refers to the meaning and impact of an effect. This is important to remember because an intervention can lead to a statistically significant result without necessarily indicating an effect has practical applications.










