Statistical Inference
Go from a sample to a claim about the population. Build confidence intervals, run hypothesis tests and see the trade-off between the two kinds of error.
Key concepts
Estimation
Use a sample statistic to estimate an unknown population parameter
Confidence Level
How often the interval-building method captures the true value
p-Value
How surprising the data would be if the null hypothesis were true
Errors and Power
False alarms, missed effects and the chance of detecting a real effect
Visualizations
Confidence Intervals
IntermediateDraw 100 samples, build an interval from each and count how many capture the true mean
Margin of ErrorConfidence LevelStandard Errort Interval
Open Hypothesis Testing
IntermediateRun a z-test step by step and see the test statistic, rejection region and p-value
Null Hypothesisp-ValueSignificance Levelz-Test
Open Type I & II Errors and Power
AdvancedSlide the effect size, sample size and α and watch the error rates and power trade off
False PositiveFalse NegativePowerEffect Size
Open