Best intro to p values
The lesson on what p values do not mean should be required reading for anyone presenting data.
Browse
Understand distributions, uncertainty, confidence intervals, hypothesis tests, A/B tests and regression by simulating them in Python
Created by Kwame Mensah
Statistics is how data science deals with uncertainty. Is a new checkout design really better, or did we get lucky? How sure are we about an average from 200 survey responses? Is the relationship in this chart real, or noise? Without statistics, data work produces confident numbers that may be wrong.
Many people find statistics hard because it is taught as a list of formulas. This course takes a different route: we simulate first. Using Python, we generate data, repeat experiments thousands of times and watch what happens. Once you have seen a sampling distribution form on your screen, the formulas become summaries of something you already understand.
We use NumPy, pandas, SciPy and statsmodels, with matplotlib for charts. Every lesson has a notebook.
You should be comfortable with basic Python and pandas. School algebra is enough for the maths; we explain each formula in words before writing it down.
Statistician and ML engineer teaching statistics and how to ship models responsibly
I trained as a statistician and now work on machine learning systems, from experiment design to keeping models healthy after deployment. I spend a lot of time explaining uncertainty to people who would prefer a single number.
My courses focus on intuition first. We simulate things in Python before we use a formula, so the formula has something to stand on. Then we look at the tools teams actually use, such as scikit-learn, MLflow and FastAPI.
I want my students to be the person on the team who asks how big the sample was and how the model will be monitored.
The lesson on what p values do not mean should be required reading for anyone presenting data.
I took statistics at university and forgot it. Seeing sampling distributions form in a notebook finally made it make sense.
The peeking simulation convinced my whole team to stop checking experiments daily.
Kwame is careful about what methods can and cannot tell you. I wanted a little more on Bayesian approaches.
Such a common confusion, explained once and for all. The bootstrap lesson was a bonus.
As a product manager I followed most of it. The regression section was the hardest but worth it.
Content is strong, but I would have liked more slides or diagrams between the notebook sessions.