Dance p 3 Mar09
Geoff Cumming2 HN recommenders · recommended in 2 months, 2011–2015
explainer · intro · evergreen · 2011–2015 on HN
Geoff Cumming uses a simulation to show how wildly the p value varies from one replication to the next because of sampling variability. He argues for estimation and confidence intervals over null hypothesis significance testing.
Recommended as a vivid visual demonstration of how unreliable p-values are.
Up next
7 mo on HNJonathan Blow: Game design: the medium is the message
CreativeMornings HQ
7 HN recommender · 2013–2020
14 mo on HNA Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt
Enthought
15 HN recommender · 2015–2026
11 mo on HNDON'T PANIC — Hans Rosling showing the facts about population
Gapminder Foundation
8 HN recommender · 2017–2021
8 mo on HNIs Most Published Research Wrong?
Veritasium
8 HN recommender · 2017–2025
6 mo on HNHow not to be ignorant about the world | Hans and Ola Rosling
TED
5 HN recommender · 2015–2023
6 mo on HNI don't like notebooks.- Joel Grus (Allen Institute for Artificial Intelligence)
O'Reilly
6 HN recommender · 2018–2025
6 mo on HNVisiData Lightning Demo at PyCascades 2018
Saul Pwanson
6 HN recommender · 2018–2025
6 mo on HNEmacs + org-mode + python in reproducible research; SciPy 2013 Presentation
Enthought
5 HN recommender · 2014–2018
5 mo on HNI Like Notebooks
Jeremy Howard
4 HN recommender · 2020–2025
4 mo on HNInteractive notebooks ~ Pluto.jl | Fons van der Plas | JuliaCon 2020
The Julia Programming Language
6 HN recommender · 2020–2021
6 mo on HNYou Suck at Excel - Joel Spolsky (Reupload)
Cool Bug Facts
7 HN recommender · 2024–2026
5 mo on HNMichael Stonebraker | Big Data is (at least) Four Different Problems
Michigan Engineering
5 HN recommender · 2015–2024
3 comments from Hacker News
The audio is a bit quiet but the 'dance of the p values' video [1] linked to by the article is absolutely fantastic and well worth watching. [1] ▶ this video
The p-value [1] criterion is often used to test a proposed hypothesis in medical and social science research papers. When you stumble upon something along the lines of "studies that shown that eating broccoli makes people happy" in your everyday life, it comes down to the p-value calculation being small enough <0.05 for the before and after gathered datasets. The p-value method is practically a standard for scientific reporting in some fields. It also has some drastic shortcomings, including, e,g., dramatic instability for tests with only little data [2]. Naturally, people realize that and try to use additional tools and criteria when available. However, scientists are pretty brutally incentivized to publish positive results and, as a result, more often than it should be, too much weight is put on the single p-value criterion. With issues like this in mind, in my opinion, it makes sense to be somewhat skeptical when seeing reports in the news that "A effects B" and definitely not to rush with the conclusions. Trivial, I know. The [3] video pretty much sums it up and by all means is worth a watch. ------------------- [1] link [2] link [3] ▶ this video
I can't claim to understand much of the statistics, but according to [1], p-values are pretty sketchy as a measure of "is this likely to be true?" [1] ▶ this video