Skip to content

Instantly share code, notes, and snippets.

@davidmanheim
Forked from johnmyleswhite/statistical_maxims.md
Last active August 25, 2016 07:49
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save davidmanheim/890e6bc90bc7b8d6d226 to your computer and use it in GitHub Desktop.
Save davidmanheim/890e6bc90bc7b8d6d226 to your computer and use it in GitHub Desktop.
Statistical Maxims
  • Correlation is not causation (???)
  • No causation without manipulation. (Holland)
  • All models are wrong, some are useful. (Box)
  • Statistics is the science of uncertainty. (arguably Tukey)
  • Statistics is the science of learning from experience, especially experience that arrives a little bit at a time. (Efron)
  • Empirically observed covariation is a necessary but not sufficient condition for causality. (Tufte)
  • Correlation is not causation but it sure is a hint. (Tufte)
  • In a causal model, correlation implies causation (somewhere). (Paul F Christiano)
  • Reality is the ultimate judge of any theory (???)
  • The Folk Theorem of Statistical Computing: When you have computational problems, often there’s a problem with your model. (Gelman)
  • Researcher degrees of freedom do not feel like degrees of freedom because, conditional on the data, each choice appears to be deterministic. (Gelman, Garden of Forking Paths)
  • Multiple comparisons can be a big problem, without any implication that the researchers in question are cheating or stupid or trying to manipulate the system (Gelman, Garden of Forking Paths)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment