Login
📚 Statistical Inference for Everyone
Chapters ▾
1 Introduction to Probability2 Applications of Probability3 Random Sequences and Visualization4 Introduction to Model Comparison5 Applications of Model Comparison6 Introduction to Parameter Estimation7 Priors, Likelihoods, and Posteriors8 Common Statistical Significance Tests9 Applications of Parameter Estimation and Inference10 Multi-parameter Models11 Introduction to MCMC12 Concluding Thoughts13 Appendix A: Computational Analysis14 Appendix B: Notation and Standards15 Appendix C: Common Distributions and Their Properties16 Appendix D: Tables

15.6 Normal (Gaussian)

The Normal distribution: a symmetric bell curve labeled p(x)=Normal(0,1), centered at x=0 with peak height about 0.4, falling essentially to zero beyond three units either side.
Figure C.6. The normal distribution.

Normal distribution The Normal distribution is the most common distribution found in all of statistical inference. It is the best prior distribution to use, when all you know is that your data has a constant true value and some constant variation around that true value. It is the posterior probability distribution for the unknown true value given N samples and the known deviation, σ. It is also the approximate form for nearly every distribution when you have many samples. The mathematical form for the normal, or Gaussian, is

N o r m a l ( μ , σ ) = 1 2 π σ 2 e − ( x − μ ) 2 / 2 σ 2

Three useful properties of σ for the normal distribution are the following:

  1. the normal distribution value at the maximum (i.e. at x=μ) is around 2.7 times larger than the value one-σ away from the maximum (at x=μ−σ and x=μ+σ)
  2. the total probability between these two points is 65%.
  3. 95% of the distribution lies between μ−2σ and μ+2σ (see Figure 7.3)

Adapted from Statistical Inference for Everyone, by Brian Blais (Bryant University), licensed under CC BY-SA 4.0 (dual-licensed under the GNU FDL 1.2 or later; this adaptation uses the CC BY-SA grant). Changes were made; this adaptation is distributed under the same license. License: CC-BY-SA-4.0.