We aim to understand some properties that characterize Gaussian distributions and make them ubiquitous in all fields of science, starting from Maxwell's Law in statistical mechanics. We will explain some key yet elementary heuristic ideas of the proofs, keeping the mathematics as simple as possible. Prerequisite: calculus.