Repository navigation
2.? Uncertainty
Uncertainty is one of the central words of statistics, and one of the most misunderstood.
It is tempting to think uncertainty means only that we do not know enough. But statistics teaches something subtler:
Uncertainty is not merely absence of knowledge,
it is structured limitation within a variable world
A process may be only partly observed.
A sample may be finite.
Measurements may fluctuate.
Signals may be noisy.
Causes may be multiple and hidden.
So uncertainty is more than emptiness. Not just a hole in our understandment.
Emptiness has shape, source, and consequence. The hole has edges. The shape of the hole is revealing a universe inside.
Uncertainty enters statistics through several doors at once.
We rarely observe everything.
A sample is smaller than a population.
A time series is shorter than the process that generated it.
A survey is narrower than the society it tries to represent.
So there is always an informational gap.
Even when we observe carefully, the world itself fluctuates.
Two patients with similar conditions may respond differently.
Two measurements of the same quantity may differ slightly.
Two days of traffic may not align.
Variation produces irreducible spread in what we can expect.
No measurement system is infinitely sharp.
Sensors drift.
Observers differ.
Categories blur.
Definitions carry ambiguity.
The map is always less than the territory.
Processes often depend on factors we do not observe or cannot fully measure. There can be a horizon where knowledge is uncertain, time can hide the signal into noise, or a veil can filter information out.
This makes even a rich dataset incomplete in principle.
A crucial lesson of statistics is that uncertainty need not be shapeless.
One can be uncertain in an organized way.
This is exactly what distributions, confidence intervals, standard errors, and models are for.
Statistics does not say:
uncertainty disappears
It says:
uncertainty can be described, bounded, propagated, and reasoned about
That is one of the deepest civilizing moves in mathematics.
Not the destruction of uncertainty, but its articulation.
Confidence is often misunderstood as the opposite of uncertainty.
It is not.
Confidence is a way of living with uncertainty under explicit rules.
A confidence interval, for example, does not abolish doubt.
It gives doubt a disciplined geometric form.
Instead of saying:
we do not know
statistics tries to say:
here is the range within which the process plausibly lies, given the method and the assumptions
This is far more precise than certainty, and often more honest.
It is useful to distinguish three things:
There are multiple possible states compatible with what is known.
The reported value differs from the underlying value or target.
The categories or concepts themselves are not sharply defined.
These may overlap, but they are not identical.
A measurement can be precise and still uncertain in interpretation.
A category can be vague even when counted accurately.
A model can be exact and still uncertain because the process varies.
Statistics becomes clearer when these are not confused.
One of the most important forms of uncertainty is produced simply by sampling.
A sample mean is not the population mean.
A sample proportion is not the population proportion.
A fitted model on one dataset is not the final structure of the world.
Different samples would produce different summaries.
This is not a bug.
It is the basic condition of inference.
To infer from sample to population is to reason under sampling uncertainty.
That is why probability becomes the hidden engine beneath statistics.
Probability describes what could happen across repeated sampling.
Statistics uses that structure to reason from the one sample we actually have.
One of the greatest dangers in statistics is false certainty.
This happens when:
- a point estimate is mistaken for a final truth
- a model fit is mistaken for reality itself
- a p-value is mistaken for certainty
- a precise number is mistaken for a complete answer
Precision is not the same as security.
A result written to six decimals may still rest on fragile assumptions, small samples, unstable processes, or weak measurement.
⚜️ Statistics does not become stronger by pretending uncertainty is gone.
It becomes stronger by showing where uncertainty remains.
Uncertainty is not an annoying afterthought added at the end of analysis.
It is one of the main things analysis is about.
Without uncertainty:
- prediction would be trivial
- inference would be unnecessary
- modeling would be mere description
- decision-making would not require judgement
Uncertainty is what turns information into a live problem.
It forces us to ask:
- how stable is this result?
- how sensitive is this conclusion?
- what range of explanations remains open?
- what could change if the sample were different?
These are not signs of weakness.
They are signs of seriousness.
Statistics is often described as the science of learning from data.
That is true, but incomplete.
It is also the science of learning without pretending to know more than the data can justify.
That is why uncertainty is not a stain on statistics.
It is one of its moral virtues.
Legend:
- 🔰 Start here
- 🏵️ Important Insight
- ⚙️ Technical and applications
- 💻 Some Code
- ⚜️ Advanced Topics
- 00.1 What Is Data?
-
00.2 Three Models of Reality (planned)
- 00.2.1 The Linguistic
- 00.2.2 The Symbolic
- 00.3.3 The Mathematical
- 00.3 Maps and Reality
- 00.4 Aside: Hossack, data as structure
- 00.5 Aside: Chomsky, data as evidence
- 01.1 🔰 Sets and Logic (planned)
- 01.2 Sample Space
- 01.3 Randomness and Pattern
- 01.4 Outcomes and Events
- 01.5 Finite and Infinite Sample Spaces
- 02.1 🔰 Functions (planned)
- 02.2 Types Are Alphabets
- 02.3 Random Variables: X : Ω → 𝒳 (planned)
- 02.4 Measurement Scales
- 02.5 Numerics
- 03.1 🔰 Fractions and Proportions (planned)
- 03.2 Randomness vs Uncertainty
- 03.3 Probability: Events, Conditioning, Bayes
- 03.4 Bayes' Theorem, Step by Step
- 03.5 Expected Value and Variance (planned)
- 03.6 Bernoulli (ES)
- 03.7 Discrete Uniform (ES)
- 03.8 🧗 Kolmogorov: Ω, 𝒜, ℙ
- 04.1 🔰 Powers and Logarithms (planned)
- 04.2 Rarity
- 04.3 Information Theory (Shannon)
- 04.4 Entropy: Three Views
- 05.1 🔰 Sums and Averages (planned)
- 05.2 Data, Measured
- 05.3 Sampling (ES)
- 05.4 Population and Sample (ES)
- 05.5 Types of Sampling (ES)
- 05.6 Choosing Summaries & Visuals
- 05.7 Visualization
- 05.8 Plots
- 06.1 What Is Statistics?
- 06.2 🔰 Curves and Area (planned)
- 06.3 Statistical Thinking
- 06.4 Variation
- 06.5 Uncertainty
- 06.6 Parameters vs Estimators (ES)
- 06.7 Distributions
- 06.8 Statistical Modeling
- 06.9 Statistical Methods
- 07.1 Data Storage: Databases (stub)
- 07.2 ER Diagrams
- 07.3 Chen Diagrams
- 07.4 SQL (planned)
- 07.5 Formal Languages and Regular Expressions (planned)
- 07.6 Reproducibility (planned)
08 · μ(x) — Fuzzy - When data is flexible
- 08.1 Fuzzy Logic (planned)
- 08.2 Fuzzy Numbers (planned)
- 08.3 Possibility vs Probability (planned)
09 · x(t) — Signals and systems - Where patterns live
- 09.1 Signals (stub)
- 09.2 Sampling and Aliasing (planned)
- 09.3 Convolution (planned)
- 09.4 Frequency (planned)
- 10.1 🔰 Vectors and Matrices (planned)
- 10.2 Mathematical Modelling (planned)
- 11.1 🔰 Derivatives (planned)
- 11.2 Convex Optimisation (planned)
- 12.1 Supervised Learning (planned)
- 12.2 Data in Language Models
- 13.1 Cause and Effect (planned)
- 13.2 Capstone Guide (planned)