Repository navigation
? Finite and Infinite Sample Spaces
Not all sample spaces look alike.
Some are finite:
Some are countably infinite:
Some are continuous:
This matters because probability behaves differently in each case.
Finite sample spaces are the most intuitive.
A die, a card draw, a finite survey response set: these all give a small visible universe of possibilities.
In finite spaces:
- outcomes can be listed
- events can be enumerated
- probabilities can often be assigned directly
These are the ideal starting point for intuition.
Sometimes the possible outcomes never end, yet they can still be counted one by one.
Examples:
- the number of customers arriving before noon
- the number of failures before the first success
- the number of emails received in a day
These live naturally in spaces like:
This is already a step beyond pure enumeration, because the space is endless, but still discrete.
Then there are outcomes that vary across intervals.
Examples:
- time
- height
- temperature
- position
- voltage
- measurement error
Here the natural model is not ℕ, but ℝ, or some interval inside it.
This changes everything.
In a continuous space, one cannot usually assign a positive probability to each individual point in the same way as in a finite space.
Instead, probability lives on sets of values:
- intervals
- regions
- measurable subsets
⚜️ This is a crucial transition:
in finite spaces, probability often feels like counting.
in continuous spaces, probability becomes measure.
Reality may be continuous while instruments are discrete.
Or reality may be modeled as discrete while the underlying process is continuous.
A thermometer prints a finite decimal expansion.
The model may still use real numbers.
So the choice between finite and infinite spaces is not only about ontology.
It is also about resolution, convenience, and explanatory power.
Once the sample space becomes infinite, intuitive “just assign values to outcomes” reasoning begins to fail.
One needs a more careful theory of:
- which sets count as events
- how probabilities extend across unions
- how to treat intervals, limits, and complements
This is the road to Kolmogorov.
The infinite is where probability stops being only common sense and becomes a true mathematical architecture.
Legend:
- 🔰 Start here
- 🏵️ Important Insight
- ⚙️ Technical and applications
- 💻 Some Code
- ⚜️ Advanced Topics
- 00.1 What Is Data?
-
00.2 Three Models of Reality (planned)
- 00.2.1 The Linguistic
- 00.2.2 The Symbolic
- 00.3.3 The Mathematical
- 00.3 Maps and Reality
- 00.4 Aside: Hossack, data as structure
- 00.5 Aside: Chomsky, data as evidence
- 01.1 🔰 Sets and Logic (planned)
- 01.2 Sample Space
- 01.3 Randomness and Pattern
- 01.4 Outcomes and Events
- 01.5 Finite and Infinite Sample Spaces
- 02.1 🔰 Functions (planned)
- 02.2 Types Are Alphabets
- 02.3 Random Variables: X : Ω → 𝒳 (planned)
- 02.4 Measurement Scales
- 02.5 Numerics
- 03.1 🔰 Fractions and Proportions (planned)
- 03.2 Randomness vs Uncertainty
- 03.3 Probability: Events, Conditioning, Bayes
- 03.4 Bayes' Theorem, Step by Step
- 03.5 Expected Value and Variance (planned)
- 03.6 Bernoulli (ES)
- 03.7 Discrete Uniform (ES)
- 03.8 🧗 Kolmogorov: Ω, 𝒜, ℙ
- 04.1 🔰 Powers and Logarithms (planned)
- 04.2 Rarity
- 04.3 Information Theory (Shannon)
- 04.4 Entropy: Three Views
- 05.1 🔰 Sums and Averages (planned)
- 05.2 Data, Measured
- 05.3 Sampling (ES)
- 05.4 Population and Sample (ES)
- 05.5 Types of Sampling (ES)
- 05.6 Choosing Summaries & Visuals
- 05.7 Visualization
- 05.8 Plots
- 06.1 What Is Statistics?
- 06.2 🔰 Curves and Area (planned)
- 06.3 Statistical Thinking
- 06.4 Variation
- 06.5 Uncertainty
- 06.6 Parameters vs Estimators (ES)
- 06.7 Distributions
- 06.8 Statistical Modeling
- 06.9 Statistical Methods
- 07.1 Data Storage: Databases (stub)
- 07.2 ER Diagrams
- 07.3 Chen Diagrams
- 07.4 SQL (planned)
- 07.5 Formal Languages and Regular Expressions (planned)
- 07.6 Reproducibility (planned)
08 · μ(x) — Fuzzy - When data is flexible
- 08.1 Fuzzy Logic (planned)
- 08.2 Fuzzy Numbers (planned)
- 08.3 Possibility vs Probability (planned)
09 · x(t) — Signals and systems - Where patterns live
- 09.1 Signals (stub)
- 09.2 Sampling and Aliasing (planned)
- 09.3 Convolution (planned)
- 09.4 Frequency (planned)
- 10.1 🔰 Vectors and Matrices (planned)
- 10.2 Mathematical Modelling (planned)
- 11.1 🔰 Derivatives (planned)
- 11.2 Convex Optimisation (planned)
- 12.1 Supervised Learning (planned)
- 12.2 Data in Language Models
- 13.1 Cause and Effect (planned)
- 13.2 Capstone Guide (planned)