Repository navigation
Home
Data is the faint imprint the world leaves when it touches measurement.
A star flickers. A market stirs. A patient breathes. A machine turns its gears. A student answers. A planet bends light by a fraction too small for the eye to see. And yet, each event leaves a trace: a number, a category, a timestamp, a signal, a change, a difference. Data is that trace.
It is tempting to think of data as cold: rows, columns, files, records. But data is not born in spreadsheets. It begins in reality, in variation, in uncertainty, in repetition, in surprise. Before it is stored, cleaned, modeled, or explained, it is simply this: the world becoming legible.
This guide begins there.
Not with tools, nor with software, nor with the rituals of technique, but with the thing itself. What data is. Why it exists. What it preserves. What it loses. And why so much of our understanding depends on learning to read it well.
To study data is to study the boundary between chaos and pattern.
Between noise and structure.
Between what happened, and what can be known.
Between certainty and wonder.
Even a good dataset is never the world itself. It is a translation. And every translation has grammar, distortion, omission, and information. It contains power: to change our decisions, policies, opinions, or even habits. If we dare to listen. If we dare to learn that language. To read those marks.
So this is a book about marks that stand for things. About measurements that pretend to capture motion, populations, choices, errors, lives. About the subtle miracle by which scattered observations can become knowledge.
Data is humble. A list of values can look trivial. And yet from such lists we infer storms, epidemics, galaxies, inequalities, habits, failures, and laws.
This is why data matters.
Because somewhere between a raw observation and an idea, there is a transformation:
from fact to form,
from form to pattern,
from pattern to meaning,
from meaning to knowledge.
And that transformation is one of the great intellectual adventures.
Welcome to Data.
Legend:
- 🔰 Start here
- 🏵️ Important Insight
- ⚙️ Technical and applications
- 💻 Some Code
- ⚜️ Advanced Topics
- 00.1 What Is Data?
-
00.2 Three Models of Reality (planned)
- 00.2.1 The Linguistic
- 00.2.2 The Symbolic
- 00.3.3 The Mathematical
- 00.3 Maps and Reality
- 00.4 Aside: Hossack, data as structure
- 00.5 Aside: Chomsky, data as evidence
- 01.1 🔰 Sets and Logic (planned)
- 01.2 Sample Space
- 01.3 Randomness and Pattern
- 01.4 Outcomes and Events
- 01.5 Finite and Infinite Sample Spaces
- 02.1 🔰 Functions (planned)
- 02.2 Types Are Alphabets
- 02.3 Random Variables: X : Ω → 𝒳 (planned)
- 02.4 Measurement Scales
- 02.5 Numerics
- 03.1 🔰 Fractions and Proportions (planned)
- 03.2 Randomness vs Uncertainty
- 03.3 Probability: Events, Conditioning, Bayes
- 03.4 Bayes' Theorem, Step by Step
- 03.5 Expected Value and Variance (planned)
- 03.6 Bernoulli (ES)
- 03.7 Discrete Uniform (ES)
- 03.8 🧗 Kolmogorov: Ω, 𝒜, ℙ
- 04.1 🔰 Powers and Logarithms (planned)
- 04.2 Rarity
- 04.3 Information Theory (Shannon)
- 04.4 Entropy: Three Views
- 05.1 🔰 Sums and Averages (planned)
- 05.2 Data, Measured
- 05.3 Sampling (ES)
- 05.4 Population and Sample (ES)
- 05.5 Types of Sampling (ES)
- 05.6 Choosing Summaries & Visuals
- 05.7 Visualization
- 05.8 Plots
- 06.1 What Is Statistics?
- 06.2 🔰 Curves and Area (planned)
- 06.3 Statistical Thinking
- 06.4 Variation
- 06.5 Uncertainty
- 06.6 Parameters vs Estimators (ES)
- 06.7 Distributions
- 06.8 Statistical Modeling
- 06.9 Statistical Methods
- 07.1 Data Storage: Databases (stub)
- 07.2 ER Diagrams
- 07.3 Chen Diagrams
- 07.4 SQL (planned)
- 07.5 Formal Languages and Regular Expressions (planned)
- 07.6 Reproducibility (planned)
08 · μ(x) — Fuzzy - When data is flexible
- 08.1 Fuzzy Logic (planned)
- 08.2 Fuzzy Numbers (planned)
- 08.3 Possibility vs Probability (planned)
09 · x(t) — Signals and systems - Where patterns live
- 09.1 Signals (stub)
- 09.2 Sampling and Aliasing (planned)
- 09.3 Convolution (planned)
- 09.4 Frequency (planned)
- 10.1 🔰 Vectors and Matrices (planned)
- 10.2 Mathematical Modelling (planned)
- 11.1 🔰 Derivatives (planned)
- 11.2 Convex Optimisation (planned)
- 12.1 Supervised Learning (planned)
- 12.2 Data in Language Models
- 13.1 Cause and Effect (planned)
- 13.2 Capstone Guide (planned)
