Repository navigation
0. Data
The term data comes from the Latin datum, meaning “something given.”
In its most general sense, data refers to symbols, signals, or representations that stand in for objects, events, states, or concepts. But this simplicity masks a profound conceptual depth.
For data to exist there must be some sort of differentiation between elements, and a datum is a marker for that difference in one element. If an element's property is invariable, then it is a quality of the set, not of the object.
- If all elements share a quality, it is a property intrinsic to the set.
- If there's are differences in the qualities, then it is a datum of the element.
---
config:
layout: elk
look: handDrawn
theme: dark
---
flowchart TD
subgraph Set2["Set2: Data"]
A2{A}
B2((B))
C2[(C)]
end
subgraph Set1["Set1: No Data"]
A[A]
B[B]
C[C]
end
-
Raw observations or measurements
7greenhigh voltage
-
Data in the context of its type.
- "the temperature is 7°C”
- "the traffic light is green”
- "this cable is for high voltage applications”
-
Structured information that allows for choices to be made.
- “Below 10°C logistic operations must cease.”
- "When the light is green, you have preference to go."
- "This cable is safe for the installation."
-
The application of knowledge into action.
- Operation planning as weather changes.
- Driving with safety.
- Powering a building.
“Data are not information; information is data that has been processed into something meaningful.”
— Claude Shannon
Claude Shannon, in his groundbreaking 1948 paper "A Mathematical Theory of Communication", defined information in terms of entropy, a measure of uncertainty.
Data here is seen as symbols transmitted through a channel.
No concern for meaning, only for signal fidelity and probabilistic structure.
Data is measurable uncertainty.
Information = reduction in uncertainty when data is received.
“The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.”
— Claude Shannon
### 🤖 Turing: The Computational Perspective
Alan Turing approached data implicitly in his theory of computation:
Data = strings of symbols manipulated by an abstract machine, now known as a Turing machine.
Meaning emerges through computation.
Data is inputs for processes.
This leads directly to algorithmic information theory, where data is seen as compressible or incompressible based on how “simple” a program can generate it.
For an Empiricist: Data is given by the world. It’s objective and discoverable.
For a Constructivist: Data is constructed. We choose what to measure, how to encode, and how to interpret.
What kinds of things are data?
- Is a photograph data? A gesture? A feeling?
- Can data exist without an observer?
In Knowledge and the Philosophy of Number, Hossack explores data as formal, ideal structures, grounding mathematical truth in logical and ontological terms.
| Field | View of Data |
|---|---|
| Physics | Measurable quantities (mass, time, energy) |
| Biology | Sequences, patterns, taxonomies |
| Computer Science | Bits, streams, records |
| Philosophy | Epistemic objects; phenomena made legible |
| Linguistics | Text, utterances, syntax trees |
| Art | Forms, order, reference |
| Media | Opinions, views, secrets |
Data is not neutral
- It reflects decisions, assumptions, and worldviews.
- Data gains power through structure
- Syntax, models, and algorithms matter.
Data bridges the abstract and the concrete
- It is symbolic, but refers to the real world.
📚 Further Reading
- Claude Shannon – A Mathematical Theory of Communication
- Luciano Floridi – Philosophy of Information
- Lisa Gitelman – Raw Data is an Oxymoron
- Alan Turing – On Computable Numbers
Legend:
- 🔰 Start here
- 🏵️ Important Insight
- ⚙️ Technical and applications
- 💻 Some Code
- ⚜️ Advanced Topics
- 00.1 What Is Data?
-
00.2 Three Models of Reality (planned)
- 00.2.1 The Linguistic
- 00.2.2 The Symbolic
- 00.3.3 The Mathematical
- 00.3 Maps and Reality
- 00.4 Aside: Hossack, data as structure
- 00.5 Aside: Chomsky, data as evidence
- 01.1 🔰 Sets and Logic (planned)
- 01.2 Sample Space
- 01.3 Randomness and Pattern
- 01.4 Outcomes and Events
- 01.5 Finite and Infinite Sample Spaces
- 02.1 🔰 Functions (planned)
- 02.2 Types Are Alphabets
- 02.3 Random Variables: X : Ω → 𝒳 (planned)
- 02.4 Measurement Scales
- 02.5 Numerics
- 03.1 🔰 Fractions and Proportions (planned)
- 03.2 Randomness vs Uncertainty
- 03.3 Probability: Events, Conditioning, Bayes
- 03.4 Bayes' Theorem, Step by Step
- 03.5 Expected Value and Variance (planned)
- 03.6 Bernoulli (ES)
- 03.7 Discrete Uniform (ES)
- 03.8 🧗 Kolmogorov: Ω, 𝒜, ℙ
- 04.1 🔰 Powers and Logarithms (planned)
- 04.2 Rarity
- 04.3 Information Theory (Shannon)
- 04.4 Entropy: Three Views
- 05.1 🔰 Sums and Averages (planned)
- 05.2 Data, Measured
- 05.3 Sampling (ES)
- 05.4 Population and Sample (ES)
- 05.5 Types of Sampling (ES)
- 05.6 Choosing Summaries & Visuals
- 05.7 Visualization
- 05.8 Plots
- 06.1 What Is Statistics?
- 06.2 🔰 Curves and Area (planned)
- 06.3 Statistical Thinking
- 06.4 Variation
- 06.5 Uncertainty
- 06.6 Parameters vs Estimators (ES)
- 06.7 Distributions
- 06.8 Statistical Modeling
- 06.9 Statistical Methods
- 07.1 Data Storage: Databases (stub)
- 07.2 ER Diagrams
- 07.3 Chen Diagrams
- 07.4 SQL (planned)
- 07.5 Formal Languages and Regular Expressions (planned)
- 07.6 Reproducibility (planned)
08 · μ(x) — Fuzzy - When data is flexible
- 08.1 Fuzzy Logic (planned)
- 08.2 Fuzzy Numbers (planned)
- 08.3 Possibility vs Probability (planned)
09 · x(t) — Signals and systems - Where patterns live
- 09.1 Signals (stub)
- 09.2 Sampling and Aliasing (planned)
- 09.3 Convolution (planned)
- 09.4 Frequency (planned)
- 10.1 🔰 Vectors and Matrices (planned)
- 10.2 Mathematical Modelling (planned)
- 11.1 🔰 Derivatives (planned)
- 11.2 Convex Optimisation (planned)
- 12.1 Supervised Learning (planned)
- 12.2 Data in Language Models
- 13.1 Cause and Effect (planned)
- 13.2 Capstone Guide (planned)