Skip to content

L. Language's Concept of Data

Julio Toboso edited this page Jan 22, 2026 · 1 revision

🧠 Chomsky and the Concept of Data

1. 📜 Data as Evidence, Not Meaning

In Noam Chomsky’s framework, data (e.g., utterances, grammaticality judgments) are seen primarily as evidence for an underlying mental system: the language faculty (I-language.

“Linguistic data are not the object of inquiry; they are evidence for the nature of the underlying generative system.”
— Noam Chomsky

So:

  • Data ≠ the thing to be modeled
  • Data = clues to a hidden structure (Universal Grammar)

This sets Chomsky apart from empiricist models that treat data as central and sufficient for understanding language.

2. 🔁 Competence vs. Performance

Chomsky famously distinguishes between:

  • Competence:

    The idealized, internal knowledge of language

  • Performance:

    The messy, real-world use of language (which produces data)

Data from performance (e.g., speech corpora) is considered noisy and incomplete, and not always reliable.

Linguistic data, by themselves, are not enough.

Chomsky argues we need theory guided interpretation: you cannot "learn" language just by looking at statistics of usage.

View Chomskyan Linguistics Statistical Language Models
What is data? Evidence of internal, rule-based grammar Raw input for modeling statistical patterns
Trust in data Limited: messy, needs interpretation High: more = better
Goal Explain mental language competence Predict/imitate language behavior
Theory Necessary, innate (Universal Grammar) Emergent from data
Famous critique “Of course you can make a model that mimics behavior. But does it explain anything?” (Counterpoint) Explanation isn't always needed for practical success

Data

Legend:

  • 🔰 Start here
  • 🏵️ Important Insight
  • ⚙️ Technical and applications
  • 💻 Some Code
  • ⚜️ Advanced Topics

Start

01 · Ω — What could happen

02 · X, 𝒳 — What we observe

03 · p(x) — What we expected

04 · I(x), H(X) — What an observation tells us

05 · Data — What is consistent

06 · Statistics — What we can learn.

07 · Databases - How to store data

08 · μ(x) — Fuzzy - When data is flexible

  • 08.1 Fuzzy Logic (planned)
  • 08.2 Fuzzy Numbers (planned)
  • 08.3 Possibility vs Probability (planned)

09 · x(t) — Signals and systems - Where patterns live

  • 09.1 Signals (stub)
  • 09.2 Sampling and Aliasing (planned)
  • 09.3 Convolution (planned)
  • 09.4 Frequency (planned)

10 · f_θ — Modelling and linear algebra

  • 10.1 🔰 Vectors and Matrices (planned)
  • 10.2 Mathematical Modelling (planned)

11 · min L(θ) — Optimisation

  • 11.1 🔰 Derivatives (planned)
  • 11.2 Convex Optimisation (planned)

12 · Learning from data

13 · Cause, design, capstone

  • 13.1 Cause and Effect (planned)
  • 13.2 Capstone Guide (planned)

Appendix

Clone this wiki locally