sqlite-utils memory --analyze option

[simonw]

To provide a way of running analyze-tables directly against JSON or CSV data.

[simonw]

curl 'https://api.github.com/users/dogsheep/repos' | sqlite-utils memory - --analyze

stdin.id: (1/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.node_id: (2/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.name: (3/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.full_name: (4/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.private: (5/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 1

  Most common:
    13: 0

stdin.owner: (6/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 1

  Most common:
    13: {"login": "dogsheep", "id": 53015001, "node_id": "MDEyOk9yZ2FuaXphdGlvbjUzMDE1MD...

stdin.html_url: (7/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.description: (8/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.fork: (9/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 1

  Most common:
    13: 0

stdin.url: (10/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.forks_url: (11/73)

  Total rows: 13
  Null rows: 0
  Blank rows: 0

  Distinct values: 13

stdin.keys_url: (12/73)

  Total rows: 13
...

[simonw]

Documentation: https://sqlite-utils.datasette.io/en/latest/cli.html#schema-analyze-dump-and-save