qri dataset definition
Switch branches/tags
Nothing to show
Clone or download
b5 feat(subset): dataset subset previews
Merge pull request #158 from qri-io/subset
Latest commit 487c665 Nov 16, 2018
Permalink
Failed to load latest commit information.
.circleci
compression
detect
dsfs
dsgraph refactor(logging): switch to go-log instrument with debug logging Mar 14, 2018
dsio
dstest
dsutil test(dsutil.FromFormFile): better test coverage Nov 4, 2018
generate
subset
testdata
use_generate feat(dsio): Generate example entries, fuzz testing, documentation Apr 4, 2018
validate refactor(Body): rename anything named data to body Jun 13, 2018
vals
.codeclimate.yml
.gitignore
LICENSE
codecov.yml
commit.go feat(pod.Assign): give Assign pattern to DatasetPod variants Nov 3, 2018
commit_test.go
compare.go
compare_test.go
data_format.go
data_format_config.go fix(csv): inferred csv structures use lazyQuotes by default, set Vari… Aug 30, 2018
data_format_config_test.go
data_format_test.go refactor(dsio): refactor tests, prepping CBOR value re/writers Mar 2, 2018
dataset.go
dataset_test.go
hash.go
hash_test.go
kind.go feat(viz): refactor vizconfig into initial support for render templates Jul 9, 2018
kind_test.go
meta.go
meta_test.go
package.json
readme.md docs: rewrite core struct descriptions Jul 5, 2018
structure.go
structure_test.go
testdata_test.go
transform.go refactor(dsutil.FromRequest): don't use filesystem in FromRequest Nov 4, 2018
transform_test.go refactor(ComparePod): rename pod comparison to 'EnsureEqual' Nov 5, 2018
viz.go feat(pod.Assign): give Assign pattern to DatasetPod variants Nov 3, 2018
viz_test.go

readme.md

dataset

Qri GoDoc License Codecov CI Go Report Card

Dataset contains the qri ("query") dataset document definition. This package contains the base definition, as well as a number of subpackages that build from this base to add functionality as necessary Datasets take inspiration from HTML documents, deliniating semantic purpose to predefined tags of the document, but instead of orienting around presentational markup, dataset documents emphasize interoperability and composition. The principle encoding format for a dataset document is JSON.

Subpackage Overview

  • compression: defines supported types of compression for interpreting a dataset
  • detect: dataset structure & schema inference
  • dsfs: "datasets on a content-addressed file system" tools to work with datasets stored with the cafs interface: github.com/qri-io/cafs
  • dsgraph: expressing relationships between and within datasets as graphs
  • dsio: io primitives for working with dataset bodies as readers, writers, buffers, oriented around row-like "entries".
  • dstest: utility functions for working with tests that need datasets
  • dsutil: utility functions that avoid dataset bloat
  • generate: io primitives for generating data
  • use_generate: small package that uses generate to create test data
  • validate: dataset validation & checking functions
  • vals: data type mappings & definitions

Getting Involved

We would love involvement from more people! If you notice any errors or would like to submit changes, please see our Contributing Guidelines.