pre and post update hooks

[maxogden]

we need to define an API for running transformations/generic functions automatically. they should be able to be run either before insert of after insert.

check out couchdb validation functions for potential inspiration http://docs.couchdb.org/en/latest/couchapp/ddocs.html#vdufun (though they arent exactly what this issue is talking about)

via @jbenet:

if i have some silly thing that POSTs some ugly format that i don't have control, would be nice to run the transformation right in dat, rather than write another server to glue it

[jbenet]

could use transformer for this. I'll play around with it and report back.

[jbenet]

could use transformer for this. I'll play around with it and report back.

[maxogden]

was thinking that we could use dat.json (once it gets surfaced to the root of the dat repo and not in the hidden .dat folder) to store the transformations... e.g.

'before': [
  'geocode.py',
  'format-addresses.rb'
]

[maxogden]

was thinking that we could use dat.json (once it gets surfaced to the root of the dat repo and not in the hidden .dat folder) to store the transformations... e.g.

'before': [
  'geocode.py',
  'format-addresses.rb'
]

[maxogden]

@mafintosh another idea, what about a one-time transformation specified during dat import ? e.g. --transform "awk '{print toupper($0)}'". would also be cool to be able to do them on dat cat on the way out

[maxogden]

@mafintosh another idea, what about a one-time transformation specified during dat import ? e.g. --transform "awk '{print toupper($0)}'". would also be cool to be able to do them on dat cat on the way out

[maxogden]

Oh yea we should also add a --dry-run option to all cli operations with side effects

[maxogden]

Oh yea we should also add a --dry-run option to all cli operations with side effects

[mafintosh]

@maxogden that's pretty trivial to add (i think). will look into it

[mafintosh]

@maxogden that's pretty trivial to add (i think). will look into it

[mafintosh]

@maxogden dat import --transform cmd and dat cat --transform cmd works in master now. you can even specify multiple transforms dat cat --transform cmd1 --transform cmd2

[mafintosh]

@maxogden dat import --transform cmd and dat cat --transform cmd works in master now. you can even specify multiple transforms dat cat --transform cmd1 --transform cmd2

[maxogden]

ok i'm declaring this done!

[maxogden]

ok i'm declaring this done!