Tubes is my attempt at some hopefully quick to use ETL scripts, written in C to be fast enough for large datasets. Each 'script' is a small C application, complete with it's own int main() that reads data from stdin, and writes to stdout.
We'll see how that works out for me.
- Reading an AutoCad DWG file - clipping the content by a specific bbox - adding colours according to a csv stylesheet - outputting to a webserver that serves WebGL code - Read in the soil map data of a province (which extends to the political boundaries - miles off the coast) - Cull data by the hydrological data of the same island (where there is land) - Add colours according to water tables - Produce pretty maps (png, webgl, kml) - Read in current transit vehicle position information from a remote server (nextbus) - Aligning those positions to the road or rail they should be on, to eliminate bad data - Produce cleaned versions of low quality data
These tools require linux/mac and build tools. First you must run 'make'.
icitw_wgs84.dbf is available at http://www.toronto.ca/open/datasets/wards/
./bin/shapefile -f icitw_wgs84.dbf | ./bin/tesselate | ./bin/png --filename=toronto_ward_map.png
I had more examples up here, but then I changed a lot of things and the examples became severely mis-leading. (So i deleted them)