Skip to content
master
Switch branches/tags
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
dev
 
 
 
 
 
 
 
 
 
 

README.md

What this is all about

The background is here

The main difference is I dumped Grafter since then.

This is a very elementary exercise in clojure code.

Nothing interesting here. Just a plain old collection of maps being passed around.

It doesn't even make use of pattern matching, and it could really use it.

No parallelism, no fancy stuff.

I even misunderstood how the transducers were supposed to be used so I had to ask for clarifications on the beginners channel of the clojurians Slack

I have been just poking around to see if and how these data could be made ready to be dumped into a triple store.

Known woes

Apart from not using the pattern matching, there's no test machinery here.

Some time ago I read about a test framework that searched for some statistical properties of the produced dataset but I can't remember which one it was. I'd be grateful if someone could point me to it again.

Also, it there is room to improve the peformance around the datetimes parsing and moving around.

There's no documentation at all. I'll try to write it in the future.

State of the art

I couldn't understand the places where some of the measurements were taken. So not oll of the input files end up in the output. Measurements of the air pollution without geographical coordinates don't make much sense.

Even so, this thing produced a file of approximately 15 million records.

If all goes well, there will be soon an on line SPARQL endpoint providing these data. When ready I'll update this README.

About

attempt to make the data released by the Arpa governmental agency open data

Resources

License

Releases

No releases published

Packages

No packages published