This is a repo to explore some basic concepts of Scala and functional data processing. The data used is by the Chicago Transit Authority (CTA) and is part of their freely downloadable datasets.
This project is based on SBT based tool. When installed in your system it gives an interactive shell where you can run different commands.
First, run activator in a shell from a checkout of this project:
sbt
You should see something similar to:
[info] Set current project to uic-cta-demo (in build file:~/projects/uic-cta-demo/)
>
Now that you have an SBT shell, you can run all tests by just typing test.
You should see something similar to:
[info] Tests: succeeded 2, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 1 s, completed Sep 18, 2015 6:38:29 PM
You can leave the SBT shell at any time using the exit command.
Before we can run the core of the project, we need to download the datasets. There is a bash script that downloads them for you:
./download_datasets.sh
If you can't run the script, you can manually download the
List of L Stops
and the
Station Entries Daily Totals
by clicking on Export on the top right and selecting CSV.
The files have to be placed in the files folder inside the project folder.
On a fresh checkout, the files folder contains two sample versions of those files that are used for testing.
The core of the application is to compute a bunch of statistics and aggregate information on the datasets. So far, the results are going to be printed out to the console.
sbt
> runMain com.github.fedeoasi.main.ParserMain