mosesn/Course-Crawler
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation
== Info
This crawl program successfully aggregated Columbia course and related
information as of Sunday, February 20, 2011. Columbia's data formats are
subject to change, and I can not guarantee that this program will be
compatible with future formats.
Questions, comments, and concerns should be directed at:
Ryan Bubinski. ryanbubinski <at> gmail <dot> com.
== Dependencies
Ruby 1.8.7>=
MySQL 5.0>=
== Setup
Copy "config.yaml.default" to "config.yaml"
Complete the following fields in config.yaml
database:
adapter: mysql
host: [localhost]
username: [db_username]
password: [db_user_passwd]
database: [db_name]
Run the following commands in the terminal window:
gem install bundler
bundle install
ruby app.rb
== Export data
Data is stored in a local database, which can be exported to a text file
in SQL format using the command:
rake db:export
The result is stored in the local directory in a file named "data.sql"