Skip to content

mosesn/Course-Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

== Info
This crawl program successfully aggregated Columbia course and related
information as of Sunday, February 20, 2011. Columbia's data formats are
subject to change, and I can not guarantee that this program will be
compatible with future formats. 

Questions, comments, and concerns should be directed at:
Ryan Bubinski. ryanbubinski <at> gmail <dot> com.


== Dependencies
Ruby 1.8.7>=
MySQL 5.0>=


== Setup

Copy "config.yaml.default" to "config.yaml"

Complete the following fields in config.yaml
  database:
    adapter: mysql
    host: [localhost]
    username: [db_username]  
    password: [db_user_passwd]
    database: [db_name]

Run the following commands in the terminal window:
  gem install bundler
  bundle install
  ruby app.rb


== Export data
Data is stored in a local database, which can be exported to a text file
in SQL format using the command:

rake db:export

The result is stored in the local directory in a file named "data.sql"

About

Aggregates course information from Columbia's online course directory and bulletins

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors