Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Importer for texastransparency.org the National Data Catalog
Ruby
branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
lib
spec
.gitignore
LICENSE
README.md
config.example.yml
rakefile.rb

README.md

National Data Catalog Importer for texastransparency.org

Installation

Install Needed RubyGems

# For development and production:
gem install datacatalog-importer

# For testing:
gem install rspec

Set Up Config Files

  • Create config.yml using config.example.yml as a template.

Run the Tests

  • Run rake test

Usage

First, pull. Then, push. It's easy.

1. rake pull

Download and parse pages from texas.gov. You will need to specify the environment using the IMPORTER_ENV environment variable. Some examples:

  • IMPORTER_ENV=local rake pull
  • IMPORTER_ENV=sandbox rake pull
  • IMPORTER_ENV=production rake pull

2. rake push

Upload pulled data to the National Data Catalog API. You will need to specify the environment using the IMPORTER_ENV environment variable. Some examples:

  • IMPORTER_ENV=local rake push
  • IMPORTER_ENV=sandbox rake push
  • IMPORTER_ENV=production rake push

Join The National Data Catalog Community

Something went wrong with that request. Please try again.