ETL for LSD to RDBMS
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.settings
LSD-ETL
output
processed
samples
scripts
src/main/java
target
.classpath
.gitignore
.project
LSD-ETL.zip
pom.xml
readme.md

readme.md

Linked Sensor Data RDF to RDBMS

  1. Download the set of Linked Observation Data that want to transform from http://wiki.knoesis.org/index.php/LinkedSensorData.
  2. Download the Linked Sensor Data with meta data of stations from http://sonicbanana.cs.wright.edu/knoesis_linkedsensordata.tar.gz.
  3. Download a release of our tool https://github.com/eugenesiow/lsd-ETL/releases/download/0.1.0/LSD-ETL.zip or clone the repository.
  4. Configure the run.sh script in the LSD-ETL directory. Change the parameters accordingly. To find a reference of parameters, you can run java -jar ETL-0.1.0.jar --help.
  5. Run the run.sh script in the LSD-ETL directory. You might have to chmod 775 run.sh to make it executable.
  6. All required files will be produced in the output directory specified. Now you have a _rdbms subdirectory and a _tdb subdirectory with the database outputs in a RDBMS and triplestore.

Usage

usage: LSDTransform [-D <driver>] -I <folder path> [-J <the jdbc string>]
       [-M <folder path>] -O <folder path> [-P <password>] [-S <stage
       number>] [-U <username>]
 -D,--jdbc_driver <driver>            the JDBC driver package
 -I,--src <folder path>               the source folder path
 -J,--jdbc_string <the jdbc string>   the jdbc path
 -M,--metadata_src <folder path>      the metadata folder path
 -O,--output <folder path>            the output folder path
 -P,--password <password>             the db password
 -S,--stage <stage number>            runs the particular stage
                                      1.Merge RDF by station
                                      2.Metadata to CSV from RDF
                                      3.Generate Mapping from RDF
                                      4.Add Metadata to Mappings
                                      5.Generate CSV from RDF
                                      6.Load RDBMS
                                      7.Load TDB
 -U,--user <username>                 the db user

Other Projects