Skip to content
master
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
src
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

ODM2StreamingDataLoader

A program for streaming continuous sensor data into an instance of Version 2 of the Observations Data Model (ODM2). The ODM2 Streaming Data Loader is written in Python and our goal is to make sure that it is compatible with Windows, Mac, and Linux platforms. The ODM2 Streaming Data Loader consists of two programs:

  1. An executable data loader that reads a configuration file, performs the work of loading the data, and can be scheduled according to a user-defined schedule.
  2. A graphical user interface wizard that enables users to map a delimited datalogger text file to an ODM2 database and create a configuration file.

Setup

Streaming Data Loader is designed to run periodically and automatically as a background process. Below are setup steps for the supported platforms.

Mac/OSX

There are a couple different ways to schedule a background task. The preferred way is using launchd and the other way is with cron. If you choose to schedule the Streaming Data Loader via launchd, you must create a plist file (see https://developer.apple.com/library/mac/documentation/MacOSX/Conceptual/BPSystemStartup/Chapters/ScheduledJobs.html for more details.) I have provided some instructions for those who would like to schedule Streaming Data Loader with cron.

  1. Download and install the latest installer package: https://github.com/ODM2/ODM2StreamingDataLoader/releases
  2. To schedule the Streaming Data Loader to run periodically, create a new cron job. Open a terminal window and enter the following command:
crontab -e

This will open a special file where you can create tasks that run automatically. The syntax for the file is as follows:

Argument 1: Minute (0 - 59)  
Argument 2: Hour (0 - 23)  
Argument 3: Day of Month (1 - 31)  
Argument 4: Month (1-12)  
Argument 5: Day of Week (0 - 6) Sunday = 0  
Argument 6: Command  

More information on cron's time formatting can be found here.

This is an example entry which will run the Streaming Data Loader every minute:

* * * * * /Applications/SDLLoader.app/Contents/MacOS/SDLLoader -c /Users/denversmith/Desktop/newb.yaml -v >/dev/null 2>&1

Appending >/dev/null 2>&1 to the end of your command will disable cron's mail alert system.

Windows

Linux

If you are running Streaming Data Loader on Linux, you can follow the instructions for setting up a cron job under the OSX section.

Credits

This work was supported by National Science Foundation Grants EAR-1224638 and ACI-1339834. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

About

A program for streaming continuous sensor data into an instance of Version 2 of the Observations Data Model (ODM2)

Topics

Resources

License

Packages

No packages published

Languages

You can’t perform that action at this time.