Skip to content

datafibers/big_data_homework

Repository files navigation

NetCDF Processor

NetCDF Processor is a demo project to download NetCDF file from AWS S3 buckets whenever file arrival notified is available. Then, the processor read and extract the file to the user database.

Setup

mvn install -Dmaven.test.skip=true

Set proper values in AppConfig.java (Or replace it by provided)

Run

  • Run through IDE by running one of demo in the main function of NetCDFProcessDemo.java
  • Run through a command line,
to be added

Unknown Issues

  1. When running the demo in IDEA, it shows Error running 'ServiceStarter': Command line is too long. Shorten command line for ServiceStarter or also for Application default configuration.. The resolution is modify .idea\workspace.xml file and look for the tag <component name="PropertiesComponent">. Then add line <property name="dynamic.classpath" value="true" />

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages