METRON-1715 Create DEB Packaging for Batch Profiler [Feature Branch]

[nickwallen]

This creates a DEB package that makes it simple to install the Batch Profiler. There are now two separate packages created for the Profiler; one for Storm and another for Spark.

• metron-profiler_0.5.1.deb
• metron-profiler-spark_0.5.1.deb

This is a pull request against the METRON-1699-create-batch-profiler feature branch.

This is dependent on the following PRs. By filtering on the last commit, this PR can be reviewed before the others are reviewed and merged.

• METRON-1708 Run the Batch Profiler in Spark [Feature Branch] #1161

Testing

1. Build Metron.

   mvn clean package -DskipTests -T2C
   

2. Build the DEBs.

   cd metron-deployment/
   mvn clean package -Pbuild-debs
   

3. Ensure that the DEBs were built. There is one for the Storm Profiler and one for the Spark Profiler.

   $ find ./ -name "metron-profiler*.deb"
   .//metron-deployment/packaging/docker/deb-docker/target/metron-profiler_0.5.1.deb
   .//metron-deployment/packaging/docker/deb-docker/target/metron-profiler-spark_0.5.1.deb
   

4. Stand-up a Ubuntu VM for testing the packages.

   vagrant init ubuntu/trusty64
   vagrant up
   

5. Copy the Metron DEBs to the Ubuntu VM. Something like the following should work when run in the same directory where you init'd the VM.

   vagrant scp ~/Development/metron/metron-deployment/packaging/docker/deb-docker/target/ /tmp
   

6. Install the Metron DEBs on the VM.
   Connect to the VM.

   vagrant ssh
   sudo su -
   

   Install the packages.

   dpkg -i /tmp/target/*.deb
   

7. Validate the files that were installed by the Storm Profiler package.

   root@vagrant-ubuntu-trusty-64:~# dpkg-query -L metron-profiler
   /.
   /usr
   /usr/metron
   /usr/metron/0.5.1
   /usr/metron/0.5.1/bin
   /usr/metron/0.5.1/bin/start_profiler_topology.sh
   /usr/metron/0.5.1/flux
   /usr/metron/0.5.1/flux/profiler
   /usr/metron/0.5.1/flux/profiler/remote.yaml
   /usr/metron/0.5.1/config
   /usr/metron/0.5.1/config/profiler.properties
   /usr/metron/0.5.1/lib
   /usr/metron/0.5.1/lib/metron-profiler-0.5.1-uber.jar
   

8. Validate the files that were installed by the Spark Profiler package.

   root@vagrant-ubuntu-trusty-64:~# dpkg-query -L metron-profiler-spark
   /.
   /usr
   /usr/metron
   /usr/metron/0.5.1
   /usr/metron/0.5.1/bin
   /usr/metron/0.5.1/bin/start_batch_profiler.sh
   /usr/metron/0.5.1/config
   /usr/metron/0.5.1/config/batch-profiler.properties
   /usr/metron/0.5.1/lib
   /usr/metron/0.5.1/lib/metron-profiler-spark-0.5.1.jar
   

Pull Request Checklist

• Have you included steps to reproduce the behavior or problem that is being changed or addressed?
• Have you included steps or a guide to how the change may be verified and tested manually?
• Have you ensured that the full suite of tests and checks have been executed in the root metron folder via:
• Have you written or updated unit tests and or integration tests to verify your changes?
• If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
• Have you verified the basic functionality of the build by building and running locally with Vagrant full-dev environment or the equivalent?

[merrimanr]

I ran through the testing instructions and everything worked fine. +1

[nickwallen]

Thanks again @merrimanr I have merged this PR into the feature branch.