alteryx / storm-deb-packaging

Debian packaging for Storm

Storm Debian Packaging

Build scripts / sample configuration for building a Storm .deb with FPM

Requirements

To make it as pain free as possible, I have used FPM to build the debian packaging. You can install it by via rubygems (gem install -r fpm). The build_storm.sh script will setup a target directory with the format required for FPM to turn a directory into a .deb package. As a bonus, if you want to change the structure of the package, just change the script to modify the target directory. Then issue the FPM build command, and you are good to go.

• FPM (https://github.com/jordansissel/fpm/)
• WGet
• build-essentials + any dependencies for ZeroMQ + JZMQ bindings

I have supplied some default Upstart scripts for use with the packaging. They assume your primary interface is ETH0, so you may want to change that if it's not the case. Since there is no way to update-rc.d an upstart script, there is an option for 'ENABLE=yes' in /etc/default/storm-process. I am currently using Monit, so chose not to have Upstart 'respawn' on process failure. If you would like Upstart to provide this feature, you can add 'respawn' to the scripts and upstart should take care of this for you. So using your favorite configuration management engine, you can change this to 'yes' to start the daemon on reboot. The build scripts provided compile the dependencies listed in https://github.com/nathanmarz/storm/wiki/Installing-native-dependencies.

Usage

Included are three scripts to build the debian packages for a storm installation.

• build_storm.sh - Storm
• build_libzmq0.sh - ZeroMQ libraries
• build_jzmq0.sh - Java bindings for ZeroMQ

Just run the build scripts, and debian artifacts will be created.

Here is a sample of the layout of the package structures.

Storm Package

drwxr-xr-x root/root         0 2012-08-02 18:10 ./
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/storm/
-rw-r--r-- root/root     12653 2012-08-02 18:10 ./opt/storm/CHANGELOG.md
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/storm/lib/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/storm/public/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/storm/public/css/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/storm/public/js/
-rw-r--r-- root/root      2794 2012-08-02 18:10 ./opt/storm/README.markdown
-rw-r--r-- root/root     12710 2012-08-02 18:10 ./opt/storm/LICENSE.html
drwxr-xr-x root/root         0 2012-08-02 18:10 ./opt/storm/bin/
-rw-r--r-- root/root   3896683 2012-08-02 18:10 ./opt/storm/storm-0.7.4.jar
-rw-r--r-- root/root         6 2012-08-02 18:10 ./opt/storm/RELEASE
drwxr-xr-x root/root         0 2012-08-02 18:10 ./etc/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./etc/default/
-rw-r--r-- root/root       387 2012-08-02 18:10 ./etc/default/storm
-rw-r--r-- root/root       166 2012-08-02 18:10 ./etc/default/storm-nimbus
-rw-r--r-- root/root       184 2012-08-02 18:10 ./etc/default/storm-supervisor
-rw-r--r-- root/root       160 2012-08-02 18:10 ./etc/default/storm-drpc
-rw-r--r-- root/root       150 2012-08-02 18:10 ./etc/default/storm-ui
drwxr-xr-x root/root         0 2012-08-02 18:10 ./etc/storm/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./etc/storm/conf.d/
-rw-r--r-- root/root       364 2012-08-02 18:10 ./etc/storm/storm.log.properties
-rw-r--r-- root/root       445 2012-08-02 18:10 ./etc/storm/storm.yaml
drwxr-xr-x root/root         0 2012-08-02 18:10 ./etc/init/
-rw-r--r-- root/root       774 2012-08-02 18:10 ./etc/init/storm-drpc.conf
-rw-r--r-- root/root       757 2012-08-02 18:10 ./etc/init/storm-ui.conf
-rw-r--r-- root/root       816 2012-08-02 18:10 ./etc/init/storm-supervisor.conf
-rw-r--r-- root/root       788 2012-08-02 18:10 ./etc/init/storm-nimbus.conf
drwxr-xr-x root/root         0 2012-08-02 18:10 ./var/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./var/lib/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./var/lib/storm/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./var/log/
drwxr-xr-x root/root         0 2012-08-02 18:10 ./var/log/storm/