LocalDevEnv

Local Development Environment

The main thing you need when doing local development on streamparse is a virtual machine configured with Storm the way it might be configured in a real cluster.

Vagrant

The easiest option for this is to use something like Vagrant and VirtualBox.

1. Check Vagrant's Getting Started guide.
2. Create a basic Vagrantfile using the Ubuntu precise64 box.
3. To provision the box, we recommend you use the official Java cookbook and a community-maintained simplified storm-cookbook which offers a storm::singlenode configuration.

Once this box is up and provisioned, you should be able to access the Storm UI on port 8080, and you should be able to run commands like sparse list from streamparse against it, once configured in your config.json.

Docker

It's also possible to get Storm running using storm-docker. However, we don't recommend this right now because streamparse requires having SSH access to your Storm worker nodes so that it can modify the filesystem to do things like virtualenv setup. Docker will make this a bit complicated (probably requiring the use of Volumes).