Apache: Big Data North America 2017 will be held at the Intercontinental Miami in Miami, Florida. 

Register now for the event taking place May 16-18, 2017. 
Thursday, May 18 • 11:20am - 12:10pm
Cluster Continuous Delivery with Oozie - Clay Baenziger, Bloomberg

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Deploying software to secure, clustered Hadoop environments is a challenge. Particularly, one must distribute keytabs, user identities and cluster configuration to build systems like Jenkins; to speak nothing of network access to clusters. At Bloomberg, we ensure our clusters are defined via configuration management and can be automatically configured, operated. Application (HBase, Spark) deployment is a key part of this as well!

We have extended Oozie to provide deployment mechanisms for Git and plans for Maven artifacts allowing us to specify all cluster configuration including software deployed to that cluster. Often this consists of an Oozie workflow to deploy software, allowing for deployments to happen as the permissioned role account and not as a superuser.

Clay will walk through the process of these deployments and the code necessary to make these first-class Oozie actions.


Clay Baenziger

Clay Baenziger - is an architect for the Hadoop Infrastructure Team at Bloomberg. Clay comes from a diverse background in systems infrastructure and analytics. At Sun Microsystems, his team built out an automated bare-metal Solaris deployment tool for Solaris engineering labs and... Read More →

Thursday May 18, 2017 11:20am - 12:10pm EDT