Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
Apache: Big Data North America 2017 will be held at the Intercontinental Miami in Miami, Florida. 

Register now for the event taking place May 16-18, 2017. 
View analytic
Tuesday, May 16 • 2:30pm - 3:20pm
Leveraging Docker for Hadoop Build Automation and Big Data Stack Provisioning - Evans Ye, Yahoo

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.

Apache Bigtop as an open source Hadoop distribution, focuses on developing packaging, testing and deployment solutions that help infrastructure engineers to build up their own customized big data platform as easy as possible. However, packages deployed in production require a solid CI testing framework to ensure its quality. Numbers of Hadoop component must be ensured to work perfectly together as well. In this presentation, we'll talk about how Bigtop deliver its containerized CI framework which can be directly replicated by Bigtop users. The core revolution here are the newly developed Docker Provisioner that leveraged Docker for Hadoop deployment and Docker Sandbox for developer to quickly start a big data stack. The content of this talk includes the containerized CI framework, technical detail of Docker Provisioner and Docker Sandbox, a hierarchy of docker images we designed, and several components we developed such as Bigtop Toolchain to achieve build automation.


Speakers
avatar for Evans Ye

Evans Ye

Sr. Software Engineer, Yahoo!
Evans Ye is currently PMC chair of Apache Bigtop. He works at Yahoo Taiwan to develop E-Commerce data solutions. He loves to code, automate things, and develop big data applications. Aside engineering stuff, he is also an enthusiast in giving talks to share software innovations a... Read More →


Tuesday May 16, 2017 2:30pm - 3:20pm
Balmoral

Attendees (27)