Running Hadoop Clusters as a Service in Production using Containers - Rachit Arora (IBM) @ContainerCamp
Running Hadoop Clusters as a Service in Production using Containers - Rachit Arora (IBM)  @ContainerCamp
Uploaded September 2017 | Updated November 2026, 18 hours ago
In order to build and deploy an analytic service on Cloud is a challenge and bigger challenge is to maintain the service. Users are moving towards the model where they want to provision an instance of service on the fly and use it for analytics and done with the service when done. Containers is now proven technology to deploy and distribute modules quickly, easily and reliably.

The aim of this talk is to share the experience of building such service. Usually it takes weeks to provision a production/enterprise ready hadoop cluster. In this Session we will give details on how we built a platform which is offers hadoop clusters to the user within 4 mins. In this session there will be discussion on how stateless containers help in patching 1000s of containers in very short time.

About Rachit: Rachit Arora is a Senior Developer at IBM, India Software Labs. He is key designer of the IBM's offerings on Cloud for Hadoop ecosystem . He has extensive experience in architecture, design and agile development. Rachit is an expert in application development in Cloud architecture and development using hadoop and it's ecosystem.

Container Camp is the community conference about software containers and is Australia's first conference dedicated to container technology.

Captured on 22-24 May, 2017 at the SMC Centre. Sydney, Australia
Running Hadoop Clusters as a Service in Production using Containers - Rachit Arora (IBM)Streaming Video at DramaFever - Bridget KromhoutThe Dark Art of Container Monitoring - Loris DegioanniRunning Kubernetes in Production A Million Ways to Crash Your Cluster - Henning Jacobs (Zalando)Building with Buildkit - Sam Cochran (Buildkite)Decoding the Service Mesh landscape - Paul Bouwer (Microsoft)A Docker image walks into a Notary - Diogo MónicaManaging Kubernetes and OpenShift with ManageIQ - Alissa BonasContainer Images Considered Harmful  - Aleksa Sarai (SUSE)Building and scaling container driven cloud infrastructure - Bryan CantrillContainer Images Considered Harmful -  Aleksa Sarai (SUSE)Container Security Best Practices - Praveen Sastry (Seek)
Container Camp |

Running Hadoop Clusters as a Service in Production using Containers - Rachit Arora (IBM)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER