A Kubernetes Native DevOps System for AI/ML and BigData Applications
Kubernetes started as a general purpose orchestration framework with a focus on serving jobs. But as it gains popularity, users want to migrate the DevOps for HPC Workloads to Kubernetes. Running these types of Workloads(Spark, TensorFlow etc) in kubernetes needs advanced capabilities like batch intelligent scheduling, job management and data management. This talk will address these issues and discuss various frameworks available in Opensource which can be used to run DevOps jobs for AI/ML and BigData Applications.