u/Ebrigglerin r/kubernetes • Recommends
On “A Kubernetes case study from CERN, covering lots of technical and non-technical aspects of adopting the platform for data analysis and other workloads”
141K subscribers • 77 videos on Hallway • Conference channel
Intermediate. Assumes working knowledge.
3.1K views8 years ago2 recommendations
Cloud and DevOpsDistributed systemsKubernetesScaling and large-scale architectureTerraform and infrastructure as code
Ricardo Rocha and Clenimar Filemon share CERN's experiences using multi-cloud federated Kubernetes to handle peak workloads.
Want to view more sessions and keep the conversations going? Join us for KubeCon + CloudNativeCon North America in Seattle, December 11 - 13, 2018 (bit.ly/KCCNCNA18) or in Shanghai, November 14-15 (bit.ly/kccncchina18) Keynote: CERN Experiences with Multi-Cloud Federated Kubernetes - Ricardo Rocha, Staff Member, CERN & Clenimar Filemon, Software Engineer, Federal University of Campina Grande Using public cloud resources to cover for peak workloads is a practical and economical alternative to over provisioning on-premise resources. This is the case in environments like CERN where its large internal computing infrastructure is usually big enough but where periods prior to big international conferences or large event reconstruction campaigns see a significant spike in the amount of workloads submitted. We will describe early experiences relying on Kubernetes federations to expand the available capacity to external clouds, while still offering a single entry point to our users - using GKE, AKS, Amazon and the Oracle cloud. We will cover some issues we had in some of the clouds (mainly networking) and how we solved them. We will show how they get integrated with our main batch system, and how workloads running on external resources access their corresponding datasets. "About Ricardo Ricardo is a software engineer at CERN currently part of the CERN cloud team, focusing primarily on networking and container based deployments. Previously he helped develop and deploy several components of the Worldwide LHC Computing Grid, a network of ~200 collaborating sites around the world helping to analyze the Large Hadron Collider data. Ricardo has presented his and his teams work in different international conferences - Computing for High Energy Physics (CHEP), IEEE NSS/MIC, IEEE MSST, DockerCon and multiple OpenStack summits. About Clenimar Clenimar is an MSc student at the Federal University of Campina Grande, Brazil. He is currently researching on distributed, secure workloads in the cloud (using OpenStack and Kubernetes). He spent last summer working at CERN as a Cloud Infrastructure Intern, where he could investigate on how Kubernetes federations could match some CERN use cases, especially regarding the CERN batch service. Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.What people say. Recommended as an impressive case study of adopting Kubernetes for large-scale data and computing workloads at CERN.
u/Ebrigglerin r/kubernetes • Recommends
On “A Kubernetes case study from CERN, covering lots of technical and non-technical aspects of adopting the platform for data analysis and other workloads”
u/JodyBroin r/kubernetes • Recommends
On “Early preview of a new Kubernetes UI”