Loading…
In-person + Virtual
18-21 April
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2023 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central European Summer Time (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis. 
Back To Schedule
Friday, April 21 • 14:00 - 14:35
Building Apache Druid on Kubernetes: How Dailymotion Serves Partner Data - Cyril Corbon & Alex Triquet, Dailymotion

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.


At Dailymotion we use Apache Druid to serve our partner-data (views, monetization etc.) Druid is a distributed time-series / column / database with few competitors in the OLAP world. We install our druid cluster on kubernetes with druid-operator. This allows us to easily manage its lifecycle, do automatic rolling upgrade, provide an easy way to scale and use cncf ecosystem for automatic exposition with cert-manager, external-dns and ingress-nginx. However to run our druid setup on kubernetes we had to solve challenges related to availability, metadata and evolutivity. We will present our architectures (past and present) and the technical means we used to install and manage druid on our clusters with an opensource operator, how we optimize our caching with Memcached and caffeine and how we performed a migration with no downtime and no costly backfills. At the end we will explain how we integrate this setup with our gitops workflow , how we realize common operations (vertical/horizontal scaling, updates, monitoring) and what we are working on as the next step for our Druid stack: Ingestion improvements, multi-tenancy and running Druid without Apache Zookeeper

Speakers
avatar for Cyril Corbon

Cyril Corbon

Devops Architect, Dailymotion
Cyril graduated as an engineer from CESI Exia in information technology and started working as a consultant at Devoteam and then for CCL Consulting. He has worked for the French retailer Carrefour, and French and European aerospatial company Airbus Defense and Space GEO. He then moved... Read More →
avatar for Alex Triquet

Alex Triquet

Senior Devops Engineer, Dailymotion
Alex graduated as an Engineer in Telecommunications from both INSA Lyon and Dublin City University in 2017. After working as a Big Data Consultant for various bank and insurance companies, Alex joined Dailymotion in 2019 as a data quality engineer to work on Apache Airflow. After... Read More →



Friday April 21, 2023 14:00 - 14:35 CEST
G106-107 | First Floor | Congress Centre
  Machine Learning + Data