Julien Tournay at #ScalaUA - Data Processing @Spotify using Scio

Julien Tournay shares insights and lessons learned from running Scio, an open-source Scala framework for Apache Beam, in production at Spotify.

Julien Tournay at #ScalaUA - Data Processing @Spotify using Scio Two years ago, Spotify introduced Scio, an open-source Scala framework to develop data pipelines and deploy them on Google Dataflow. In this talk, we discuss the evolution of Scio, and share the highlights of running Scio in production for two years. We showcase several interesting data processing workflows ran at Spotify, what we learned from running them in production, and how we leverage that knowledge to make Scio faster, and safer and easier to use. Follow ScalaUA Conference on Twitter: twitter.com/@ScalaUA_Conf