u/alexandraabbasin r/dataengineering • Recommends
link to this video Apache Beam Explained in 12 Minutes
0:00 / 0:00
#apachebeam#googleclouddataflow#dataflowmodel
Apache Beam Explained in 12 Minutes
datastacktv
794 subscribers • 1 video on Hallway
- Recommended by 1 person: 1 in engineering communities.
- Presented by Alexandra
- Linked in the descriptiondatastacktv/apache-beam-explained
Intermediate. Assumes working knowledge.
78K views6 years ago1 recommendation
Distributed systemsDatabases and dataData engineering and warehousesKafka and stream processingConcurrency and parallelism
Alexandra explains the core concepts of Apache Beam and the Dataflow model, including windowing, triggers, and transforms.
Apache Beam is a popular parallel processing framework. In this video, Alexandra will give you an overview of Apache Beam and by the end of the video you will hopefully have the skills that you need to write a simple pipeline. Source code - github.com/datastacktv/apache-beam-explained References T Akidau et al. - The Dataflow Model (2015): research.google/pubs/pub43864/ Outline - Introduction - The Dataflow Model overview - Windowing - Event time vs processing time - Triggers - Core transforms - Web Analytics use case - Code pipeline Want to find datastack.tv elsewhere on the internet? Twitter - twitter.com/datastacktv LinkedIn - linkedin.com/company/datastacktv Website - datastack.tv/Why it's here
1 person recommends thisWhat people say. Recommended as a clear and concise introduction to Apache Beam and the Dataflow model.