Skip to content
0:00 / 0:00

#apachespark#rdd#yarn

Advanced Apache Spark Training - Sameer Farooqui (Databricks)

Spark Summit

38K subscribers • 1 video on Hallway

YouTube
  • Recommended by 1 person: 1 in engineering communities.
  • Presented by Sameer Farooqui, Databricks
  • Linked in the descriptionSlides on spark-summit.org
  • Made by the vendor. The company whose product it covers made or sponsored it.
  • May be out of date. The tools, versions or practices it shows have likely moved on.

Advanced. Deep dive for people who know the field.

365K views11 years ago1 recommendation

Distributed systemsDatabases and dataData engineering and warehousesScaling and large-scale architectureConcurrency and parallelism

Sameer Farooqui delivers an in-depth training session on Spark core, RDDs, resource managers, internals, and streaming.

Live Big Data Training from Spark Summit 2015 in New York City. "Today I'll cover Spark core in depth and get you prepared to use Spark in your own prototypes. We'll start by learning about the big data ecosystem, then jump into RDDs (Resilient Distributed Datasets). Then we'll talk about integrating Spark with resource managers like YARN and Standalone mode. After a peek into some Spark Internals, we touch base upon Accumulators and Broadcast Variables. Finally, we end with Spark Streaming and a technical explanation of how the 100 TB sort competition was won in 2014." - Sameer Slides: spark-summit.org/wp-content/uploads/2015/03/SparkSummitEast2… Want to learn more about Spark? Check out my new class, "Exploring Wikipedia with Apache Spark", recorded June 2016: youtube.com/watch?v=vlVnSpJ6TDE&t=21m23s // About the Presenter // Sameer Farooqui is a Technology Evangelist at Databricks where he helps promote the adoption of Apache Spark. As a founding member of the training team, he created and taught advanced Spark classes at private clients, meetups and conferences globally. Follow Sameer on - Twitter: twitter.com/blueplastic LinkedIn: linkedin.com/in/blueplastic

Why it's here

1 person recommends this

What people say. Recommended as a comprehensive resource for learning Apache Spark internals and preparing for certification.

u/Background_Debate_94in r/dataengineering • Recommends

Just got certified! - Databricks certified associate developer for apache spark 3.0 in Python Just got certified! I am a new data analyst who wants to hopefully move into the data engineering field. I have done a few projects just finding it hard in the current market to find a job. Decided to keep working at my current job and in the meantime finish off a few certs to hopefully attract a few recruiters. Gonna go for the data engineer associate and professional next For anyone wanting to get it, I highly recommend getting it, it stays forever(no expiry), fairly simple took me 2 weeks assuming you have general python syntax knowledge, plus access to documentation in the exam. The resource…