Skip to content
Hallway
0:00 / 0:00

#apachespark#pyspark#dataframes

Pasha Finkelshteyn: The Spark of Big Data - An Introduction to Apache Spark

PyData

173K subscribers • 11 videos on Hallway

YouTube
  • Recommended by 1 person: 1 in engineering communities.
  • Presented by Pasha Finkelshteyn

Beginner. No background in the topic needed.

304 views3 years ago1 recommendation

Distributed systemsDatabases and dataData engineering and warehousesScaling and large-scale architecture

Pasha Finkelshteyn introduces Apache Spark, PySpark DataFrames, and SQL APIs for processing large-scale datasets.

Get ready to level up your big data processing skills! Join us for an introductory talk on Apache Spark, the distributed computing system used by tech giants like Netflix and Amazon. We'll cover PySpark DataFrames and how to use them. Whether you're a Python developer new to big data or looking to explore new technologies, this talk is for you. You'll gain foundational knowledge about Apache Spark and its capabilities, and learn how to leverage DataFrames and SQL APIs to efficiently process large amounts of data. Don't miss out on this opportunity to up your big data game!

Why it's here

1 person recommends this

What people say. Recommended as an interesting introductory talk on Apache Spark and PySpark.

Moments people linked to

u/mjgcfbin r/dataengineering • Recommends

PyCon DE & PyData Berlin 2023 Playlist Playlist Some of the talks I found most intersting: * Use Spark from anywhere - A Spark client in Python powered by Spark Connect * Streamlit meets WebAssembly - stlite * Pragmatic ways of using Rust in your data project * An Introduction to Apache Spark * WebAssembly demystified * Rusty Python - A Case Study * Towards Learned Database Systems
36View on Reddit