The Data Engineering Landscape in 2021 - Talk Python to Me Ep. 302

Tobias Macey joins Michael Kennedy to discuss the state of data engineering, its tools, and how it compares to data science.

I'm sure you're familiar with data science. But what about data engineering? Are these the same or how are they related? ▬▬▬▬ About the podcast ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ This video is the uncut, live recording of the Talk Python To Me podcast ( talkpython.fm ). We cover Python-focused topics every week and publish the edited and polished version in audio form. Subscribe in your podcast player of choice (100% free) at talkpython.fm/subscribe. ▬▬▬▬ Guests ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Tobias Macey ▬▬▬▬ Links and resources from the show ▬▬▬▬▬▬▬▬▬▬▬▬ YouTube: youtube.com/watch?v=D0Z6ZsNNeJs Tobias Macey: boundlessnotions.com/ Podcast.__init__: pythonpodcast.com/ Data Engineering podcast: dataengineeringpodcast.com/ Designing Data-Intensive Applications Book: amzn.to/36rsLyC wally: github.com/WallarooLabs/wally lakeFS: lakefs.io/ A Beginner’s Guide to Data Engineering: medium.com/@rchang/a-beginners-guide-to-data-engineering-par… Apache Airflow: airflow.apache.org/ Dagster: dagster.io/ Prefect: prefect.io/ #68 Crossing the streams with Podcast.__init__: talkpython.fm/episodes/show/68/crossing-the-streams-with-pod… dbt: getdbt.com/ Great Expectations: github.com/great-expectations/great_expectations Dask: dask.org/ Meltano: meltano.com/ Languages trends on StackOverflow: insights.stackoverflow.com/trends?tags=java%2Cc%2Cc%2B%2B%2C… DVC: dvc.org/ Pandas: pandas.pydata.org/ ▬▬▬▬ Dive deeper ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Listen to the Talk Python To Me podcast at talkpython.fm and explore over 275 hours of Python courses at training.talkpython.fm/courses. ▬▬▬▬ Follow us on Social ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Mastodon: Michael - fosstodon.org/@mkennedy & Talk Python - fosstodon.org/@talkpython Bluesky: Michael - bsky.app/profile/mkennedy.codes & Talk Python - bsky.app/profile/talkpython.fm X: Michael - x.com/mkennedy & Talk Python - x.com/talkpython