Skip to content
Hallway
0:00 / 0:00

#dataengineering#datapipelines

What Data Engineers ACTUALLY Do? Tasks & Responsibilities Explained!

First Principles Data Engineering

961 subscribers • 2 videos on Hallway

YouTube
  • Recommended by 1 person: 1 in engineering communities.

Beginner. No background in the topic needed.

1.1K views1 year ago1 recommendation

Careers and interviewsDatabases and dataData engineering and warehousesCareer growthThe tech industry

An overview of the daily tasks, responsibilities, and essential skills required to succeed as a data engineer.

Ever wondered what data engineers actually do? In this video, we break down the day to day tasks, responsibilities, and skills needed to succeed in this role. From managing data pipelines to ensuring data quality, data engineers play a crucial role in turning raw data into actionable insights. We'll explore their essential duties, common tools used, and the key skills employers look for in data engineers. Whether you're considering a career in data engineering or just curious, this video provides a clear and concise look into the world of data engineering. Excel List: docs.google.com/spreadsheets/d/1zB6wocrgxNgjWwo6Jkezje0SgJ3P… LinkedIn: linkedin.com/in/yash-analytics/

Why it's here

1 person recommends this

What people say. Recommended as a clear introduction to the daily responsibilities and study plans for aspiring data engineers.

u/cryptoyashin r/dataengineering • Recommends

…ed skills. Here are the top skills in demand: https://preview.redd.it/b5m9eqi86fbe1.png?width=1490&format=png&auto=webp&s=7fa9aba3a431168986398b929eede4cb4fd778f5 ➡️ Excel Sheet with data - https://docs.google.com/spreadsheets/d/1zB6wocrgxNgjWwo6Jkezje0SgJ3PXMIoCEyJwdY-nLU/edit?usp=sharing ➡️ Checkout the full video with explanation of tasks - [video **4 Month Study Plan -** https://preview.redd.it/qv0fl0nf6fbe1.png?width=1488&format=png&auto=webp&s=39bad3c34dfb4d0b9844a6b9ad7c23c0a179daae https://preview.redd.it/s5cka0nf6fbe1.png?width=1494&format=png&auto=webp&s=0df56710c9ea19a2e3a615e6529661a11826a859 ➡️ Full breakdown with details of each section and resources - link to this video Hope yo…
366View on Reddit

u/cryptoyashin r/kubernetes • Recommends

…n (10), Collaboration (8)| |API and Microservices|11|API (8), Microservices (3)| |Machine Learning|10|Machine Learning (7), MLOps (2), AI/ML Model Development (1)| ➡️ Excel Sheet with data - https://docs.google.com/spreadsheets/d/1zB6wocrgxNgjWwo6Jkezje0SgJ3PXMIoCEyJwdY-nLU/edit?usp=sharing ➡️ Checkout the full video with explanation of tasks - [video **2. 4 Month Study Plan -** **Month 1: Foundations** * **DBMS & SQL:** Basics of database concepts, querying, and design. * **Python:** Focus on Python essentials, including libraries like Pandas and NumPy. * **Linux:** Basic commands and navigation. * **DSA:** Data structures and algorithms, especially for big tech roles. **Month 2: Ke…
2View on Reddit

u/cryptoyashin r/dataengineering • Recommends

…ng|10|Machine Learning (7), MLOps (2), AI/ML Model Development (1)| ➡️ Excel Sheet with data - https://docs.google.com/spreadsheets/d/1zB6wocrgxNgjWwo6Jkezje0SgJ3PXMIoCEyJwdY-nLU/edit?usp=sharing ➡️ Checkout the full video with explanation of tasks (for Beginners) - "What Do Data Engineers ACTUALLY Do? Tasks & Responsibilities Explained!" - [video **4 Month Study Plan -** This study plan is based on 4+ years of experience, the above analysis, and guidance from industry mentors during my time at McGill. It’s a structured guide to help you break into Data Engineering in four months. **Month 1: Foundations** * **DBMS & SQL**: Basics of databases and querying. *Learning*: Datacamp SQ…
1View on Reddit

u/cryptoyashin r/dataengineering • Recommends

…th=1490&format=png&auto=webp&s=7fa9aba3a431168986398b929eede4cb4fd778f5 ➡️ Excel Sheet with data - https://docs.google.com/spreadsheets/d/1zB6wocrgxNgjWwo6Jkezje0SgJ3PXMIoCEyJwdY-nLU/edit?usp=sharing ➡️ Checkout the full video with explanation of tasks (for Beginners) - "What Do Data Engineers ACTUALLY Do? Tasks & Responsibilities Explained!" - [video **4 Month Study Plan -** https://preview.redd.it/qv0fl0nf6fbe1.png?width=1488&format=png&auto=webp&s=39bad3c34dfb4d0b9844a6b9ad7c23c0a179daae https://preview.redd.it/s5cka0nf6fbe1.png?width=1494&format=png&auto=webp&s=0df56710c9ea19a2e3a615e6529661a11826a859 ➡️ **Full breakdown in:**  link to this video Hope you found this helpful, I will try my…
1View on Reddit