Ben Rogojan outlines the essential skills required for data engineers, including ETL, data warehousing, SQL, and programming languages.
At a high level, data engineers help take data from point A to point B and remodel it into a format where analysts and data scientists can easily use it.
From a skills perspective, this means that data engineers specialize in ETLs (extract, transform, load), automation (usually with Python or other programming languages), data modeling/data warehousing, SQL and NoSQL data manipulation, and data visualization, to name a few.
The skills that are less known are skills like ETLs and data warehousing. Both of these are usually discussed more in master’s or certificate programs after getting your bachelor’s degree — although we suspect this will or has already changed.
More than likely you will need to learn these skills in some form of order.
Learn More about data engineering Googles DE certificate
coursera.pxf.io/rn1rGv
Starting with python and SQL, then ETLs and data warehousing, cloud and data viz, etc.
Intro
Python And SQL
ETL and Data Warehousing
Cloud, DevOps and Dataviz
Specialize
The dashboard UI article i reference can be found here
uxplanet.org/10-rules-for-better-dashboard-design-ef68189d73…
If you need data consulting help, then reach out to our team here:
theseattledataguy.com/
Also, if you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.
seattledataguy.substack.com/
Check out my Medium here:
medium.com/@SeattleDataGuy
Watch our video on the reality of being a data engineer
youtube.com/watch?v=6RiA_Qur2yo
Why it's here
1 person recommends this
Moments people linked to
n
u/nonkeymnin r/dataengineering • Recommends
Breaking Into Data Engineering - Why Is It So Challenging
Breaking into the data engineering I think can be difficult for a few different reasons and I wanted to cover some of the challenges I see people facing as well as some of the solutions I have implemented as well as other people I know.
# First, the challenges:
Lack Of College Courses That Teach Data Engineering \- Overall, there are limited courses that teach on data engineering concepts in college. I have noticed plenty of masters courses offer some big data concepts but overall I feel like data warehousing, data pipelines and other key concepts like streaming aren't really taught as they tend to be more practical and less the…