Uploaded November 2021 | Updated September 2026, 2 weeks ago
Data engineering is now growing faster than data science. I got to thinking, what does this mean for the data domain as a whole. Is this a good thing? Why is it happening now?
For the most part, data engineering is upstream from data science. The work that they do building data warehouses and data pipelines allows data analysts, data scientists, and ml engineers to build models and create insights from data. Why is this domain, that should precede data science, growing in popularity AFTER data science did?
For better or for worse, the world doesn’t always work linearly. Data science became sexy because many of the top technology companies were making gobs of money with it. Non-Tech companies saw the value that data science and machine learning was providing and they soon followed suit.
Unfortunately for many of these companies following the trend, they didn’t have the data infrastructure to properly leverage data scientists.
I believe the massive uptick in data engineering’s popularity comes from many less technical companies realizing that they made a massive mistake. They needed to hire people to fix their data before hiring all these data scientists.
0:00 Intro
0:35 Infatuation with Data Science
1:39 Top Tech Companies vs Everyone Else
2:25 The Big (Data) Mistake
3:12 Is this a Good Thing?
4:10 Why Now?
5:22 Should YOU Become a Data Engineer?
6:45 HILARIOUS Data Engineering Joke
Video From @SundasKhalid - youtube.com/watch?v=wN_eu04kXhk&ab_channel=SundasKhalid
Video from @SeattleDataGuy - youtube.com/watch?v=SpaFPPByOhM&list=PLXRKPZRrlvE5DEOn2LsCMld8F0TsFc_Dh&index=9&ab_channel=SeattleDataGuy
Other articles Referenced:
- medium.com/bitgrit-data-science-publication/why-is-data-engineering-popular-now-4e41b9f80cf4
- reddit.com/r/dataengineering/comments/o0z8s5/why_is_data_engineering_popular_now
#DataScience #KenJee #DataEngineering
⭕ Subscribe: youtube.com/c/kenjee1?sub_confirmation=1
🎙 Listen to My Podcast: youtube.com/c/KensNearestNeighborsPodcast
🕸 Check out My Website - kennethjee.com
✍️Sign up for My Newsletter - kennethjee.com/newsletter
📚 Books and Products I use - amazon.com/shop/kenjee (affiliate link)
Partners & Affiliates
🌟 365 Data Science - Courses ( 57% Annual Discount): 365datascience.pxf.io/P0jbBY
🌟 Interview Query - interviewquery.com/?ref=kenjee
MORE DATA SCIENCE CONTENT HERE:
🐤My Twitter - twitter.com/KenJee_DS
👔 LinkedIn - linkedin.com/in/kenjee
📈 Kaggle - kaggle.com/kenjee
📑 Medium Articles - medium.com/@kenneth.b.jee
💻 Github - github.com/PlayingNumbers
🏀 My Sports Blog -playingnumbers.com
Check These Videos Out Next!
My Leaderboard Project: youtube.com/watch?v=myhoWUrSP7o&ab_channel=KenJee
66 Days of Data: youtube.com/watch?v=qV_AlRwhI3I&ab_channel=KenJee
How I Would Learn Data Science in 2021: youtube.com/watch?v=41Clrh6nv1s&ab_channel=KenJee
My Playlists
Data Science Beginners: youtube.com/playlist?list=PL2zq7klxX5ATMsmyRazei7ZXkP1GHt-vs
Project From Scratch: youtube.com/watch?v=MpF9HENQjDo&list=PL2zq7klxX5ASFejJj80ob9ZAnBHdz5O1t&ab_channel=KenJee
Kaggle Projects: youtube.com/playlist?list=PL2zq7klxX5AQXzNSLtc_LEKFPh2mAvHIO
Data engineering is now growing faster than data science. I got to thinking, what does this mean for the data domain as a whole. Is this a good thing? Why is it happening now?
For the most part, data engineering is upstream from data science. The work that they do building data warehouses and data pipelines allows data analysts, data scientists, and ml engineers to build models and create insights from data. Why is this domain, that should precede data science, growing in popularity AFTER data science did?
For better or for worse, the world doesn’t always work linearly. Data science became sexy because many of the top technology companies were making gobs of money with it. Non-Tech companies saw the value that data science and machine learning was providing and they soon followed suit.
Unfortunately for many of these companies following the trend, they didn’t have the data infrastructure to properly leverage data scientists.
I believe the massive uptick in data engineering’s popularity comes from many less technical companies realizing that they made a massive mistake. They needed to hire people to fix their data before hiring all these data scientists.
0:00 Intro
0:35 Infatuation with Data Science
1:39 Top Tech Companies vs Everyone Else
2:25 The Big (Data) Mistake
3:12 Is this a Good Thing?
4:10 Why Now?
5:22 Should YOU Become a Data Engineer?
6:45 HILARIOUS Data Engineering Joke
Video From @SundasKhalid - youtube.com/watch?v=wN_eu04kXhk&ab_channel=SundasKhalid
Video from @SeattleDataGuy - youtube.com/watch?v=SpaFPPByOhM&list=PLXRKPZRrlvE5DEOn2LsCMld8F0TsFc_Dh&index=9&ab_channel=SeattleDataGuy
Other articles Referenced:
- medium.com/bitgrit-data-science-publication/why-is-data-engineering-popular-now-4e41b9f80cf4
- reddit.com/r/dataengineering/comments/o0z8s5/why_is_data_engineering_popular_now
#DataScience #KenJee #DataEngineering
⭕ Subscribe: youtube.com/c/kenjee1?sub_confirmation=1
🎙 Listen to My Podcast: youtube.com/c/KensNearestNeighborsPodcast
🕸 Check out My Website - kennethjee.com
✍️Sign up for My Newsletter - kennethjee.com/newsletter
📚 Books and Products I use - amazon.com/shop/kenjee (affiliate link)
Partners & Affiliates
🌟 365 Data Science - Courses ( 57% Annual Discount): 365datascience.pxf.io/P0jbBY
🌟 Interview Query - interviewquery.com/?ref=kenjee
MORE DATA SCIENCE CONTENT HERE:
🐤My Twitter - twitter.com/KenJee_DS
👔 LinkedIn - linkedin.com/in/kenjee
📈 Kaggle - kaggle.com/kenjee
📑 Medium Articles - medium.com/@kenneth.b.jee
💻 Github - github.com/PlayingNumbers
🏀 My Sports Blog -playingnumbers.com
Check These Videos Out Next!
My Leaderboard Project: youtube.com/watch?v=myhoWUrSP7o&ab_channel=KenJee
66 Days of Data: youtube.com/watch?v=qV_AlRwhI3I&ab_channel=KenJee
How I Would Learn Data Science in 2021: youtube.com/watch?v=41Clrh6nv1s&ab_channel=KenJee
My Playlists
Data Science Beginners: youtube.com/playlist?list=PL2zq7klxX5ATMsmyRazei7ZXkP1GHt-vs
Project From Scratch: youtube.com/watch?v=MpF9HENQjDo&list=PL2zq7klxX5ASFejJj80ob9ZAnBHdz5O1t&ab_channel=KenJee
Kaggle Projects: youtube.com/playlist?list=PL2zq7klxX5AQXzNSLtc_LEKFPh2mAvHIO
