Mar 22, 2022Member-onlyWhy Data Engineering Has Overtaken Data ScienceIt was October 2012, Data Science seemingly exploded overnight with the publishing of the now-famous Harvard Business Review article titled “Data Scientist: The Sexiest Job of the 21st Century”. This triggered a tidal wave of interest in advanced analytics, was the impetus for many graduate Data Science programs, and careers…Data Science4 min readData Science4 min read
Mar 4, 2022Member-onlyData Engineering Career Path: To Code or to No-Code?Which direction do I have to grow in before ultimately topping out in this discipline? — As a Sr. Data Engineer, I find myself questioning what’s next. Many companies consider their Data Engineers an extension of analytics (I’m looking at you, Meta.) Many others, such as Apple and Netflix, see their Data Engineers as an extension of Software Engineering. My current skills are more focused towards…Software Development4 min readSoftware Development4 min read
Published inTowards Data Science·Feb 23, 2022Member-onlyA Day in the Life of a Silicon Valley Data EngineerThe Data Engineer has been gaining popularity in the past 10 years, but what exactly do Data Engineers do? Data Engineers in my experience wear many hats, and often sit in the middle of a triangle of Business Intelligence, Software Engineering, and Data Science. One primary role of the Data…Data Science6 min readData Science6 min read
Published inDev Genius·Feb 19, 2022Member-onlyYour SQL is Bad (You Should Feel Bad)When I tried to submit my first bit of SQL to my code repository, the response I received must have been longer than the code submitted, and I had been writing (what I thought to be) good SQL for years. Looking around at samples of other code, I realized that…6 min read6 min read
Published inDev Genius·Feb 16, 2022Member-only2022 Data Engineering Job Market: Analysis of 1,000 FAANG Job PostingsRecently, I was strongly considering the prospect of switching careers, so I set out to answer the question “What skills are in-demand for Data Engineers in 2022.” To do this, I manually collected data from LinkedIn, amassing 1,029 Data Engineer jobs at 15 top tech companies such as Meta, Amazon…Data5 min readData5 min read
Published inTowards Data Science·Feb 11, 2022Member-onlyThe Data Scientist of the Future, According to MicrosoftRecently, I built a predictive model that will soon produce tremendous value, but I’m not a Data Scientist, nor do I have any formal training in Data Science. This got me thinking; why does so much industry and education exist around such specialized data science? Back in 2012, the Harvard…Data5 min readData5 min read
Published inDev Genius·Feb 7, 2022Member-onlyLearn from Silicon Valley’s Data Engineers: Dimensional Data Modeling is DeadMy first day in Silicon Valley was in 2019, and one of my biggest surprises was that I didn’t find any dimensional data marts. I was used to joining facts to dimensions and could rattle off normal forms and preach best practices of data modeling. I considered myself an expert…Data5 min readData5 min read
Jan 30, 2022Member-onlyWhy Working at Meta is Bad for Data EngineersI have to come clean — I build data pipelines, but I’m not a Data Engineer; at least according to some top tech companies. Over the past few years at one Silicon Valley company, I’ve worked with many Data Engineers. To be more specific; varying roles who deliver work commonly…Technology5 min readTechnology5 min read
Jan 18, 2022Member-onlyHow AutoML is Killing the Data ScientistWhile working for one Silicon Valley company, I realized the Data Scientist as we know it is a breed dying right before my eyes. Machine Learning has advanced many industries, leading to task automation, better ability to predict outcomes, and deep learning applications to interpret and generate text. Traditionally, machine…Data Science4 min readData Science4 min read
Published inDev Genius·Jan 8, 2022Member-onlyWhy You Should Treat Your SQL Like CodeFor the past 2 years working at a large Silicon Valley technology company, I’ve been observing the way Data Engineers treat SQL the same way Software Engineers treat code. This winning mentality can be integrated into the data strategy of any company of any size. I’m going to walk through…Data5 min readData5 min read
