My path into data engineering didn’t start in computer science — it started with a bachelor’s degree in economics, a strong interest in technology, and a lot of curiosity about data.
I’ve had the privilege of working in a field that is constantly evolving and presenting new challenges. In this post, I’ll share my personal journey, look at the career paths I explored along the way, and pass on the best practices that helped me.
Whether you’re just starting out or considering a transition into the world of data, I hope my experience gives you a useful map.
My Journey Into Data Engineering
Where I started
I started my journey with a bachelor’s degree in Economics and a strong interest in technology and a curiosity for data. Determined to turn that curiosity into a career, I went back to school to pursue a Master’s degree in data analytics, which laid the foundation for my career in data engineering.
Graduating on a Friday and starting as a data engineer on Monday, I have never looked back. The data field is dynamic, offering continuous learning and growth opportunities.
The journey from studying economics to becoming a data engineer is a testament to the power of resilience and adaptability. In this article, I’ll share the different career paths in data engineering and the best practices that can guide you on your own journey into this field.
Working with data before the degree
Even before my degree, I was in contact with data. As an SEO specialist, I spent a lot of time gathering data from websites, analysing it, and using it to help businesses improve their search engine rankings.
That experience taught me a lot about the importance of data and how it can be used to drive decision-making. It was a great foundation for my career as a data engineer.
In fact, as a data engineer, I still use a lot of the same skills I learned in SEO. I’m still working with large amounts of data and using my analytical abilities to extract insights from it.
My first data engineering role
My first full-time data engineering role was with a company that used ELK stack (Elasticsearch, Logstash, and Kibana) to search and analyse vast quantities of data. Working with large and complex datasets, I quickly realised how important data engineering is for the success and competitiveness of any organisation.
Through jobs like this one, I gained a deeper understanding of data management, data modelling, and data infrastructure. I learned how to clean and transform raw data into structured workflows that could be used for analysis and decision-making.
Data Analyst, Data Engineer, or Data Scientist: Which Path to Choose?
When it comes to the world of data, there are various career paths to consider. Each path offers unique opportunities for growth and learning.
Here is the short version of how the three main roles differ. For a full side-by-side comparison — responsibilities, skill sets, and education requirements for each role — see my companion article, ‘Data Analyst vs. Data Engineer vs. Data Scientist: What’s the Difference?.’
Data Analyst
A data analyst uses data to answer business questions. They create reports and dashboards, and generate insights.
Data analysts are essential to businesses — they provide the insights that drive decision-making, and help identify trends and patterns that inform strategy.
Data Engineer
Data engineers design and build the infrastructure that collects, processes, and stores data. They work with large and complex data sets, making them available to the people who need them in a format they can work with.
Data Scientist
Data scientists combine the skills of data analysts and data engineers. They have a strong background in mathematics, statistics, and computer science, and use these skills to extract insights from data and build predictive models.
Depending on the size of the company, data scientists may wear a data analyst’s and a data engineer’s hats. In smaller companies, they may handle multiple roles, while in larger organisations, they can be more specialised.
Best Practices for Aspiring Data Professionals
Regardless of the specific career path you choose, there are some best practices that can help you succeed.
1. Keep learning continuously
The field of data is constantly evolving, so be prepared to keep learning. Stay updated with the latest trends and technologies. There are many online resources to help you learn, including courses and certifications, books, and community forums.
2. Develop your technical skills
Develop a strong foundation in programming languages, data structures, and algorithms, as well as in data modelling, data processing, and data storage. This will enable you to build and maintain efficient data infrastructure.
3. Gain practical experience
Apply your skills to real-world projects and datasets. This could involve building data pipelines, designing data warehouses, or working on open-source projects.
4. Collaborate and communicate
Data professionals often work in cross-functional teams, so it is important to develop strong communication and collaboration skills. This will enable you to work effectively with stakeholders, data analysts, data scientists, and other team members.
5. Adopt a problem-solving mindset
Data engineering can be complex and challenging, so embrace a problem-solving mindset. Be persistent, think critically, and be willing to try different approaches to solve problems.
Patterns for Success
While the path to becoming a data engineer may vary, there are some patterns that can significantly enhance your success:
- Gain practical experience: Building real-world projects and working on data-related challenges will help you apply your knowledge and develop your skills.
- Collaborate with others: Joining data-focused communities, participating in hackathons, and collaborating with fellow data professionals will amplify your learning and expose you to new ideas and perspectives.
- Embrace a growth mindset: Data engineering is a rapidly evolving field. Embrace a growth mindset, be open to learning new tools and technologies, and be willing to adapt to changing environments.
- Communicate effectively: Data engineers often work closely with data analysts, scientists, and stakeholders. Strong communication skills are essential to convey technical concepts to non-technical audiences and collaborate effectively within interdisciplinary teams.
- Stay curious: Curiosity is a key trait for data engineers. Stay curious about data, explore new tools and technologies, and seek to understand how different technologies fit into the larger data ecosystem.
Key Takeaways
- A data engineering career doesn’t have to start in computer science — economics, an SEO background, and a degree in data analytics were the foundation of mine.
- Before the degree, practical experience with SEO taught me how data drives decision-making — and those analytical skills still serve me as a data engineer.
- Data analyst, data engineer, and data scientist are three distinct roles, split by what they do with data: interpret it, build the systems that move and store it, or model it.
- The best practices are the same ones that worked for me: keep learning, develop the technical foundations, get practical experience, collaborate, and stay curious.
- Expect some detours along the way — each step teaches the next one its lessons.
Final Thoughts
My route into data engineering went from economics, through SEO and data analysis, back to school, and into engineering — and I wouldn’t trade that winding path. Each step taught me something the next one needed.
If you’re on a similar journey, or thinking about starting one, I’d love to compare notes. Connect with me on LinkedIn and let’s continue the conversation there.
