Senior Data Engineer
Job Description
As Senior Data Engineer, you will be part of the Data, Analytics & AI organization which is an integral part in driving the transformation of the company into a data driven culture. Here you will be creating and managing deliveries for Advanced Analytics, Machine Learning and AI to provide value in the form of data-centric services to colleagues across the company.
In collaboration with Data Analysts and Data Scientists, you will facilitate data exploration and advanced analytics activities by processing, cleaning and structuring data which will be used for insight generation, dashboards, and AI models in operation. You will be working within a team that works together for continuous improvement, whereas you will be part in driving advancements in data acquisition, testing, tooling, and automation to enhance data delivery and quality. You may be involved in performing analysis on internal or external data sets and processes to help answer business questions and identify efficiency improvement opportunities.
As part of the team, you will develop new and provide runtime support for existing data pipelines, using a modern data stack built around the Python and SQL. For more senior applicants, there are opportunities to focus on leading your colleagues in projects or be part of the project portfolio discussions to further expand your experience and skillset. You will also have opportunity to be contributing with input to the technology roadmap and future direction of the team.
Your Profile:
- Experienced in developing and maintaining robust data pipelines on high performing data lake solutions in a cloud environment.
- Expert in working with Spark and SQL, have extensive working knowledge of databases and are comfortable in working with large unstructured datasets.
- Deeper knowledge and experience with AWS data stack such as S3, Lambda, Glue, Athena, Kinesis, Step Functions, and Lake Formation is premiered.
- Data lake house solution (Databricks)
- DevOps environment utilizing Git and infrastructure as code (such as Terraform or AWS CDK) together with above mentioned tools to deploy data pipelines through a centralized CI/CD solution.
Soft Skills:
- Analytical, structured, and innovative team-player that loves problem solving and working together to solve complex challenges.
- Communicative and like to put your technical expertise to use in collaboration with cross-functional teams to accelerate data to value creation.
- Motivated to facilitate own end-to-end deliveries by effectively managing business and technical stakeholder needs and requirements in Data Engineering work.