Data Engineer

We’re looking for 2 data engineers. It can be mid-level or senior. The main needs are familiarity with GCP, terraform and git. If there is similar experience cloud, infra as code, version control the candidate can also be considered.

Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Their ultimate goal is to make data accessible so that organizations can use it to evaluate and optimize their performance Additionally, they develop different technical tools/services to enable large scale machine learning solutions. As a Data Engineer, you are focused on value creation and growth by making data accessible to the organization, and thus enabling excellent customer experience and business results.

Responsibilities

Design, develop and build real-time data pipelines from a variety of sources (streaming data, APIs, data warehouse, data mesh, messages etc.)
Manage project delivery, planning, steering and risk to ensure that the delivery is effective and anchored to value
Handle product development and management, as well as product risk and issue management
Assist during application deployment and in needs of support
Leverage the understanding of software architecture, software development lifecycle and software design patterns to write scalable, maintainable, well- designed and future proof software
Manage existing pipelines and create new pipelines from a variety of sources (relational, XML, etc.)
Propose and implement solutions for data pipeline stabilization and data quality checks
Coordination with other teams to design optimal patterns for data ingest and egress, as well as lead and coordinate data quality initiatives and troubleshooting
Design and build solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations
Ensure best practices are followed across architecture, codebase and configuration
Manage on-premise hardware
Ensure assurance, audit, compliance and testing related to cyber security issues
Implement and manage secure systems
Secure incident management, investigation and digital forensics
Handle security governance and management, as well as threat assessment and information risk management

Skills and Abilities

A high customer and consumer focus
Ability to establish with clear goals and responsibilities to achieve a high level of performance.
Ability to evaluate different options proactively and ability to solve problems in an innovative way. Develop new solutions or combine existing methods to create new approaches.
Comfortable in working with external product teams to establish the optimal data integration patterns/solutions Basic understanding of Machine Learning

Functional Knowledge

Understand downstream consumer needs, create or understand technical specification
Set up infrastructure, pipelines, deploy code, infrastructure as code, CI/CD, monitor service health
work with jira, and other tools following our agile WoW.
Terraform (or other infra as code solution), git, github, google cloud platform, SQL, python