Summary
Written in English from the original postingData Engineer role focused on maintaining, updating, and expanding configuration-driven data pipelines for a core data platform. The position also involves building tools for data discovery, lineage, governance, and privacy while ensuring dataset quality and reliability. It requires 3+ years of data engineering experience, SQL, pipeline orchestration such as Airflow, and proficiency in at least one major programming language.
Job description
Key Responsibilities:
● Contribute to maintaining, updating, and expanding existing Core Data platform configuration-driven data pipelines
● Build tools and services to support data discovery, lineage, governance, and privacy
● Collaborate with other software/data engineers and cross-functional teams to drive the success of the Core Data platform
● Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, data storage, and more
● Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)
● Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
● Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements
● Maintain detailed documentation of your work and changes to support data quality and data governance requirements
Requirements
- 3+ years of data engineering experience developing large data pipelines
- Proficiency in at least one major programming language (e.g., Python, Java, Scala)
- Experience with SQL and ability to create queries to analyze complex datasets (Snowflake preferred)
- Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
- Strong algorithmic problem-solving expertise
- Excellent written and verbal communication
- Willingness and ability to learn and pick up new skill sets
- Self-starting problem solver with an eye for detail and excellent analytical and communication skills
- Background in at least one of the following: distributed data processing or software engineering of data services, or data deling
- Familiar with Scrum and Agile methodologies
- Bachelor’s Degree in Computer Science, Information Systems equivalent industry experience
_________________________________________________________________________________________________
Benefits
Interested candidates can fwd CV's to [email removed]
Contact Deivy at [phone removed] extn 1221
The weekly Digest
The week's most transparent data engineering jobs in your inbox once a week.
Once a week, a few new jobs that state their salary, location and stack, plus links to the rest. No open tracking; clicks are counted per issue, not per person. Unsubscribe with one click.