About this role
The team is seeking a skilled Data Engineer to build and maintain all data pipelines feeding the Databricks lakehouse. The successful candidate will ensure clean, timely, and governed data flows from various sources across the Investment Division’s five portfolio clusters and, in later phases, the Group’s operating divisions.
Key Responsibilities:
- Build and maintain automated data pipelines to support data ingestion and transformation.
- Own the bronze-to-silver-to-gold transformation logic to ensure data quality and integrity.
- Monitor data quality and implement necessary improvements.
- Manage security master data for compliance and governance.
- Develop and maintain ingestion and classification pipelines for the Document Intelligence Engine.
Required Skills & Qualifications:
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in data pipeline and ETL processes.
- Experience with Databricks and data lakehouse architecture.
- Familiarity with data quality monitoring tools and techniques.
- Knowledge of data governance principles and practices.
- Proficient in programming languages such as Python or Scala.
- Experience with cloud platforms like AWS or Azure is a plus.
Experience:
- Minimum of 5-8 years of experience in data engineering or related fields.
What we offer:
- Opportunity to work in a dynamic and innovative environment.
- Collaborate with a talented team on impactful projects.
- Professional development and growth opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.