About this role
As a Data Engineer specializing in Microsoft Azure Databricks, you will design, develop, and maintain robust data solutions for data generation, collection, and processing. Your role will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will work on diverse data projects and collaborate with cross-functional teams to drive impactful data initiatives.
Key Responsibilities:
- Serve as a Subject Matter Expert (SME) in data engineering and manage the team to deliver high-quality results.
- Design and implement scalable data pipelines using Microsoft Azure and Databricks.
- Ensure data integrity and quality through rigorous testing and validation processes.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions.
- Optimize existing data processes and workflows for improved efficiency and performance.
- Document data processes, architecture, and workflows for future reference and compliance.
Required Skills & Qualifications:
- Strong experience with Microsoft Azure and Databricks.
- Proficient in ETL processes and data pipeline development.
- Solid understanding of data modeling, data warehousing, and data governance principles.
- Familiarity with programming languages such as Python or Scala.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
Experience:
- Minimum of 5-8 years of experience in data engineering or a related field.
What we offer:
- Opportunity to work on innovative data projects with cutting-edge technology.
- Collaborative and dynamic work environment.
- Professional development and growth opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.