About this role
The team is seeking a skilled and motivated Senior Data Engineer to join their dynamic team. The ideal candidate will have strong experience with Azure Databricks, Python, and Spark programming, along with a proven track record in building and optimizing data pipelines. You will play a pivotal role in leveraging Databricks workflows, Databricks Asset Bundles, and CI/CD pipelines using GitHub to deliver high-performance data solutions.
Key Responsibilities:
- Design, develop, and optimize data pipelines in Azure Databricks.
- Implement and manage Databricks workflows and Asset Bundles.
- Utilize CI/CD practices with GitHub to streamline deployment processes.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality and integrity throughout the data lifecycle.
- Troubleshoot and resolve data-related issues as they arise.
Required Skills & Qualifications:
- Strong experience with Python and Spark programming.
- Expertise in Azure Databricks and data pipeline optimization.
- Familiarity with CI/CD practices and tools, specifically GitHub.
- Solid understanding of Data Warehousing concepts and best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork abilities.
Experience: Minimum of 5 years in data engineering or related field.
What we offer:
- Opportunity to work in a collaborative and innovative environment.
- Professional development and growth opportunities.
- Engaging projects that leverage cutting-edge technology.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.