About this role
The team is seeking a Lead Data Engineer to join their dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines to ensure efficient data flow and management across various platforms.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Azure and Databricks.
- Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
- Optimize Spark, SQL, and Python code for performance and scalability.
- Work hands-on with Databricks Asset Bundles (DABs) for CI/CD and environment management.
- Continuously adopt and apply new Databricks features to accelerate development processes.
Required Skills & Qualifications:
- Strong experience with Azure services, Databricks, and data pipeline development.
- Proficiency in Spark, SQL, and Python programming.
- Familiarity with CI/CD practices and environment management.
- Ability to optimize data workflows for performance and scalability.
- Excellent problem-solving skills and attention to detail.
Experience:
- 5-8 years of relevant experience in data engineering and pipeline optimization.
What we offer:
- An opportunity to work with cutting-edge technologies in a collaborative environment.
- Professional growth and development opportunities.
- A supportive team culture that values innovation and excellence.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.