About this role
The team is seeking a Senior Data Engineer to join their dynamic team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and curated data assets on Databricks. You will work closely with cross-functional teams to ensure data is accessible and reliable for analysis and decision-making.
Key Responsibilities:
- Design and implement scalable data pipelines using Databricks.
- Develop and maintain ETL/ELT processes for data ingestion, transformation, validation, and publication.
- Utilize advanced SQL, Python, PySpark, and Dbt for data processing and analysis.
- Collaborate with data scientists and analysts to understand data needs and deliver solutions.
- Monitor and optimize data pipeline performance and reliability.
- Ensure data quality and accuracy through rigorous validation processes.
Required Skills & Qualifications:
- Strong experience with Databricks and cloud-based data solutions.
- Proficiency in SQL, Python, and PySpark.
- Familiarity with data modeling and ETL/ELT best practices.
- Experience with data warehousing concepts and tools.
- Ability to work collaboratively in a fast-paced environment.
- Excellent problem-solving skills and attention to detail.
Experience:
- Minimum of 5 to 8 years of experience in data engineering or related fields.
What we offer:
The team provides a collaborative work environment that encourages innovation and growth. You will have the opportunity to work with cutting-edge technologies and contribute to projects that make a meaningful impact.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.