About this role
The team is seeking a Senior Data Engineer to design and build scalable, reliable batch and streaming data platforms. This role involves developing production-grade ETL/ELT pipelines, data ingestion, transformation, validation, reconciliation, and publishing workflows. The ideal candidate will work extensively with Python, SQL, Apache Spark/PySpark, and AWS to process large-scale data.
Key Responsibilities:
- Design and implement cloud data lakes, lakehouses, and data warehouse components.
- Develop and maintain ETL/ELT processes to ensure data quality and integrity.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions.
- Optimize data processing workflows for performance and scalability.
- Monitor and troubleshoot data pipeline issues to ensure reliability.
Required Skills & Qualifications:
- Proficient in Python, SQL, and Apache Spark/PySpark.
- Strong experience with AWS services related to data engineering.
- Familiarity with data modeling and database design principles.
- Excellent problem-solving skills and attention to detail.
- Ability to work independently and as part of a team in a fast-paced environment.
Experience:
- Minimum of 5-8 years of experience in data engineering or a related field.
What we offer:
- Opportunity to work on cutting-edge data technologies.
- Collaborative and innovative work environment.
- Professional development and growth opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.