About this role
The team is seeking an experienced Senior Data Engineer with strong expertise in designing, developing, monitoring, and optimizing scalable data pipelines. The ideal candidate will possess hands-on experience with a variety of data technologies and tools, ensuring efficient data processing and management.
Key Responsibilities:
- Design, develop, and maintain scalable and reliable data pipelines.
- Develop data processing solutions using PySpark.
- Build and manage ETL/ELT pipelines using AWS Glue.
- Orchestrate data workflows using Airflow.
- Optimize data storage and retrieval processes utilizing S3/Iceberg and Redshift.
- Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
Required Skills & Qualifications:
- Strong experience with AWS services, particularly AWS Glue, S3, and Redshift.
- Proficiency in PySpark for data processing.
- Solid understanding of PostgreSQL and data modeling.
- Experience with data pipeline orchestration tools, preferably Airflow.
- Ability to troubleshoot and optimize data workflows.
- Excellent problem-solving skills and attention to detail.
Experience:
- Minimum of 5 to 8 years of experience in data engineering or related fields.
What we offer:
- Opportunity to work with cutting-edge technologies in a dynamic environment.
- Collaborative team culture focused on innovation and professional growth.
- Access to continuous learning and development opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.