About this role
The team is seeking a Senior Data Engineer with a strong background in cloud technologies and data engineering concepts. The ideal candidate will have extensive experience working with AWS services and a deep understanding of data processing frameworks.
Key Responsibilities:
- Design and implement data pipelines using AWS Glue, Amazon EMR, and Amazon Redshift.
- Develop and maintain ETL processes using PySpark and Python.
- Collaborate with data scientists and analysts to understand data requirements and ensure data quality.
- Optimize data storage and retrieval processes in AWS using services such as S3, RDS, and DynamoDB.
- Implement best practices for cloud architecture, focusing on high availability and fault tolerance.
- Monitor and troubleshoot data workflows and performance issues.
Required Skills & Qualifications:
- In-depth knowledge of AWS services related to data engineering, including EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg, EMR, and Athena.
- Strong programming skills in Python and SQL.
- Proven experience with data engineering concepts and frameworks.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment.
Experience:
- 5-8 years of relevant experience in data engineering and cloud technologies.
What we offer:
- Opportunity to work in a dynamic environment with a talented team.
- Exposure to cutting-edge technologies and projects.
- Professional development and career growth opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.