About this role
The team is seeking a Senior Data Engineer with expertise in AWS and big data technologies to join their team in Pune or Nagpur. This role is crucial for enhancing data integration frameworks and leveraging cloud technologies to drive data solutions.
Key Responsibilities:
- Assess and design technology solutions based on existing data integration frameworks.
- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
- Develop and maintain data pipelines using tools such as Databricks, EMR, and AWS Lambda.
- Optimize data storage and retrieval processes in S3 and Snowflake.
- Implement data processing workflows using PySpark and SQL.
- Ensure data quality and integrity throughout the data lifecycle.
Required Skills & Qualifications:
- Strong knowledge of AWS services including S3, EMR, and Lambda.
- Proficiency in big data technologies such as Databricks and Snowflake.
- Solid foundation in database concepts and SQL.
- Experience with data modeling and ETL processes.
- Strong analytical and problem-solving skills.
- Ability to work independently and in a team environment.
Experience:
- 5-8 years of experience in data engineering or related fields, with a focus on big data and cloud technologies.
What we offer:
- Opportunity to work with cutting-edge technologies in a dynamic environment.
- Professional growth and development opportunities.
- Collaborative and innovative team culture.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.