About this role
The team is seeking an experienced Big Data Engineer to join their team in Pune or Nagpur. The ideal candidate will possess strong expertise in PySpark and the Big Data ecosystem. This role involves designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.
Key Responsibilities:
- Design, develop, and maintain data pipelines using PySpark and related Big Data technologies.
- Collaborate with cross-functional teams to gather and analyze requirements.
- Optimize data processing workflows for performance and efficiency.
- Monitor and troubleshoot data pipeline performance issues.
- Implement data quality checks and validation processes.
- Stay updated with the latest industry trends and technologies in Big Data.
Required Skills & Qualifications:
- Strong experience with PySpark and Hadoop ecosystem.
- Proficiency in data modeling and ETL processes.
- Experience with cloud platforms such as AWS or Azure.
- Knowledge of SQL and NoSQL databases.
- Familiarity with data warehousing solutions.
- Excellent problem-solving and analytical skills.
Experience:
- 4-8 years of relevant experience in Big Data engineering or similar roles.
What we offer:
- A dynamic work environment with opportunities for professional growth.
- Collaborative team culture and innovative projects.
- Access to cutting-edge technologies and training resources.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.