About this role
The team is seeking a Staff Engineer - Big Data to join their team in Bangalore/Mumbai, India. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark and Apache Spark. You will process and analyze large-scale structured and unstructured datasets in distributed environments, and build real-time analytics on cloud and edge devices.
Key Responsibilities:
- Design and implement scalable data pipelines using PySpark and Apache Spark.
- Process and analyze large datasets in both structured and unstructured formats.
- Build real-time analytics solutions for cloud and edge devices.
- Solve complex data and architectural challenges using cutting-edge technologies.
- Collaborate cross-functionally with data scientists, data engineers, and other stakeholders.
Required Skills & Qualifications:
- Strong experience with PySpark and Apache Spark.
- Proficiency in handling large-scale data processing.
- Familiarity with cloud platforms and edge computing.
- Excellent problem-solving skills and ability to work in a fast-paced environment.
- Strong communication and collaboration skills.
Experience: 5-8 years of relevant experience in Big Data engineering or related fields.
What we offer:
- Opportunity to work with cutting-edge technology in a dynamic environment.
- Collaborative and innovative team culture.
- Opportunities for professional growth and development.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.