About this role
The team is seeking a Senior Engineer - IT to join their dynamic team in Chennai. This role involves designing, developing, and maintaining scalable data pipelines to support data-driven decision-making.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
- Build robust ETL/ELT workflows for batch and near real-time data processing.
- Write optimized and efficient SQL queries for data transformation, validation, and analysis.
- Work with large-scale distributed datasets using Spark-based processing frameworks.
- Perform data ingestion from multiple sources including APIs, files, and databases into data lakes/lakehouses.
Required Skills & Qualifications:
- Strong experience with Databricks, PySpark, and SQL.
- Proficiency in building ETL/ELT workflows and handling large datasets.
- Familiarity with data lake architectures and data ingestion techniques.
- Experience with distributed computing frameworks, particularly Apache Spark.
- Excellent problem-solving skills and ability to work in a fast-paced environment.
Experience:
- A minimum of 5-8 years of relevant experience in data engineering or a related field.
What we offer:
- An opportunity to work in a collaborative and innovative environment.
- Professional development and growth opportunities.
- A chance to contribute to impactful projects within the organization.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.