About this role
We are looking for an experienced **Data Engineer (Lead)** with strong expertise in **Databricks** to design, develop, and maintain scalable data pipelines and data processing solutions.Key Responsibilities
- Design, develop, and maintain scalable data pipelines using **Databricks**.
- Develop data processing solutions using **PySpark and Python**.
- Work with **Apache Spark** for large-scale data processing.
- Build and optimize **ETL/ELT pipelines**.
- Work with **Delta Lake** for data storage and processing.
- Develop and manage workflows using **Databricks Workflows**.
- Perform data transformation, cleansing, and validation.
- Optimize Spark jobs and improve pipeline performance.
- Collaborate with data engineers, analysts, and other technical teams.
- Troubleshoot data pipeline issues and ensure data quality.
Required Skills
- **8-10** years of experience in **Data Engineering**.
- Strong hands-on experience with **Databricks**.
- Good knowledge of **PySpark and Python**.
- Strong understanding of **Apache Spark**.
- Experience with **Delta Lake** and data lake architecture.
- Good knowledge of **SQL**.
- Experience in building **ETL/ELT data pipelines**.
- Understanding of cloud platforms such as **Azure, AWS, or GCP**.
- Experience with **Git and CI/CD** is an added advantage.
Good to Have
- Experience with **Azure Databricks**.
- Knowledge of **Azure Data Factory, ADLS, or similar cloud data services**.
- Experience with **DBT, Snowflake, or other modern data platforms**.
- Databricks certification is a plus.
What We Offer
- Opportunity to work on real-world **Data Engineering and AI projects**.
- Exposure to modern data technologies and cloud platforms.
- Collaborative and learning-focused work environment.
- Opportunity to work with a growing technology team.
Pay: ₹500,000.00 - ₹2,000,000.00 per year
Work Location: In person
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.