About this role
The team is seeking a Senior Data Engineer with strong hands-on expertise in Databricks, PySpark, Python, SQL, and big data processing. This role is fully remote and requires a commitment to working from 12:30 PM to 9:30 PM IST.
In this position, you will be responsible for designing and developing scalable data ingestion pipelines, ensuring high performance and reliability in data processing. You will work closely with cross-functional teams to implement DataOps practices and optimize data workflows.
Key Responsibilities:
- Design and develop data ingestion pipelines using Databricks and Azure Data Factory.
- Utilize PySpark and Python for data processing and transformation tasks.
- Implement performance optimization techniques to enhance data processing efficiency.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Maintain documentation for data processes and workflows to ensure transparency and knowledge sharing.
Required Skills & Qualifications:
- 5-8 years of experience in data engineering or related field.
- Strong expertise in Databricks, PySpark, and Python.
- Proficient in SQL and experience with big data processing frameworks.
- Familiarity with Microsoft Fabric and DataOps practices.
- Excellent problem-solving skills and attention to detail.
What we offer:
- Opportunity to work in a dynamic and innovative environment.
- Flexible remote work arrangement.
- Collaborative team culture focused on professional growth and development.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.