About this role
**Senior Data Platform Engineer**
**Location: Pune, India**
**Model of Work: Hybrid**
**About The team**
The team connects people and information across the energy value chain. Twenty years ago, we built the first software for gas plant accountants. Pipeline operators came next, followed by land administrators, pumpers, and planners. Since 1998, The team has helped thousands of energy workers with business workflows that optimize profitability and growth. Our vision for the future connects the global energy ecosystem through cloud-first software, data standards, and integration. The trusted source of decision-ready data for 1,800+ companies, The team makes the essential connections that let us work better together in the connected energy workplace. For more information, visit quorumsoftware.com
**Be a part of our legacy**
The team is the world's largest provider of digital technology focused solely on business workflows that empower the next evolution of energy. From emerging companies to supermajors, throughout every region of the globe, customers rely on The team's proven innovation and unmatched global expertise to streamline business operations and make data-driven decisions that optimize profitability and growth. Our industry-leading solutions are transforming energy companies across the entire value chain, helping visionary leaders evolve their organizations into modern energy companies.
**Who we are looking for:**
Are you excited by challenges? Do you enjoy working in a fast-paced, international and dynamic environment? Then now is the time to join The team, a rapidly growing company and industry leader in oil & gas transformation.
**Job Purpose**
We are looking for a Senior Data Platform Engineer to join the OPTI (Office of Product and Technology Innovation) AI Platform team in Pune. You will build, deliver, and maintain the data pipelines, analytics, dashboards, and reporting that run on the Databricks platform of the OPTI AI team, and you will own their data quality and monitoring.
You are a strong individual contributor who takes ownership of complex technical problems, brings opinions to design discussions, and raises the quality bar of everything you touch. You won't just execute tickets: you'll help shape how data moves, transforms, and gets consumed. You will work day to day with the Pune and US, AI Platform team and the team supports what it builds in production.
**What You Will Do:**
- Design, build, and maintain scalable data pipelines that move and transform data across Bronze, Silver, and Gold layers in a Medallion Architecture
- Develop and optimize data workflows in Databricks, Databricks Workflows, and Unity Catalog
- Build dashboards and reports with stakeholders/SMEs, turning their requirements into reliable, well-designed views of the data
- Own data quality and monitoring for your pipelines: checks, alerting, and observability that keep SLAs met consistently
- Take part in design reviews, bringing practical experience and a critical eye to technical decisions
- Use AI coding tools and our AI Development Life Cycle (AIDLC) as part of how you build, test, and ship
- Work with Azure data services for storage, orchestration, security, and infrastructure, alongside the team's DevOps engineer
- Collaborate with stakeholders, AI Platform team in US and India to shape what gets built and why
- And other duties as assigned.
**What to Bring:**
**Data engineering fundamentals**
- 5+ years of hands-on data engineering experience in a production environment
- Strong Python and SQL, complex joins, and performance tuning
- Solid understanding of pipeline design patterns: incremental loading, schema evolution, and error handling
- Experience with multiple ingestion methods: Batch based, JDBC, API driven, KAFKA etc
**Databricks and Spark**
- Hands-on experience with Apache Spark or other large-scale data processing tools
- Databricks experience strongly preferred, Unity Catalog, and Databricks Workflows
- Working knowledge of Medallion Architecture and how to structure Bronze, Silver, and Gold layers for different data domains and Star-schema presentation layer. Useful knowledge of SCD2, data lineage, data quality measures, etc
**Quality, testing, and observability**
- A testing mindset: automated tests for transformations, data quality checks, and validation built into the pipeline
- Experience setting up monitoring and alerting for production pipelines, and debugging and optimizing slow or failing ones
- Familiarity with CI/CD for data pipelines, including version control, automated testing, and deployment (GitHub Actions or Azure DevOps)
**Reporting**
- Strong Experience building dashboards and reports that business users rely on
**Azure**
- Hands-on experience with Azure data services such as Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Microsoft Purview, and Azure Key Vault
- Hands-on experience with infrastructure as code on Azure, such as Terraform or Bicep
**Working style:**
- Hands-on experience with AI coding tools like Claude
- Clear written and spoken English, and confidence working with distributed teams across India and the US
**Nice to Have:**
- Experience in the oil and gas or energy industry, particularly with operational, production, or field data
**Additional Details**
- Visa Sponsorship: Employment eligibility to work with The team in India is required as the company will not pursue visa sponsorship for this position.
**The team Diversity Statement:** At The team, we are committed to fostering, cultivating, and preserving a culture of belonging. We want to be the place where a diverse pool of talented people join us, stay with us and do their best work. With a diverse team of employees, we grow and learn better together. The collective sum of the individual differences, life experiences, knowledge, innovation, self-expression, and talent that our employees inv