Big Data GCP Engineer (Gurugram)

The team is seeking a highly skilled Big Data + GCP Engineer to join their team in Gurugram. The ideal candidate will have a strong background in Google Cloud Platform (GCP) and Big Data technologies, along with hands-on experience in designing, developing, and deploying scalable cloud-native applications.

Key Responsibilities:

• Design, develop, and deploy scalable applications on Google Cloud Platform (GCP).
• Develop robust and high-performance data processing pipelines using PySpark and Big Data technologies.
• Build and maintain RESTful APIs and microservices using FastAPI.
• Work with large-scale distributed data processing frameworks such as Spark, Hive, MapReduce, and HBase.
• Deploy and manage containerized applications using Google Kubernetes Engine (GKE).
• Develop cloud-native solutions using GCP services including Compute Engine, App Engine, Cloud Functions, BigQuery, Cloud SQL, Dataproc, and Dataflow.
• Optimize database queries, indexing strategies, and overall application performance.
• Collaborate with cross-functional teams including data engineering, DevOps, and application development teams.
• Perform troubleshooting, debugging, and root cause analysis for production issues.
• Create reusable components, automation scripts, and deployment pipelines.
• Ensure best practices in scalability, security, reliability, and maintainability.

Required Skills & Qualifications:

• 6+ years of overall IT experience.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Proficient in Java 8+ and PySpark.
• Experienced in Big Data technologies: Apache Spark, Hive, MapReduce, HBase.
• Strong experience with FastAPI development.
• Hands-on experience with Google Kubernetes Engine (GKE).
• Solid understanding of distributed data processing and cloud architecture.
• Familiarity with GCP services: Compute Engine, App Engine, Cloud Functions, BigQuery, Cloud SQL, Dataproc, Dataflow.
• Experience in UNIX, Shell scripting, Python, or Perl scripting.
• Strong knowledge of relational databases such as PostgreSQL, MySQL, or DB2.
• Experience with query optimization and database indexing.
• Good understanding of CI/CD and containerization concepts.
• Strong analytical, problem-solving, and debugging skills.

Educational Qualification:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.

What we offer:

• A dynamic work environment with opportunities for professional growth.
• The chance to work on cutting-edge technologies in the cloud and big data space.
• A collaborative team culture that values innovation and creativity.