Big Data + GCP Engineer Full Time

Position: Big Data + GCP Engineer (GKE & FastAPI)

Location : Gurgaon

Experience Required: 6+ Years

Work Model: Fulltime – Hybrid-3 days/week from the client office in Gurgaon

Job Summary

We are looking for an energetic, high-performing, and highly skilled Big Data + GCP Engineer with strong expertise in Google Cloud Platform (GCP), Big Data technologies, GKE, and FastAPI. The ideal candidate should have hands-on experience in designing, developing, and deploying scalable cloud-native applications using Java, PySpark, and modern data engineering technologies.

The candidate must possess strong experience in Big Data processing, cloud infrastructure, containerized deployments, API development, and database optimization. Exposure to Kubernetes-based deployments and modern microservices architecture is highly preferred.

Key Responsibilities

• Design, develop, and deploy scalable applications on Google Cloud Platform (GCP).
• Develop robust and high-performance data processing pipelines using PySpark and Big Data technologies.
• Build and maintain RESTful APIs and microservices using FastAPI.
• Work with large-scale distributed data processing frameworks such as Spark, Hive, MapReduce, and HBase.
• Deploy and manage containerized applications using Google Kubernetes Engine (GKE).
• Develop cloud-native solutions using GCP services such as Compute Engine, App Engine, Cloud Functions, BigQuery, Cloud SQL, Dataproc, and Dataflow.
• Optimize database queries, indexing strategies, and overall application performance.
• Collaborate with cross-functional teams including data engineering, DevOps, and application development teams.
• Perform troubleshooting, debugging, and root cause analysis for production issues.
• Create reusable components, automation scripts, and deployment pipelines.
• Ensure best practices in scalability, security, reliability, and maintainability.

Mandatory Skills

• 6+ years of overall IT experience.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Strong programming expertise in Java 8+ and PySpark.
• Hands-on experience in Big Data technologies:
• Apache Spark
• Hive
• MapReduce
• HBase
• Strong experience with FastAPI development.
• Hands-on experience with Google Kubernetes Engine (GKE).
• Strong understanding of distributed data processing and cloud architecture.
• Experience with GCP services:
• Compute Engine
• App Engine
• Cloud Functions
• BigQuery
• Cloud SQL
• Dataproc
• Dataflow
• Experience in UNIX, Shell scripting, Python, or Perl scripting.
• Strong knowledge of relational databases such as PostgreSQL, MySQL, or DB2.
• Experience in query optimization and database indexing.
• Good understanding of CI/CD and containerization concepts.
• Strong analytical, problem-solving, and debugging skills.

Educational Qualification

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.