US/Canada - Lead - Data Engineer - GCP
2 days ago
Job Description AuxoAI is seeking a Data Engineer Lead to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP) . This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers. You’ll work closely with cross-functional teams to build production-grade pipelines using tools like BigQuery, Dataflow, Pub/Sub, Cloud Composer , and Dataform , enabling high-quality data delivery and analytics at scale. Responsibilities: Build and optimize batch and streaming data pipelines using Apache Beam (Dataflow) Design and maintain BigQuery datasets using best practices in partitioning, clustering, and materialized views Develop and manage Airflow DAGs in Cloud Composer for workflow orchestration Implement SQL-based transformations using Dataform (or dbt) Leverage Pub/Sub for event-driven ingestion and Cloud Storage for raw/lake layer data architecture Drive engineering best practices across CI/CD, testing, monitoring, and pipeline observability Partner with solution architects and product teams to translate data requirements into technical designs Mentor junior data engineers and support knowledge-sharing across the team Contribute to documentation, code reviews, sprint planning, and agile ceremonies Requirements 7+ years of hands-on experience in data engineering , with at least 2 years on GCP Proven expertise in BigQuery , Dataflow (Apache Beam) , Cloud Composer (Airflow) Strong programming skills in Python and/or Java Experience with SQL optimization , data modeling , and pipeline orchestration Familiarity with Git , CI/CD pipelines , and data quality monitoring frameworks Exposure to Dataform , dbt , or similar tools for ELT workflows Solid understanding of data architecture , schema design , and performance tuning Excellent problem-solving and collaboration skills Bonus Skills: GCP Professional Data Engineer certification Experience with Vertex AI , Cloud Functions , Dataproc , or real-time streaming architectures Familiarity with data governance tools (e.g., Atlan, Collibra, Dataplex) Exposure to Docker/Kubernetes , API integration , and infrastructure-as-code (Terraform) Requirements Bachelor’s degree in Computer Science, Engineering, or related field; or equivalent work experience. Proven experience as a DevOps Engineer or similar role with hands-on expertise in AWS and Azure cloud environments. Strong proficiency in Azure DevOps, Git, GitHub, Jenkins, and CI/CD pipeline automation. Experience deploying and managing Kubernetes clusters (EKS, AKS) and container orchestration platforms. Deep understanding of cloud-native architectures, microservices, and serverless computing. Familiarity with Azure Synapse, ADF, ADLS, and AWS data services (EMR, Redshift, Glue) for data integration and analytics. Solid grasp of infrastructure as code (IaC) tools like Terraform, CloudFormation, or ARM templates. Experience with monitoring tools (e.g., Prometheus, Grafana) and logging solutions for cloud-based applications. Excellent troubleshooting skills and ability to resolve complex technical issues in production environments.
-
US/Canada - Lead - Data Engineer - GCP
2 days ago
Bengaluru, India AuxoAI Engineering Pvt. Ltd. Full timeAuxoAI is seeking a Data Engineer Lead to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP) . This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers....
-
Lead Gcp Data Engineer
4 weeks ago
Bengaluru, India Whatjobs IN C2 Full timeJob Title: Lead Data Engineer – GCP (BigQuery - Composer - Python - PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
Lead GCP Data Engineer
4 weeks ago
Bengaluru, India Impetus Full timeJob Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
GCP Data Engineer
7 days ago
Bengaluru, India Impetus Full timeAbout the Organization-Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...
-
GCP Data Engineer
6 days ago
Bengaluru, India Impetus Full timeAbout the Organization-Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...
-
GCP Data Engineer
6 days ago
Bengaluru, India Impetus Full timeAbout the Organization-Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...
-
GCP Data Engineer
6 days ago
Bengaluru, India Impetus Full timeAbout the Organization-Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...
-
GCP Data Engineer
4 days ago
Bengaluru, India Impetus Full timeAbout the Organization-Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...
-
GCP Data Engineer
4 days ago
Bengaluru, India Impetus Full timeAbout the Organization- Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing...
-
GCP Lead Engineer
6 days ago
Bengaluru, Karnataka, India NTT DATA North America Full time US$ 1,20,000 - US$ 1,80,000 per yearReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).At NTT DATA, we know that with the right people...
