Gcp Lead Data Engineer

3 days ago

Alwar, India Whatjobs IN C2 Full time

Lead Data Engineer – Python & GCP Location - 10+ Years Job Overview: We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP) . The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support. This role involves designing scalable ETL/ELT pipelines , architecting cloud-native solutions, implementing data ingestion & transformation processes, and ensuring data quality across systems. Experience Level: 10+ years of relevant IT experience in data engineering and backend development. Key Responsibilities: Design, develop, test, and maintain scalable ETL/ELT data pipelines using Python . Architect enterprise-grade data solutions using technologies such as Kafka , GKE , multi-cloud services, load balancers, APIGEE , DBT , LLMs, and DLP tools. Work extensively with GCP services , including: Dataflow – real-time & batch processing Cloud Functions – serverless compute BigQuery – data warehousing & analytics Cloud Composer – workflow orchestration (Airflow) GCS – scalable storage IAM – access control & security Cloud Run – containerized workloads Build APIs using Python FastAPI . Work with Big Data and processing technologies: Apache Spark , Kafka , Airflow , MongoDB , Redis/Bigtable Perform data ingestion, transformation, cleansing, and validation to ensure high data quality. Implement and enforce data quality checks, monitoring, and validation rules. Collaborate with data scientists, analysts, and engineering teams to understand data needs and deliver solutions. Use GitHub for version control and support CI/CD deployments. Write complex SQL queries for relational databases such as SQL Server , Oracle , and PostgreSQL . Document data pipeline designs, architecture diagrams, and operational procedures. Required Skills: 10+ years of hands-on experience with Python in data engineering or backend development. Strong working knowledge of GCP services (Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS, Cloud Run). Deep understanding of data pipeline architecture, ETL/ELT processes, and data integration patterns. Experience with Apache Spark , Kafka , Airflow , FastAPI , Redis/Bigtable . Strong SQL skills with at least one enterprise RDBMS (SQL Server, Oracle, PostgreSQL). Experience in on-prem to cloud data migrations. Knowledge of GitHub and CI/CD best practices. Good to Have: Experience with Snowflake . Hands-on knowledge of Databricks . Familiarity with Azure Data Factory (ADF) or other Azure data tools.

  • Project Manager – Data Engineering

    1 week ago

    Alwar, India Brillio Full time

    About the Company: We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics. You will manage cross-functional teams to execute data platform, pipeline, and analytics initiatives, ensuring alignment with business goals and timely delivery.About the Role: A short paragraph summarizing the key role...

  • Data engineer

    2 weeks ago

    Alwar, India Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data Engineer  Experience: 6 Months to 3 Years  Location: Remote  Joining: Immediate Joiners Preferred  About the Role:   We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data...

  • Lead Software Engineer

    6 days ago

    Alwar, India Scoutright Full time

    Hiring: Lead Software Engineer - Full Stack (Python & React)Location: Chennai / Bangalore | Experience: 9+ Years | Full-time | Hybrid (3 days WFO)Hello from Scoutright!We are a consulting firm with a singular goal - to connect people with work that feels right for them. We understand that every career path is different, and we aim to match professionals with...

  • Senior Backend Engineer | Node |

    1 week ago

    Alwar, India Conceit Consultancy Services Full time

    🚀 Senior Backend Engineer | Node | (Lead Level) – MovatePosition: Permanent, Long-TermExperience: 8–10 YearsLocation: Remote (India)Joining: Urgent – within 15 daysAbout the RoleMovate is seeking a Senior Backend Engineer to build and scale AI-powered enterprise applications that enable knowledge automation and conversational intelligence.You will...

  • Senior Data Engineer

    2 days ago

    Alwar, India Anblicks Full time

    Senior Data Engineer (Snowflake + dbt)Experience: 8–12 YearsLocation: Hyderabad / Ahmedabad (Hybrid)Company: Anblicks Inc. – Great Place to Work® Certified | Snowflake Elite PartnerRole OverviewWe are looking for a highly skilled Senior Data Engineer with deep hands-on experience in Snowflake and dbt to design, build, and optimize scalable ELT pipelines...

  • Senior Data Engineer

    1 day ago

    Alwar, India Anblicks Full time

    Senior Data Engineer (Snowflake + dbt)Experience: 8–12 YearsLocation: Hyderabad / Ahmedabad (Hybrid)Company: Anblicks Inc. – Great Place to Work® Certified | Snowflake Elite PartnerRole OverviewWe are looking for a highly skilled Senior Data Engineer with deep hands-on experience in Snowflake and dbt to design, build, and optimize scalable ELT pipelines...

  • Lead Engineer

    5 days ago

    Alwar, India Mancer Consulting Services Full time

    Job Title: Lead EngineerKey Responsibilities:•Shared Responsibility Models: Define and implement clear shared responsibility models, ensuring accountability across teams for infrastructure, platforms and application security and reliability.•Compliance and Policy as Code: Create roadmaps to embed our SDLC into code together with the platform teams,...

  • Senior QA Auditor/ Senior GCP Auditor

    1 day ago

    alwar, India Tilda Research Full time

    Remote: IndiaOpen to candidates with experience in global clinical research operations.About the RoleWe are seeking a Senior QA Auditor/ Senior GCP Auditor professional with proven experience in audits, SOP management, and regulatory compliance across global clinical research environments. This role is ideal for someone who has worked within or closely with...

  • Engineering manager

    2 weeks ago

    Alwar, India Ripik.AI Full time

    Ripik. AI is hiring for Engineering Manager, Noida! About Us ! Ripik.ai is a fast-growing Industrial AI Saa S startup founded by IIT Delhi and BITS Pilani alumni with experience at Mc Kinsey, Google, IBM, and more. Backed by Accel, Venture Highway, and 25+ top angel investors (including 14 unicorn founders), we build patented full-stack software to automate...

  • Azure Data Engineer

    5 days ago

    Alwar, India Elongo Global Solutions Full time

    🚀 About the Role We are looking for an experienced Azure Data Engineer to lead the design and implementation of scalable, high-performance data solutions on the Azure Data Platform. In this role, you will focus on integrating financial data from SAP BW and SAP BFC into Azure, establishing a robust and automated data foundation that supports advanced...