GCP Lead Data Engineer

4 days ago

Hyderabad, India people prime worldwide pvt ltd Full time

Important Note (Please Read Before Applying) Do NOT apply if: You have less than 10 years of GCP Lead Data Engineer experience. You do not have hands-on GCP, Python, Python Fast API, Kafka, Dataflow, MongoDB, Redis/Bigtable, Big Query, Git Hub experience. You are on a notice period longer than 15 days. You are looking for remote only (role is hybrid in Hyderabad ). ✅ Apply ONLY if you meet ALL criteria above. Random / irrelevant applications will not be processed. Job Title: GCP Lead Data Engineer Location: Hyderabad (Hybrid) Experience: 10- 15Years (STRICTLY) Employment Type: Permanent Notice Period: Immediate Joiners / About the Company Egen is a technology services company specializing in cloud, data, analytics, and platform engineering, with a focus on using generative AI to help organizations transform. The company, formerly known as SpringML, has over 700 employees across Canada, Europe, India, and the United States and works with clients across various industries like healthcare, communications, and media. Egen's solutions focus on areas like building scalable platforms, creating data-driven insights, and developing intelligent applications. Job Description We are looking for an experienced Lead Data Engineer who is strong in Python and Google Cloud Platform (GCP) . You will design, build, and manage ETL/ELT data pipelines , work with cloud services, and ensure data is accurate, fast, and secure. Key Responsibilities: Design and build scalable ETL/ELT pipelines using Python . Work with GCP services like Dataflow, BigQuery, Cloud Functions, Composer, GCS, and GKE . Use tools like Spark, Kafka, Airflow, FastAPI, Redis, and MongoDB for data processing. Manage data ingestion, transformation, and quality checks . Write and optimize SQL queries for various databases. Work with GitHub and CI/CD pipelines for deployments. Collaborate with teams to deliver end-to-end data solutions. Handle data migrations from on-premise to cloud systems. Mandatory Skills Strong hands-on Python programming. Deep experience with GCP (Dataflow, BigQuery, Cloud Functions, Composer) . Solid knowledge of data architecture , ETL , and data integration . Experience with Spark, Kafka, Airflow, Redis, FastAPI . Strong SQL skills (SQL Server, Oracle, PostgreSQL, etc.). Experience with GitHub, CI/CD , and cloud deployments (GKE/Cloud Run) . Good understanding of data quality , monitoring , and security . .

  • Lead GCP Data Engineer

    2 weeks ago

    Hyderabad, India Incedo Inc. Full time

    Role: Lead GCP Data Engineer Location: Hyderabad/Chennai Experience: 6+ Years Job details: Key Responsibilities Lead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP. Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...

  • Lead GCP Data Engineer

    2 weeks ago

    Hyderabad, India Incedo Inc. Full time

    Role: Lead GCP Data EngineerLocation: Hyderabad/ChennaiExperience: 6+ YearsJob details:Key Responsibilities- Lead the end-to-end design and implementation of data pipelines, ETL/ELT processes, and data lake/warehouse solutions on GCP.- Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...

  • Lead GCP Data Engineer

    4 weeks ago

    Hyderabad, India Incedo Inc. Full time

    Role: Lead GCP Data EngineerLocation: Hyderabad/ChennaiExperience: 6+ YearsJob details:Key Responsibilities- Lead the end-to-end design and implementation of data pipelines, ETL/ELT processes, and data lake/warehouse solutions on GCP.- Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...

  • GCP Lead Data Engineer

    5 days ago

    Hyderabad, India people prime worldwide pvt ltd Full time

    Important Note (Please Read Before Applying)🚫 Do NOT apply if:You have less than 10 years of GCP Lead Data Engineer experience.You do not have hands-on GCP, Python, Python Fast API, Kafka, Dataflow, MongoDB, Redis/Bigtable, Big Query, Git Hubexperience.You are on a notice period longer than 15 days.You are looking for remote only (role is hybrid in...

  • GCP Lead Data Engineer

    4 days ago

    hyderabad, India people prime worldwide pvt ltd Full time

    Important Note (Please Read Before Applying)🚫 Do NOT apply if:You have less than 10 years of GCP Lead Data Engineer experience.You do not have hands-on GCP, Python, Python Fast API, Kafka, Dataflow, MongoDB, Redis/Bigtable, Big Query, Git Hubexperience.You are on a notice period longer than 15 days.You are looking for remote only (role is hybrid in...

  • GCP Lead Data Engineer

    4 days ago

    Hyderabad, India people prime worldwide pvt ltd Full time

    Important Note (Please Read Before Applying)🚫 Do NOT apply if:You have less than 10 years of GCP Lead Data Engineer experience.You do not have hands-on GCP, Python, Python Fast API, Kafka, Dataflow, MongoDB, Redis/Bigtable, Big Query, Git Hubexperience.You are on a notice period longer than 15 days.You are looking for remote only (role is hybrid in...

  • GCP Lead Data Engineer

    4 days ago

    Hyderabad, India people prime worldwide pvt ltd Full time

    Important Note (Please Read Before Applying)Do NOT apply if:- You have less than 10 years of GCP Lead Data Engineer experience.You do not have hands-on GCP, Python, Python Fast API, Kafka, Dataflow, MongoDB, Redis/Bigtable, Big Query, Git Hubexperience.- You are on a notice period longer than 15 days.- You are looking for remote only (role is hybrid in...

  • Lead GCP Data Engineer

    4 weeks ago

    Hyderabad, India Incedo Inc. Full time

    Role: Lead GCP Data Engineer Location: Hyderabad/Chennai Experience: 6+ Years Job details: Key Responsibilities Lead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP. Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer,...

  • Lead GCP Data Engineer

    4 weeks ago

    Hyderabad, India Incedo Inc. Full time

    Role: Lead GCP Data Engineer Location: Hyderabad/Chennai Experience: 6+ Years Job details: Key Responsibilities Lead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP. Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer,...

  • Lead Data Engineer- GCP

    2 weeks ago

    hyderabad, India Egen Full time

    Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract,...