Lead Data Engineer – Python

7 days ago

bangalore, India People Prime Worldwide Full time

Job Title: Lead Data Engineer – Python & GCPExperience: 10+ YearsLocation: HyderabadInterview Mode: Face-to-FaceAbout the RoleWe are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). This role involves designing and building scalable data solutions, developing ETL/ELT pipelines, and leading the architecture and implementation of complex data workflows. You’ll collaborate with business and technical teams to deliver high-quality data solutions that support analytics, reporting, and business intelligence needs.Experience Level: 10+ years in IT, with hands-on experience in data engineering and cloud-based systems.Key ResponsibilitiesDesign, develop, and maintain robust ETL/ELT data pipelines using Python.Architect enterprise-grade data solutions using GCP services and other technologies.Work extensively with GCP services such as Dataflow, BigQuery, Cloud Functions, Composer (Airflow), GCS, IAM, and Cloud Run.Build APIs using Python (FastAPI Framework).Handle real-time and batch data processing using Apache Kafka and Apache Spark.Utilize storage systems like MongoDB, Redis, and Bigtable.Manage deployments on GKE and Cloud Run with CI/CD integration (GitHub).Ensure data quality, validation, and transformation for accurate, consistent data delivery.Collaborate closely with data scientists, analysts, and cross-functional teams.Write advanced SQL queries for data extraction and validation.Document designs, data flow diagrams, and standard operating procedures.Required SkillsStrong programming experience in Python.Solid understanding of GCP services (Dataflow, BigQuery, Cloud Functions, Composer, etc.).Hands-on experience with Apache Spark, Airflow, Kafka, and Redis.Proficiency with SQL and database systems like SQL Server, Oracle, or PostgreSQL.Knowledge of CI/CD practices and version control (GitHub).Expertise in designing and managing large-scale data architectures.Experience with cloud data migrations from on-premise sources.Good to HaveExperience with Snowflake and Databricks.Familiarity with Azure Data Factory (ADF) and other Azure tools.

  • Lead GCP Data Engineer

    4 days ago

    Bangalore, India Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • GCP Lead Data Engineer

    7 days ago

    bangalore, India People Prime Worldwide Full time

    Lead Data Engineer – Python & GCPLocation - 10+ YearsJob Overview:We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP). The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support....

  • Lead Data Engineer

    3 days ago

    bangalore, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer– Wealth ManagementLocation: [Noida/Gurgaon/Remote]Experience: 10+ yearsMust Have: Wealth Management DomainJob Summary:We are seeking a highly skilled Lead Data Engineer with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions.Experience in building end-to-end Data Lake and...

  • Data Engineer-

    7 days ago

    bangalore, India MyRemoteTeam Inc Full time

    About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Python Coder – Data Processing Client: Wipro (Google Project) Location: Remote –...

  • Lead GCP Data Engineer

    1 day ago

    bangalore, India Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: BengaluruExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • Lead - Data Engineering

    2 weeks ago

    Bangalore, India Jobted IN C2 Full time

    Overview: Annalect is currently seeking a data engineering lead to join our technology team. In this role you will be building data pipelines and developing data set processes. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will lead...

  • AWS Lead Data engineer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...

  • Data Engineer

    5 days ago

    bangalore, India Awign Expert Full time

    Job Description – Data Engineer (Python + GenAI)Location: Bangalore / Chennai / Hyderabad / PuneExperience: 8+ YearsWe are looking for a senior Data Engineer with strong expertise in Python, hands-on experience in Azure data services, and exposure to GenAI/Agentic AI. The role involves building scalable data pipelines, integrating LLM/GenAI components, and...

  • Lead Ii

    3 days ago

    Bangalore, Karnataka, India UST Full time

    Position Senior Data Engineer Python Devops Experience 7-8 Years Work Location Bangalore Hyderabad Mumbai Kolkata Hybrid Work Hours 2 PM - 11 PM IST Job Summary We are seeking a Senior Data Engineer with strong Python and Devops development skills to join our team The ideal candidate should have 7-8 years of experience in data engineering Python development...

  • Lead GCP Data Engineer

    1 day ago

    bangalore district, India Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...