Lead Data Engineer

5 days ago

New Delhi, India People Prime Worldwide Full time

Important Note (Please Read Before Applying)Do NOT apply if:You have less than 10 years or more than 12 years of total IT experience You do not have hands-on experience with Python and GCP Data Engineering projects You lack real-world experience in building and deploying ETL/ELT pipelines using GCP services (Dataflow, BigQuery, Composer, etc.) You have no exposure to Apache Spark, Kafka, or Airflow You are on a notice period longer than 30 days You are looking for a purely remote role (onsite/client engagement required) You come from a non-data background (e.g., testing, support, or non-engineering roles)✅ Apply ONLY if you meet ALL mandatory skills and criteria above.Job Title:Lead Data Engineer - GCP + PythonLocation:HyderabadYears of Experience:10+YearsAbout the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Job Description :Key Responsibilities: ● Design, develop, test, and maintain scalable ETL data pipelines using Python. ● Architect the enterprise solutions with various technologies like Kafka, multi-cloud services, auto-scaling using GKE, Load balancers, APIGEE proxy API management, DBT, using LLMs as needed in the solution, redaction of sensitive information, DLP (Data Loss Prevention) etc. ● Work extensively on Google Cloud Platform (GCP) services such as: ○ Dataflow for real-time and batch data processing ○ Cloud Functions for lightweight serverless compute ○ BigQuery for data warehousing and analytics ○ Cloud Composer for orchestration of data workflows (on Apache Airflow) ○ Google Cloud Storage (GCS) for managing data at scale ○ IAM for access control and security ○ Cloud Run for containerized applicationsRequired Skills: ● 10 to 12 years of hands-on experience in Python for backend or data engineering projects. ● Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.). ● Solid understanding of data pipeline architecture, data integration, and transformation techniques. ● Experience in working with version control systems like GitHub and knowledge of CI/CD practices. ● Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs. ● Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.). ● Experience in data migrations from on-premise data sources to Cloud platforms.✅ Mandatory Skills Strong hands-on expertise in Python for backend and data engineering projects ✔ Proven experience in Google Cloud Platform (GCP) — especially Dataflow, BigQuery, Cloud Composer, Cloud Functions, GCS, and IAM ✔ Strong understanding of ETL/ELT pipeline design, architecture, and development ✔ Hands-on experience with Apache Spark, Kafka, and Airflow (GCP Composer DAGs) ✔ Experience in developing APIs using Python FastAPI framework ✔ Experience with GKE (Google Kubernetes Engine) and Cloud Run for deployment ✔ Strong SQL skills with enterprise databases (SQL Server / Oracle / PostgreSQL) ✔ Familiarity with NoSQL databases like MongoDB, Redis, or Bigtable ✔ Proficient in Git/GitHub and CI/CD pipeline deployments for data projects ✔ Experience in data migration from on-premise sources to Cloud platforms ✔ Solid knowledge of data quality, validation, monitoring, and data governance best practices

  • Operations Data Lead

    1 week ago

    New Delhi, India Data Unveil Full time

    Position Title: Operations Data LeadExperience:5 Years to 6 Years Location:Hyderabad, Telangana Hire Type:Full Time, On-site Start Date:ImmediateOverview: The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...

  • Data Analytics Lead

    3 days ago

    delhi, India NTT DATA Full time

    Build, manage, and foster a high-functioning team of data engineers and Data analysts. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Experience of working with manufacturing industry in building a centralized data platform for self service reporting. Lead the data analytics team members, providing...

  • Sr Operations Data Lead

    4 weeks ago

    New Delhi, India Data Unveil Full time

    Position Title: Sr Operations Data LeadExperience: 4 Years to 6 YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...

  • Lead Data Engineer

    3 weeks ago

    New Delhi, India Anblicks Full time

    Lead Data Engineer Location: Hyderabad or Ahmedabad Experience: 8+ years Skills: Snowflake, Python/Pyspark, SQLOnly Immediate to 15 Days joiners apply.Key Responsibilities: Lead the end-to-end Snowflake platform implementation, including architecture, design, data modeling, and governance. Oversee the migration of data and pipelines from legacy platforms to...

  • lead Data Engineer

    3 weeks ago

    New Delhi, India Cozzera Full time

    Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks....

  • Lead Data Engineer

    3 days ago

    New Delhi, India People Prime Worldwide Full time

    Senior & Lead Data EngineerJob Details:- Client: Egen - Role: Senior & lead Data Engineer - Experience: 7-12 Years - Location: Hyderabad - Interview Mode: F2F Interview on monday - Notice Period Preference: Immediate to 30 DaysMandatory Skills Matrix :Skill Mandatory/Good to Have1 .Python Mandatory2 .GCP Mandatory3.RESTful APIs or FastAPI Mandatory4.GitHub...

  • Lead Data Engineer

    1 week ago

    New Delhi, India Cimpress Full time

    Our Team: Enterprise Business SolutionsVista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain, and HR functions. The cross-functional team includes product owners, analysts, technologists, data engineers and more – all focused on providing Vista with...

  • Data Analytics Lead

    3 weeks ago

    Delhi, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years Location: Delhi NCR...

  • Lead Data Engineer

    4 weeks ago

    New Delhi, India People Prime Worldwide Full time

    We’re Hiring: Senior / Lead Data Engineer – Python & GCP | Hyderabad (Hybrid)Are you someone who loves building scalable data pipelines, designing cloud-native solutions, and solving complex data challenges?Here’s your chance to join a high-performing team working on cutting-edge Data Engineering projects on Google Cloud Platform (GCP)!Role: Senior /...

  • Lead Data Engineer

    5 days ago

    New Delhi, India MakeMyTrip Full time

    Role:Lead Data Engineer Location:Bangalore Years of Experience:6 -8 Years About the function: At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We...