Lead GCP Data Engineer

11 hours ago


Varanasi, India People Prime Worldwide Full time

Important Note (Please Read Before Applying)🚫 Do NOT apply if: • You have less than 10 years of relevant IT experience • You lack hands-on Python + GCP project experience • You have no real-time experience with Dataflow, BigQuery, Airflow, or Spark • You are not experienced in architecting or designing data pipelines • You cannot work in the specified work mode/location • You cannot join within a reasonable timeframe✅ Apply ONLY if you meet ALL mandatory criteria above. Random or irrelevant applications will not be processed. Job Title: Lead Data Engineer – Python & GCP Location: Hyderabad Experience: 10+ Years (STRICTLY) Employment Type: Permanent Notice Period: ImmediateAbout the Company:Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Job Description:• Design, build, and maintain scalable ETL/ELT data pipelines using Python • Architect enterprise-grade solutions leveraging modern data technologies • Work directly with customers for requirement gathering, discovery, and design • Implement data ingestion, transformation, validation, and quality checks • Develop solutions using key GCP services (Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS, IAM, Cloud Run) • Build and manage pipelines using Airflow and write advanced SQL queries • Work with Kafka, Spark, FastAPI, Redis/MongoDB/Bigtable • Participate in CI/CD deployments using GitHub • Ensure performance optimization, monitoring, logging, and data consistency • Create architecture diagrams, design documents, and support post-delivery activitiesMandatory Skills: ✔ 10+ years of hands-on experience in Python (backend or data engineering) ✔ Strong experience with Google Cloud Platform (Dataflow, BigQuery, Cloud Composer, Cloud Functions, GCS, IAM, Cloud Run) ✔ Experience designing scalable ETL/ELT pipelines ✔ Strong SQL skills (SQL Server / Oracle / PostgreSQL) ✔ Hands-on experience with Apache Spark & Kafka ✔ Experience with Airflow / GCP Composer DAGs ✔ Experience with FastAPI ✔ Proficiency in GitHub & CI/CD workflows ✔ Experience with NoSQL technologies (MongoDB / Redis / Bigtable) ✔ Experience deploying solutions on GKE & Cloud RunGood to Have (Optional): • Snowflake experience • Databricks (PySpark) • Azure Data Factory or Azure data engineering tools


  • Data engineer

    1 day ago


    Varanasi, India People Prime Worldwide Full time

    mportant Note (Please Read Before Applying) ???? Do NOT apply if: You have less than 5, GCP and Python experience is a plus. You do not have Expertise in Big Query, Gcp Functions highly experience. You are on a notice period longer than 15 days. You are looking for remote only (role is hybrid in Hyderabad / ). You are a fresher or from unrelated backgrounds...

  • Data Engineer

    4 days ago


    Varanasi, India Pro5.ai Full time

    About the RoleOur client is seeking a Data Engineer to build and maintain data pipelines supporting AI agents for real estate and construction applications. You’ll play a key role in ensuring reliable data flows, integrations, and preprocessing frameworks that power advanced GenAI systems.This is a high-impact opportunity within an early-stage,...

  • Cloud Engineer

    3 weeks ago


    Varanasi, India Whatjobs IN C2 Full time

    We're looking for a highly skilled and experienced Cloud AI Engineer to join our dynamic team. In this role, you'll be instrumental in designing, developing, and deploying cutting-edge artificial intelligence and machine learning solutions leveraging the full suite of Google Cloud Platform (GCP) services. Objectives of this role Lead the end-to-end...

  • Data Scientist

    3 weeks ago


    Varanasi, India Live Connections Full time

    Role - AD Data ScientistExperience - 10+ yearsBudget - Up to 30 LPA maxRequired Notice Period - Immediate to 30 dats onlyMust Have10+ years of hands-on experience in Machine Learning, Deep Learning, and Data Science.Strong programming skills in Python with frameworks like TensorFlow, PyTorch, Scikit-learn, LangChain, and Hugging Face Transformers.Experience...

  • Data Scientist

    2 weeks ago


    Varanasi, India Live Connections Full time

    Role - AD Data ScientistExperience - 10+ yearsBudget - Up to 30 LPA maxRequired Notice Period - Immediate to 30 dats onlyMust Have10+ years of hands-on experience in Machine Learning, Deep Learning, and Data Science.Strong programming skills in Python with frameworks like TensorFlow, PyTorch, Scikit-learn, LangChain, and Hugging Face Transformers.Experience...

  • Lead Data Scientist

    19 hours ago


    Varanasi, India Perfios Full time

    Perfios is a leading B2B SaaS TechFin company empowering 1,000+ financial institutions across 18+ countries with AI-driven financial insights and decision-making. We process over 8 billion data points annually and are now expanding our innovation footprint through advanced AI/ML and data science applications in credit, fraud, and decision intelligence.We are...

  • Data Engineer

    3 weeks ago


    Varanasi, India Talogy Full time

    Data EngineerThis opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines. This role requires an analytical thinker who pays significant attention to detail in their work.We are looking for an experienced data engineer with extensive...

  • Senior data engineer

    4 weeks ago


    Varanasi, India HireAlpha Full time

    Senior Data Engineer (Informatica Platform Engineer / Administrator) – Bangalore We’re looking for a Senior Data Engineer with strong expertise in Informatica platform administration to join our Group IT Data Engineering team.This role is ideal for professionals who enjoy building and maintaining enterprise-grade data platforms that power large-scale...

  • Technical Lead

    1 week ago


    Varanasi, Uttar Pradesh, India MINTRIX-AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About MintrixMintrix is an AI-driven EdTech SaaS startup transforming school operations through intelligent automation, RAG-powered chatbots, and AI agents.Our mission is to simplify educational workflows, empower teachers and administrators, and make schools smarter through AI-integrated systems.We're building the future of education with automation,...


  • Varanasi, India Whatjobs IN C2 Full time

    AI Engineer – Document Intelligence & Identity Verification Experience Required: 5-6 Years Job Type: Full-Time, Remote Location: Noida (Uttar Pradesh) / Remote We’re seeking an experienced AI Engineer to build advanced models and automation pipelines for a cutting-edge document verification and identity validation platform. You’ll design, train, and...