Lead GCP Data Engineer

1 day ago

Thiruvananthapuram, India People Prime Worldwide Full time

Important Note (Please Read Before Applying)🚫 Do NOT apply if: • You have less than 10 years of relevant IT experience • You lack hands-on Python + GCP project experience • You have no real-time experience with Dataflow, BigQuery, Airflow, or Spark • You are not experienced in architecting or designing data pipelines • You cannot work in the specified work mode/location • You cannot join within a reasonable timeframe✅ Apply ONLY if you meet ALL mandatory criteria above. Random or irrelevant applications will not be processed. Job Title: Lead Data Engineer – Python & GCP Location: Hyderabad Experience: 10+ Years (STRICTLY) Employment Type: Permanent Notice Period: ImmediateAbout the Company:Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Job Description:• Design, build, and maintain scalable ETL/ELT data pipelines using Python • Architect enterprise-grade solutions leveraging modern data technologies • Work directly with customers for requirement gathering, discovery, and design • Implement data ingestion, transformation, validation, and quality checks • Develop solutions using key GCP services (Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS, IAM, Cloud Run) • Build and manage pipelines using Airflow and write advanced SQL queries • Work with Kafka, Spark, FastAPI, Redis/MongoDB/Bigtable • Participate in CI/CD deployments using GitHub • Ensure performance optimization, monitoring, logging, and data consistency • Create architecture diagrams, design documents, and support post-delivery activitiesMandatory Skills: ✔ 10+ years of hands-on experience in Python (backend or data engineering) ✔ Strong experience with Google Cloud Platform (Dataflow, BigQuery, Cloud Composer, Cloud Functions, GCS, IAM, Cloud Run) ✔ Experience designing scalable ETL/ELT pipelines ✔ Strong SQL skills (SQL Server / Oracle / PostgreSQL) ✔ Hands-on experience with Apache Spark & Kafka ✔ Experience with Airflow / GCP Composer DAGs ✔ Experience with FastAPI ✔ Proficiency in GitHub & CI/CD workflows ✔ Experience with NoSQL technologies (MongoDB / Redis / Bigtable) ✔ Experience deploying solutions on GKE & Cloud RunGood to Have (Optional): • Snowflake experience • Databricks (PySpark) • Azure Data Factory or Azure data engineering tools

  • GCP & PySpark with ETL - Lead

    3 days ago

    Kochi, Thiruvananthapuram, India UST Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key ResponsibilitiesDesign, develop, and optimize ETL pipelines using PySpark on Google Cloud Platform (GCP).Work with BigQuery, Cloud Dataflow, Cloud Composer (Apache Airflow), and Cloud Storage for data transformation and orchestration.Develop and optimize Spark-based ETL processes for large-scale data processing.Implement best practices for data...

  • Lead- Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India UST Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    7 - 12 Years1 OpeningTrivandrumRole descriptionLead II - Software Engineering Who we are:At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 25 countries, we build for...

  • Data Engineer

    4 weeks ago

    Thiruvananthapuram, India UST Full time

    Greetings from UST Who we are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world. UST is a mission-driven group of over 38,000+ practical problem...

  • Lead I

    1 week ago

    Thiruvananthapuram, Kerala, India UST Full time

    We are recruiting Data Engineers with strong technical ability who can articulate well to non-tech audience who will join our team on a permanent basis Role The Data Engineer will engage with external Clients and internal customers understand their needs and design build and maintain data pipelines and infrastructure using Google Cloud Platform GCP This will...

  • Data Engineering

    4 days ago

    Thiruvananthapuram, Kerala, India UST Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    9 - 12 Years1 OpeningTrivandrumRole descriptionSpecialist I - Software EngineeringWho we are:At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for...

  • data engineering faculty

    2 weeks ago

    Thiruvananthapuram, Kerala, India Edure Learning Full time ₹ 1,50,000 - ₹ 3,00,000 per year

    We are looking for a skilled and passionate Data Engineering Faculty to train and mentor students in modern data engineering concepts and tools. The ideal candidate should have hands-on experience in data pipelines, databases, cloud platforms, and big data technologies, along with a strong passion for teaching and student development.Key...

  • Lead Engineer

    4 weeks ago

    Thiruvananthapuram, India Velodata Global Pvt Ltd Full time

    Job Title: Lead Engineer – .NETLocation: Cochin (COK) / Trivandrum (TVM) Experience: 5 to 8 years (relevant experience: 5 to 8 years) Salary budget up to 20 lpa Onboarding: ASAPJob PurposeLead the design, development, and delivery of high-quality web applications and APIs using .NET Core. Take ownership of technical excellence, mentoring, and process...

  • Lead Engineer

    3 weeks ago

    thiruvananthapuram, India Velodata Global Pvt Ltd Full time

    Job Title: Lead Engineer – .NET Location: Cochin (COK) / Trivandrum (TVM) Experience: 5 to 8 years (relevant experience: 5 to 8 years) Salary budget up to 20 lpa Onboarding: ASAP Job Purpose Lead the design, development, and delivery of high-quality web applications and APIs using .NET Core. Take ownership of technical excellence, mentoring, and process...

  • Lead Engineer

    4 weeks ago

    Thiruvananthapuram, India Velodata Global Pvt Ltd Full time

    Job Title: Lead Engineer – .NET Location: Cochin (COK) / Trivandrum (TVM) Experience: 5 to 8 years (relevant experience: 5 to 8 years) Salary budget up to 20 lpa Onboarding: ASAP Job Purpose Lead the design, development, and delivery of high-quality web applications and APIs using .NET Core. Take ownership of technical excellence, mentoring, and process...

  • Lead Full Stack Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Equifax Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed,...