GCP Data Engineer

2 days ago


bangalore, India Avanciers Full time

Job description for the Data engineering role

Context: Data engineers are required to assist with transitioning and migration of the data pipelines running on Teradata to the Jungle asset developed on the Openshift platform.

Soft skills:

· Can do attitude, good problem solving skills

· comfortable in working independently as well as in team

· Able to steer tech conversations

Tech responsibilities:

· Migration of data pipelines from Teradata to Starburst (mpp sql query engine, open source version is known as Trinio/Presto)

· Develop models using DBT (template engine) for the sql queries

· Test the outputs of data pipelines and reconcile between source and target

· Create DAG’s on Airflow (scheduling and orchestration tool)

· Troubleshoot issues in the pipelines and fix and deploy

Experience*:

· Experience in building data pipelines using ETL/ELT pattern

· Strong experience in developing sql on a mpp (e.g. hive, trino/presto/starburst (preferably), bigquery, redshift)

· Strong experience in data warehousing, scd2

· Experience in building DBT models

· Understanding of distributed computing platforms (e.g. Hadoop, Kubernetes)

· Experience in using git for source code management

· Experience in identifying testing requirements, test execution from data perspective (e.g. data completeness, data correctness checks)

· Nice to have experience in scheduling tool (preferably airflow, but oozie and control-m is acceptable)

· Understanding of devops and CICD


  • GCP Engineer

    3 weeks ago


    Bangalore, India NTT DATA Services Full time

    Req ID: 295441  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a GCP Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Position...

  • GCP Data Engineer

    3 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore / Pune/ Chennai / Mumbai Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and...

  • GCP Data Engineer

    2 days ago


    bangalore, India Insight Global Full time

    Role: GCP Data Engineer Company: to be released via phone callOpenings: 12Duration: 9 month contract with extensions possibleWork Locations: hyrbid 3x a week in Gurgaon or Bangalore, IndiaInterview Process: 1 roundMust Haves:At least 3-6 Years of Experience as a Data EngineerExperience working with GCP product offeringsExperience with Google's big data...

  • GCP Data Engineer

    5 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for GCP Data EngineerDesired Experience Range: 5+ YearsJob Location: Gurgaon / BangaloreKey responsibilities:As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code (Python, Java), ensuring...

  • Gcp data engineer

    2 days ago


    bangalore, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • GCP Data Engineer

    6 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code (Python, Java),...

  • Gcp Data Engineer

    7 days ago


    Bangalore City, India Insight Global Full time

    Role: GCP Data Engineer Company: to be released via phone callOpenings: 12Duration: 9 month contract with extensions possibleWork Locations: hyrbid 3x a week in Gurgaon or Bangalore, IndiaInterview Process: 1 roundMust Haves:At least 3-6 Years of Experience as a Data EngineerExperience working with GCP product offeringsExperience with Google's big data...

  • GCP Data Engineer

    3 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for GCP Data EngineerDesired Experience Range: 5+ YearsJob Location: Gurgaon / Bangalore / Pune/ Chennai / MumbaiKey responsibilities:As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code...

  • Gcp Data Engineer

    1 week ago


    Bangalore City, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • GCP Data Engineer

    4 hours ago


    bangalore, India Quess IT Staffing Full time

    Position - GCP Data EngineerExperience - 4-8yrsNotice Period - max 20daysJob Requirement: Experience/Skill: Experience: 4+ years of experience in data engineering, with a focuson Google Cloud Platform. GCP Proficiency: Strong expertise in GCP services, includingBigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud SQL, and IAM. Programming Skills:...

  • Java with GCP

    2 weeks ago


    Bangalore, India NTT DATA Services Full time

    Req ID: 292565  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Java with GCP to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Experience: 3 to...

  • Data Scientist+GCP

    2 days ago


    bangalore, India LTIMindtree Full time

    Experience – 4 to 7 years Location – Mumbai, Pune, Bangalore Mandatory Skills – Data Science, GCP, Gen AI, AI/ML Job Details: We are seeking a motivated and adaptable engineer with a minimum of 4 years of experience in software development, data engineering, or cloud technologies with a strong background in Python to join our team as a Google Cloud...

  • GCP Data Engineer

    1 month ago


    Bangalore Urban, India Tech Mahindra Full time

    Overall, 5 + Years of Proven experience as a Data Engineer with a focus on GCP services. • Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub. • Proficiency in SQL. • Solid understanding of data warehousing concepts and ETL processes. • Experience with real-time data processing and streaming analytics. • Strong...


  • bangalore, India Technogen India Pvt. Ltd. Full time

    Role-GCP Data EngineerExp : 2-8.5 YearsPrimary Skills: SQL, GCP (Big Query, Composer, Data Flow), Big Data (Scala, Kafka) , Spark Streaming , CICD , Big Data Pipeline Development.Location : Bangalore,ChennaiPlease share your resumes to Job Description :You'll need to have:Four or more years of relevant work experience.Experience in Big Data technologies -...

  • Data Scientist+GCP

    3 days ago


    bangalore, India LTIMindtree Full time

    Experience – 4 to 7 yearsLocation – Mumbai, Pune, BangaloreMandatory Skills – Data Science, GCP, Gen AI, AI/MLJob Details:We are seeking a motivated and adaptable engineer with a minimum of 4 years of experience in software development, data engineering, or cloud technologies with a strong background in Python to join our team as a Google Cloud...


  • bangalore, India LTIMindtree Full time

    Data Science – GCP requirements – 8 positions Experience – 4 to 7 years Location – Mumbai, Pune, Bangalore Mandatory Skills – Data Science, GCP, Gen AI, AI/ML Job Details: We are seeking a motivated and adaptable engineer with a minimum of 4 years of experience in software development, data engineering, or cloud technologies with a strong...


  • bangalore, India LTIMindtree Full time

    Data Science – GCP requirements – 8 positionsExperience – 4 to 7 yearsLocation – Mumbai, Pune, BangaloreMandatory Skills – Data Science, GCP, Gen AI, AI/MLJob Details:We are seeking a motivated and adaptable engineer with a minimum of 4 years of experience in software development, data engineering, or cloud technologies with a strong background in...

  • GCP Data Architect

    2 days ago


    bangalore, India Tata Consultancy Services Full time

    GCP Data Architect, BQ, Pub/Sub, GKE, Terraform, Python, Cloud DevOps Exp-5 to 10 Location-Pan India • Main Skill Experience in cloud architecture or systems engineering • Experience with identity management and networking segmentation across multiple VPC networks and projects • Experience leading large-scale network migrations to GCP • Experience...


  • bangalore, India techolution Full time

    We are looking for a Google Cloud Data Engineer who will help us build a highly scalable and reliable platform to match our exponential growth. As a Google Cloud Data Engineer, you will be responsible for building a solid back end infrastructure which will enable data delivery in near real-time using next-gen technologies. Title : Google Cloud Data Engineer ...

  • GCP Data Architect

    5 days ago


    bangalore, India Tata Consultancy Services Full time

    GCP Data Architect, BQ, Pub/Sub, GKE, Terraform, Python, Cloud DevOpsExp-5 to 10Location-Pan India• Main SkillExperience in cloud architecture or systems engineering• Experience with identity management and networking segmentation across multiple VPC networks and projects• Experience leading large-scale network migrations to GCP• Experience...