GCP Data Engineer

3 weeks ago

Gurugram, India Persistent Systems Full time

About Us:


Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next and take action. Our offerings, proven solutions, and innovative partner ecosystem create a unique competitive advantage for our clients by giving them the power to see beyond and rise above.

We work with many industry-leading organizations across 18 countries - including 14 of the 30 most innovative US companies, 80% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem. In addition, we are recognised across the industry as the market leader in delivery and customer excellence, as rated by ISG (2020 and 2021 ISG Star of Excellence Awards).

At Persistent, our values are more than a list of ideas to improve our corporate image. We’re dedicated to building an inclusive culture that reflects what’s important to our employees and is based on what they value.

We provide a people-centric work environment that enables our employees to:

- Accelerate growth, both professionally and personally.

- Impact the world in powerful, positive ways, using the latest technologies.

- Enjoy collaborative innovation, with diversity and work-life wellbeing at the core

- Unlock global opportunities to work and learn with the industry’s best.

As a result, 95% of our employees approve of the CEO and 83% recommend working at Persistent to a friend


Requirements:


• Experience in designing and building data lake on GCP Developing and implementing ETL pipelines to load data into data warehouses and data lakes.

• Optimize and troubleshoot data pipelines to ensure performances and reliability.

• Professional experience as GCP Data Engineer with big data knowledge.

• Solid understanding of SQL, Python and data processing frameworks such as Apache Spark, Hive

• Good to have experience in real time/streaming data pipeline

• Knowledge of Airflow/Orchestration tool will be needed to develop data ingestion framework for different sources.

• Kafka and Flink(Real Time) poc and migration

• Batch, Consumption and Orchestration includes EMR to dataproc, databricks and model framework

• Prism and its related components

GCP DataProc(Spark and Hive), Databricks(Spark), Kafka, Airflow, SQL, Scala(Preferred) or Python

Additional Skills: Exposure to multiple technologies: Java, Big Data, Spark, PySpark, Spark SQL, Scala, Hadoop, HDFS, YARN, Hive, GCP Cloud, Google Cloud Dataflow, Big Query, Dataproc, Elasticsearch, MySQL, Oracle, Cloudera, Azure HDInsight, AWS EMR, Python, Spring Boot, Spring Data, REST APIs, Kubernetes, Docker, Git, Oozie.

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Impetus Full time

    Location: GurgaonRoles & Responsibilities:4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies –...

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Impetus Full time

    Location: GurgaonRoles & Responsibilities:4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies –...

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Impetus Full time

    Location: GurgaonRoles & Responsibilities:4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies –...

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Impetus Full time

    Location: Gurgaon Roles & Responsibilities: 4-7 years of IT experience range is preferred. Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services. Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function. Strong experience in Big Data technologies...

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Impetus Full time

    Location: GurgaonRoles & Responsibilities:4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies –...

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Persistent Systems Full time

    About Us:Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next and take action. Our offerings, proven solutions, and innovative partner ecosystem create a unique competitive advantage for our clients by giving them the...

  • GCP Data Engineer

    4 weeks ago

    Gurugram, India Persistent Systems Full time

    About Us:Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next and take action. Our offerings, proven solutions, and innovative partner ecosystem create a unique competitive advantage for our clients by giving them the...

  • GCP Data Engineer

    4 weeks ago

    Gurugram, India Persistent Systems Full time

    About Us:Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next and take action. Our offerings, proven solutions, and innovative partner ecosystem create a unique competitive advantage for our clients by giving them the...

  • GCP Data Engineer

    3 weeks ago

    Gurugram, India Persistent Systems Full time

    About Us:Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next and take action. Our offerings, proven solutions, and innovative partner ecosystem create a unique competitive advantage for our clients by giving them the...

  • GCP Data Engineer

    4 weeks ago

    gurugram, India Persistent Systems Full time

    About Us: Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next and take action. Our offerings, proven solutions, and innovative partner ecosystem create a unique competitive advantage for our clients by giving them the...

  • Lead GCP Data Engineer

    2 months ago

    Gurgaon,Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description Have : 7+ years of experience in the Software and IT industry 4 + years of relevant work experience in GCP cloud data engineering Hands on in one of the programming languages like Python / Scala/ Java Collaborate with clients to understand business requirements and translate them into technical solutions on GCP. Experience in migrating...

  • Gcp Data Architect

    2 weeks ago

    Gurugram, Haryana, India Virtusa Full time

    Python Knowledge with Py spark, Pandas and Python Objects Knowledge of Google Cloud Platform GCP Certified Prof. Data Engineer. Google Cloud GCP cloud composer, cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Py spark DWH Data warehousing concepts & dimension modeling GIT Teams Leading Experience Apache...

  • Opening for Gcp Architect

    4 weeks ago

    Gurugram, Haryana, India Cognizant Full time

    **Title - GCP Architect** **Location - Chennai /Blr/GGN/HYD/Pune/Kolkata** Level - M/SM - 8 to 16 years RR-58704631 JD - **GCP Architect who can design data services (any location)** GCP Data Engineer with hands on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization. LI-RK6

  • Engineer I

    3 weeks ago

    Gurugram, India American Express Full time

    You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create...

  • Engineer I

    4 weeks ago

    Gurugram, India AMEX Full time

    You Lead the Way. Weve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, youll learn and grow as we help you create a...

  • Engineer I

    4 weeks ago

    gurugram, India AMEX Full time

    You Lead the Way. Weve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, youll learn and grow as we help you create a...

  • Gcp Solutions Architect

    2 weeks ago

    Gurugram, Haryana, India Clairvoyant Full time

    **About Clairvoyant** Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Data Engineer

    4 weeks ago

    Gurugram, India Impetus Full time

    About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...

  • Data Engineer

    2 months ago

    Gurugram, India Impetus Full time

    About Impetus Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders providing...

  • Data Engineer

    2 months ago

    Gurugram, India Impetus Full time

    About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...