Senior GCP Big Data Engineer

2 weeks ago


Bangalore, India Notus Full time

Job Title : GCP (Google Cloud Platform) Specialist

Number of Positions : 6 (1 Senior Role, 5 Lead Roles)

Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PM

Location : TechM India locations

Notice Period : Early/Immediate/30 days (Positions need to be filled by May)

Budget :

Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Lead Role : 6+ years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Skillset :

- GCP ETL

- Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python

Mandatory Requirements :

- Knowledge of Big Data Architecture patterns and experience in delivery of BigData and Hadoop ecosystems.

- Strong experience in GCP with multiple large projects involving GCP Big Query and ETL.

- Experience in GCP-based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, Airflow, Google Cloud Storage, Data Fusion, Data Flow, Dataproc, etc.

- Experience in SQL/Data Warehouse.

- Expertise in programming languages such as Java, Hadoop, Scala, Python, PySpark.

- Expertise in at least one distributed data processing framework like Spark (Core, streaming, SQL), Storm, or Flink, etc.

- Worked on any of Orchestration tools like Airflow, Oozie.

- Experience in performance tuning, optimization, and data security.

Preferred Experience and Knowledge :

- Excellent understanding of the data technologies landscape/ecosystem.

- Exposure to development with CI/CD pipeline, knowledge of containerization orchestration, and KE engine would be an added advantage.

- Familiarity with the pros and cons of various database technologies like relational, BigQuery, columnar databases, NoSQL.

-Exposure to Data governance, catalog, lineage, and associated tools would be an added advantage.

- GCP PDE certification is a plus point.

(ref:hirist.tech)

  • Bangalore, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...


  • bangalore, India TecHHire Global Full time

    Job Description : We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP : Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...


  • Bangalore, India TecHHire Global Full time

    Job Description : We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP : Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Data Engineer

    1 month ago


    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...

  • GCP Data Engineer

    1 week ago


    bangalore, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 08, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    5 days ago


    bangalore, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 14, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    2 days ago


    bangalore, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 16, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    2 weeks ago


    bangalore, India Impetus Full time

    Location: Bangalore/Gurgaon4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies – Hadoop, Sqoop, Hive...

  • GCP Data Engineer

    2 weeks ago


    bangalore, India Coforge Full time

    Job Description Position: GCP Data Engineer Location: Bangalore Duration: Full Time MUST HAVE SKILLS: 1: Scala 2: Python 3: GCP Cloud (Big Query, Big Table, Google Cloud Storage) 4: ETL Pipelines and Data Pipelines RESPONSIBILITIES: Build data pipelines on cloud GCP Environment. Implement...

  • Gcp Data Engineer

    2 weeks ago


    Bangalore City, India Impetus Full time

    Location: Bangalore/Gurgaon4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.G. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies – Hadoop, Sqoop, Hive...

  • Senior Data Engineer

    1 month ago


    bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 weeks ago


    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...


  • bangalore, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Location Bangalore, Karnataka, India Job Description We are looking for an analytical, big-picture thinker who is driven to enhance and further the mission of Tredence by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization. This Data Engineer...

  • GCP Data Engineer

    1 month ago


    Bangalore Metropolitan Area, India Tredence Inc. Full time

    Have Implemented and Architected solutions on Google Cloud Platform using the components of GCPExperience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines.Experience in some of the following: Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.Experience...

  • Big Data Engineer

    2 days ago


    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...


  • bangalore, India Recro Full time

    Job Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform :Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...

  • GCP Data Engineer

    1 week ago


    bangalore, India Infogain Full time

    GCP Data Engineer (Lead) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 08, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Mandatory skills - Java8, Python, Spark, Spring Boot, GCP/Cloud, Jenkins, Terraform. Should have at least 8+ yrs of exp (for...