Senior GCP Big Data Engineer

2 weeks ago

Bengaluru, India Notus Full time

Job Title : GCP (Google Cloud Platform) Specialist

Number of Positions : 6 (1 Senior Role, 5 Lead Roles)

Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PM

Location : TechM India locations

Notice Period : Early/Immediate/30 days (Positions need to be filled by May)

Budget :

Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Lead Role : 6+ years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Skillset :

- GCP ETL

- Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python

Mandatory Requirements :

- Knowledge of Big Data Architecture patterns and experience in delivery of BigData and Hadoop ecosystems.

- Strong experience in GCP with multiple large projects involving GCP Big Query and ETL.

- Experience in GCP-based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, Airflow, Google Cloud Storage, Data Fusion, Data Flow, Dataproc, etc.

- Experience in SQL/Data Warehouse.

- Expertise in programming languages such as Java, Hadoop, Scala, Python, PySpark.

- Expertise in at least one distributed data processing framework like Spark (Core, streaming, SQL), Storm, or Flink, etc.

- Worked on any of Orchestration tools like Airflow, Oozie.

- Experience in performance tuning, optimization, and data security.

Preferred Experience and Knowledge :

- Excellent understanding of the data technologies landscape/ecosystem.

- Exposure to development with CI/CD pipeline, knowledge of containerization orchestration, and KE engine would be an added advantage.

- Familiarity with the pros and cons of various database technologies like relational, BigQuery, columnar databases, NoSQL.

-Exposure to Data governance, catalog, lineage, and associated tools would be an added advantage.

- GCP PDE certification is a plus point.

(ref:hirist.tech)

  • Senior GCP Big Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget :Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Big Data and Gcp

    3 weeks ago

    Bengaluru, Karnataka, India Manage Captive Solutions Full time

    **Who We Are** Manage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances. We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable...

  • Big Data and Gcp

    4 days ago

    Bengaluru, Karnataka, India Manage Captive Solutions Full time

    Who We AreManage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances. We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable businesses...

  • GCP Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: June 13, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    3 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: June 13, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • Senior Data Engineer

    2 months ago

    Bengaluru, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Senior Associate Data Engineering DE

    2 weeks ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Senior Associate Data Engineering DE

    3 weeks ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Senior Associate Data Engineering DE

    3 weeks ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Senior Associate Data Engineering DE

    2 weeks ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Senior Associate Data Engineering DE

    3 weeks ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • GCP Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP). ...

  • Senior Associate Data Engineering DE

    2 weeks ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...