Senior GCP Big Data Engineer

4 weeks ago

Bengaluru, India Notus Full time

Job Title : GCP (Google Cloud Platform) Specialist

Number of Positions : 6 (1 Senior Role, 5 Lead Roles)

Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PM

Location : TechM India locations

Notice Period : Early/Immediate/30 days (Positions need to be filled by May)

Budget :

Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Lead Role : 6+ years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Skillset :

- GCP ETL

- Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python

Mandatory Requirements :

- Knowledge of Big Data Architecture patterns and experience in delivery of BigData and Hadoop ecosystems.

- Strong experience in GCP with multiple large projects involving GCP Big Query and ETL.

- Experience in GCP-based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, Airflow, Google Cloud Storage, Data Fusion, Data Flow, Dataproc, etc.

- Experience in SQL/Data Warehouse.

- Expertise in programming languages such as Java, Hadoop, Scala, Python, PySpark.

- Expertise in at least one distributed data processing framework like Spark (Core, streaming, SQL), Storm, or Flink, etc.

- Worked on any of Orchestration tools like Airflow, Oozie.

- Experience in performance tuning, optimization, and data security.

Preferred Experience and Knowledge :

- Excellent understanding of the data technologies landscape/ecosystem.

- Exposure to development with CI/CD pipeline, knowledge of containerization orchestration, and KE engine would be an added advantage.

- Familiarity with the pros and cons of various database technologies like relational, BigQuery, columnar databases, NoSQL.

-Exposure to Data governance, catalog, lineage, and associated tools would be an added advantage.

- GCP PDE certification is a plus point.

(ref:hirist.tech)

  • GCP Data Engineer

    7 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 23, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    5 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 22, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 19, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    1 week ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    6 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    5 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    3 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    2 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • GCP Data Engineer

    2 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • GCP data engineer

    1 month ago

    Bengaluru, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • Senior Associate Data Engineering DE

    18 hours ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Senior Associate Data Engineering DE

    21 hours ago

    Bengaluru, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • GCP data engineer

    2 months ago

    Bengaluru, India Impetus Full time

    Qualifications: 3.5-7 years of IT experience range is preferred. The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus. Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc. Exposure to enterprise application...

  • GCP data engineer

    2 months ago

    Bengaluru, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • GCP data engineer

    2 months ago

    Bengaluru, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Coforge Full time

    Job Description Position: GCP Data Engineer Location: Bangalore Duration: Full Time MUST HAVE SKILLS: 1: Scala 2: Python 3: GCP Cloud (Big Query, Big Table, Google Cloud Storage) 4: ETL Pipelines and Data Pipelines RESPONSIBILITIES: Build data pipelines on cloud GCP Environment. Implement tasks for Automatic job...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, India Impetus Full time

    Location: Bangalore/Gurgaon 4-7 years of IT experience range is preferred. Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services. Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function. Strong experience in Big Data technologies – Hadoop,...