GCP data Engineer

3 hours ago

Bangalore Urban Karnataka India, IN Impetus Full time

Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.

Responsibilities

  • Must have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).
  • Should be aware with columnar database e.g parquet, ORC etc.
  • Visualize and evangelize next generation infrastructure in Cloud platform/Big Data space (Batch, Near Real-time, Real-time technologies).
  • Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms.
  • Developing and implementing an overall organizational data strategy that is in line with business processes. The strategy includes data model designs, database development standards, implementation and management of data warehouses and data analytics systems.
  • Expert-level proficiency in at-least 4-5 GCP services.
  • Experience with technical solutions based on industry standards using GCP - IaaS, PaaS and SaaS capabilities.
  • Strong understanding and experience in distributed computing frameworks, particularly.
  • Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.

Qualifications

7-10 years of experience in the role of implementation of high end software products

Required Skills

  • Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).
  • Expert-level proficiency in at-least 4-5 GCP services.
  • Strong understanding and experience in distributed computing frameworks.
  • Experience working within a Linux computing environment.
  • Should be aware with columnar database e.g parquet, ORC etc.
  • Experience with technical solutions based on industry standards using GCP - IaaS, PaaS and SaaS capabilities.

  • GCP Data Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Job Title: GCP Data EngineerLocation: BengaluruExperience: 3-8 yearsAbout the Role:Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark/Spark to transform, clean, aggregate and prepare data for analytics/ML.Orchestrate workflows using Cloud Composer (Airflow) to schedule,...

  • GCP Lead Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Qualifications8-11 years of IT experience range is preferred.BE/B.Tech/MCA/MS-IT/M.Tech or any other Engineering degrees in related fieldsThe candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 4-5 Years of exp in Big Data technologies including,...

  • Senior Data Engineer

    2 hours ago

    Bangalore Urban district, India, IN AuxoAI Full time

    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior...

  • AI Data Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Job Title: AI Data EngineerExp- 4 to 8 yearsLocation- PAN IndiaJob DescriptionKey Responsibilities:• Build and maintain data infrastructure: Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud.• Ensure data quality: Clean, transform, and enrich raw data to create "business truth" that AI models can use for...

  • Senior Data Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • GCP data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN Impetus Full time

    Location: Gurgaon and BangaloreExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesJob Descriptions for Big data or Cloud EngineerWe are looking for candidates with hands on experience in pyspark with GCP cloud.Qualifications3-10 years of IT experience range is preferred.Able to effectively use GCP managed...

  • Lead GCP Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: GurgaonExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • GCP Data Engineer

    3 hours ago

    , India, IN HCLTech Full time

    Looking for 5+ Years of experiencenotice period- immediate to 60 daysSkill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow

  • Engineering Manager

    2 hours ago

    Bangalore Urban, Karnataka, India, IN HiLabs Full time

    We are looking for an experienced Data Engineering Manager to lead and scale our data engineering function. The ideal candidate will be responsible for designing, building, and maintaining high-quality data pipelines and platforms that support analytics, reporting, and data-driven decision-making across the organization. This role involves leading a team of...

  • Freelance Apache NiFi GCP Data Engineer

    3 hours ago

    india, IN ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cybersecurity company specializing in protecting businesses and organizations from cyber threats. We offer services including cloud security, web and mobile security testing, DevSecOps, and cloud security assessments to deliver customized, affordable solutions tailored to client needs. Committed to proactive...