Data Platform Engineer

4 days ago

Bengaluru, Karnataka, India infinite Computer Solution Full time

Role : Data Platform Engineer (GCP Focus)

Key Responsibilities

Data Pipeline Automation & Engineering

  • Design, build, and automate scalable, production-grade data pipelines on GCP using core services such as Cloud Composer (Airflow), Dataflow (Apache Beam), and BigQuery.
  • Develop and implement continuous integration and continuous deployment (CI/CD) workflows for data processing and analytics pipelines using tools like Cloud Build, GitHub Actions, or Jenkins.
  • Implement reusable data frameworks, templates, and libraries to standardize pipeline deployments, configuration management, and promote "Infrastructure as Code" principles.
  • Orchestrate complex, multi-stage ETL/ELT pipelines across diverse data sources and environments, ensuring efficient resource utilization and low latency.

Data Quality, Testing & Reliability

  • Implement and manage automated data validation, schema checks, and anomaly detection using industry-leading tools like Great Expectations, dbt tests, or custom Python frameworks.
  • Integrate quality gates directly into CI/CD workflows to ensure early issue detection and continuously improve overall data reliability (Data Reliability Engineering - DRE principles).
  • Schedule, monitor, and optimize data workflows, ensuring strict adherence to data delivery SLAs.

Monitoring & Observability

  • Set up and maintain proactive monitoring, logging, and automated alerting for all data pipelines and platform components using Stackdriver (Cloud Monitoring & Logging), Prometheus, or Grafana.
  • Develop and maintain comprehensive dashboards to track critical metrics, including data health, SLA adherence, and pipeline operational performance.

Data Governance & Metadata Management

  • Integrate and manage data assets, schemas, and metadata within Google Data Catalog or equivalent metadata management platforms.
  • Enforce robust governance policies, including data lineage tracking, strict access control (IAM), and compliance standards for sensitive data.

Required Skills & Experience

  • 5+ years of professional experience in data engineering, data platform operations, or a similar cloud-native technical role.
  • Strong expertise in the Google Cloud Platform (GCP) data stack: BigQuery, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, and Cloud Build.
  • High proficiency in Python, SQL, and general automation scripting.
  • Hands-on experience with CI/CD principles and tools, including GitOps and Infrastructure as Code (IaC) using Terraform or Cloud Deployment Manager.
  • Proven experience with data quality and testing frameworks such as Great Expectations, dbt, or PyTest.
  • Working knowledge of observability, logging, and monitoring frameworks for high-volume data systems.
  • Familiarity with metadata management, data lineage tools, and establishing data governance policies.

Qualifications

Graduate

Range of Year Experience-Min Year

5

Range of Year Experience-Max Year

8

  • Platform Engineer

    7 days ago

    Bengaluru, Karnataka, India Hevo Data Full time

    About Hevo:At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes.There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Data Platform/Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India QAIN-Finity Full time

    About the RoleWe are seeking an ambitious and experiencedData Platform/Platform Engineerto join our team in Bangalore. This role is ideal for a hands-on engineer with 2-4 years of experience who possesses a strong foundation in core software engineering, a"Data + Infra"hybrid mindset, and the drive to thrive in a fast-paced, autonomous environment. You will...

  • Platform Engineer III

    8 hours ago

    Bengaluru, Karnataka, India Hevo Data Full time

    About Hevo: At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes.  There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Security Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Security...

  • Senior Data Engineer

    12 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Data Engineering

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID: 345813NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineering & Analytics Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role: Own the...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...

  • Data Engineering

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Define data-first architecture, standards, and blueprints across ingestion, cleansing, enrichment, modeling, and serving layers. Lead design of batch and streaming pipelines (e.g., Informatica, Spark, AWS Glue, Azure Data Factory/Databricks); choose fit-for-purpose storage/compute. Establish semantic/serving models and integration patterns for Power BI,...

  • Senior Security Platform Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Staff Engineer, Data Platforms

    2 days ago

    Bengaluru, Karnataka, India Wayfair Full time

    Staff Engineer - Data Platforms- Software EngineeringWho we areWayfair is seeking a passionate and driven Staff Engineer to join our "Data Platforms" team. In this pivotal role, you will be instrumental in shaping and executing Wayfair's New-Age Data Platform strategy across large-scale Data Ingestion, Transformation, Real-time Messaging Platforms and Data...