Sr Data Platform Engineer

7 days ago

Bengaluru, Karnataka, India infinite Computer Solution Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role : Senior Data Platform Engineer (GCP Focus)

Key Responsibilities

Data Pipeline Automation & Engineering

  • Design, build, and automate scalable, production-grade data pipelines on GCP using core services such as Cloud Composer (Airflow), Dataflow (Apache Beam), and BigQuery.
  • Develop and implement continuous integration and continuous deployment (CI/CD) workflows for data processing and analytics pipelines using tools like Cloud Build, GitHub Actions, or Jenkins.
  • Implement reusable data frameworks, templates, and libraries to standardize pipeline deployments, configuration management, and promote "Infrastructure as Code" principles.
  • Orchestrate complex, multi-stage ETL/ELT pipelines across diverse data sources and environments, ensuring efficient resource utilization and low latency.

Data Quality, Testing & Reliability

  • Implement and manage automated data validation, schema checks, and anomaly detection using industry-leading tools like Great Expectations, dbt tests, or custom Python frameworks.
  • Integrate quality gates directly into CI/CD workflows to ensure early issue detection and continuously improve overall data reliability (Data Reliability Engineering - DRE principles).
  • Schedule, monitor, and optimize data workflows, ensuring strict adherence to data delivery SLAs.

Monitoring & Observability

  • Set up and maintain proactive monitoring, logging, and automated alerting for all data pipelines and platform components using Stackdriver (Cloud Monitoring & Logging), Prometheus, or Grafana.
  • Develop and maintain comprehensive dashboards to track critical metrics, including data health, SLA adherence, and pipeline operational performance.

Data Governance & Metadata Management

  • Integrate and manage data assets, schemas, and metadata within Google Data Catalog or equivalent metadata management platforms.
  • Enforce robust governance policies, including data lineage tracking, strict access control (IAM), and compliance standards for sensitive data.

Required Skills & Experience

  • 5+ years of professional experience in data engineering, data platform operations, or a similar cloud-native technical role.
  • Strong expertise in the Google Cloud Platform (GCP) data stack: BigQuery, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, and Cloud Build.
  • High proficiency in Python, SQL, and general automation scripting.
  • Hands-on experience with CI/CD principles and tools, including GitOps and Infrastructure as Code (IaC) using Terraform or Cloud Deployment Manager.
  • Proven experience with data quality and testing frameworks such as Great Expectations, dbt, or PyTest.
  • Working knowledge of observability, logging, and monitoring frameworks for high-volume data systems.
  • Familiarity with metadata management, data lineage tools, and establishing data governance policies.

Qualifications

Graduate

Range of Year Experience-Min Year

8

Range of Year Experience-Max Year

12

  • AWS Sr Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Sr. Data Science

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Job Title: Data Science & AIML, GenAI Lead/EngineerKey Responsibilities: Develop and implement traditional machine learning algorithms. Deploy at least one model in a production environment. Write and maintain Python...

  • Sr. Data Engineer Data Science

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Sr. Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Sr. Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Sr. Data Engineer Digital Surgery Platform

    2 weeks ago

    Bengaluru, Karnataka, India Johnson & Johnson Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Sr. Data Engineer Digital Surgery Platform (DSP)At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where sophisticated diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and...

  • Sr Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Nam Info Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Dear Candidate,Hope you are doing well.Greeting from NAM Info INC.NAM Info Inc. is a technology-forward talent management organization dedicated to bridging the gap between industry leaders and exceptional human resources. They pride themselves on delivering quality candidates, deep industry coverage, and knowledge-based training for consultants. Their...

  • Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Hevo Data Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    About Hevo:At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes.There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Sr Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...

  • Sr. Data Science

    4 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Job...