Data Platform Engineer
13 hours ago
Role : Data Platform Engineer (GCP Focus)
Key Responsibilities
Data Pipeline Automation & Engineering
- Design, build, and automate scalable, production-grade data pipelines on GCP using core services such as Cloud Composer (Airflow), Dataflow (Apache Beam), and BigQuery.
- Develop and implement continuous integration and continuous deployment (CI/CD) workflows for data processing and analytics pipelines using tools like Cloud Build, GitHub Actions, or Jenkins.
- Implement reusable data frameworks, templates, and libraries to standardize pipeline deployments, configuration management, and promote "Infrastructure as Code" principles.
- Orchestrate complex, multi-stage ETL/ELT pipelines across diverse data sources and environments, ensuring efficient resource utilization and low latency.
Data Quality, Testing & Reliability
- Implement and manage automated data validation, schema checks, and anomaly detection using industry-leading tools like Great Expectations, dbt tests, or custom Python frameworks.
- Integrate quality gates directly into CI/CD workflows to ensure early issue detection and continuously improve overall data reliability (Data Reliability Engineering - DRE principles).
- Schedule, monitor, and optimize data workflows, ensuring strict adherence to data delivery SLAs.
Monitoring & Observability
- Set up and maintain proactive monitoring, logging, and automated alerting for all data pipelines and platform components using Stackdriver (Cloud Monitoring & Logging), Prometheus, or Grafana.
- Develop and maintain comprehensive dashboards to track critical metrics, including data health, SLA adherence, and pipeline operational performance.
Data Governance & Metadata Management
- Integrate and manage data assets, schemas, and metadata within Google Data Catalog or equivalent metadata management platforms.
- Enforce robust governance policies, including data lineage tracking, strict access control (IAM), and compliance standards for sensitive data.
Required Skills & Experience
- 5+ years of professional experience in data engineering, data platform operations, or a similar cloud-native technical role.
- Strong expertise in the Google Cloud Platform (GCP) data stack: BigQuery, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, and Cloud Build.
- High proficiency in Python, SQL, and general automation scripting.
- Hands-on experience with CI/CD principles and tools, including GitOps and Infrastructure as Code (IaC) using Terraform or Cloud Deployment Manager.
- Proven experience with data quality and testing frameworks such as Great Expectations, dbt, or PyTest.
- Working knowledge of observability, logging, and monitoring frameworks for high-volume data systems.
- Familiarity with metadata management, data lineage tools, and establishing data governance policies.
Qualifications
Graduate
Range of Year Experience-Min Year
5
Range of Year Experience-Max Year
8
-
Senior Software Engineer, Platform
14 hours ago
Bengaluru, Karnataka, India vaga para Senior Software Engineer, Platform na Headout Full time ₹ 12,00,000 - ₹ 24,00,000 per yearWhy Headout?We're a rocketship: 9-figure revenue, record growth, and profitableWith $130M in revenue, guests in 100+ cities, and 18 months of profitability, Headout is the fastest-growing marketplace in the travel industry, and we're just getting started. We've raised $60M+ from top-tier investors and are building a durable company for the long term —...
-
Platform Engineer
4 days ago
Bengaluru, Karnataka, India Hevo Data Full time ₹ 10,00,000 - ₹ 20,00,000 per yearAbout Hevo:At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes.There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Data Platform Engineer
6 days ago
Bengaluru, Karnataka, India Grizmo Labs 🌐 Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWhat you'll do:• Design, build, and maintain scalable data platforms and pipelines to support the needs of the business• Ensure data quality and accuracy by implementing data validation and testing processes• Participate in code reviews and provide feedback to improve code quality and adherence to best practices• Work closely with DevOps to ensure...
-
Security Platform Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Security...
-
IT Data Platform Engineer
6 days ago
Bengaluru, Karnataka, India Palo Alto Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany Description Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and...
-
Senior Data Engineer cum Data Scientist
6 days ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...
-
Lead DataOps Engineer
2 weeks ago
Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout us:FirstHive is a USA headquartered company with operations and customers across the US, India, and ASEAN and is a premier global Customer Data Platform - a tool for consumer marketing enterprises to consolidate all their opt-in first-party consumer data.We are building an AI led marketing tech product that is changing the fabric of marketing globally...
-
Data Engineer
5 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...
-
Manager, Data Platform Engineering
7 days ago
Bengaluru, Karnataka, India Eventbrite Full time ₹ 12,00,000 - ₹ 36,00,000 per yearTHE CHALLENGEEventbrite operates one of the world's largest data ecosystems for live events, supporting millions of events and hundreds of millions of transactions annually across 170+ countries. The Data Platform Engineering team's mission is to build the foundational infrastructure, tooling, and data services that enable high-quality analytics, operational...