Data Observability Engineer for Cloud Platform
1 day ago
We are a global data science solutions provider seeking a highly skilled Data Observability Engineer with 6+ years of experience to join our team in Bangalore, Chennai, Pune, Gurgaon, or Kolkata. This role will focus on implementing data observability solutions within the Google Cloud Platform (GCP) ecosystem.
Key Responsibilities:- Data Observability Design & Implementation
- Design and deploy observability frameworks across GCP-based data pipelines, integrating tools like Google Cloud Monitoring, Google Cloud Logging, and Google Cloud Trace.
- Build dashboards and metrics using Google Cloud Monitoring to provide real-time insights into the health and performance of data assets, including BigQuery, Dataflow, and Cloud Storage.
- Monitoring & Alerting
- Implement automated monitoring and alerting solutions using Google Cloud Monitoring, setting up metrics for tracking data integrity, completeness, and latency across different stages of data pipelines.
- Configure alerts to proactively detect data anomalies and potential issues, ensuring rapid response to incidents through integrations with alerting tools like Opsgenie or PagerDuty.
- Collaboration with Data Teams
- Collaborate with data engineers and architects to incorporate Google Monitoring services at the design stage, ensuring comprehensive observability across all data assets.
- Work closely with DevOps teams to integrate monitoring and observability tools within CI/CD pipelines using Google Cloud Build and other GCP-native CI/CD tools.
- Troubleshooting & Root Cause Analysis
- Use Google Cloud Trace and Google Cloud Logging to perform in-depth troubleshooting of data incidents, identifying root causes and implementing corrective measures.
- Develop automated response workflows with Google Cloud Functions for resolving common data issues, reducing Mean Time to Resolution (MTTR).
- Data Quality & Compliance
- Implement data quality monitoring solutions using Google Cloud Monitoring and Dataform to ensure compliance with data governance frameworks (e.g., GDPR, CCPA).
- Set up data quality metrics, alerts, and dashboards to monitor and maintain data health across GCP services, ensuring data accuracy, completeness, and consistency.
- Performance Optimization
- Analyze performance metrics using Google Cloud Monitoring to identify and optimize data processing bottlenecks, enhancing speed and reliability of data flows.
Required Skills & Qualifications:- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
- 6+ years of total experience in data engineering, data observability, or data operations roles, with a focus on Google Cloud Platform (GCP).
- Extensive hands-on experience using Google Cloud Monitoring, Google Cloud Logging, and Google Cloud Trace for building observability solutions.
- Experience with GCP data services such as BigQuery, Dataflow, and Cloud Storage, and orchestration tools like Google Cloud Composer (Apache Airflow).
- Proficiency in Python, SQL, and CI/CD tools like Google Cloud Build.
- Strong problem-solving abilities, especially in troubleshooting and root cause analysis using GCP tools.
- Effective communication skills, capable of explaining technical solutions to non-technical stakeholders.
- Ability to work independently and as part of a team in a fast-paced environment.
Estimated Salary: ₹12,00,000 - ₹18,00,000 per annum
Why Tredence?
We offer a collaborative work culture with a focus on continuous learning and skill development, competitive compensation, benefits, and clear pathways for career advancement. Our clients include leading companies in retail, CPG, hi-tech Telecom, healthcare, and travel industries.
"Leader" in 2023 Forrester Wave for Customer Analytics
"Partner of the Year" in Retail and CPG by Databricks (2022 & 2023)
"Analytics Partner of the Year" by Microsoft (2022)
"50 Best Firms for Data Scientists to Work For" by AIM (2023/2022)
"Entrepreneur of the Year" in Services Business by Entrepreneur Magazine (2022)
-
Observability Platforms Leader
6 days ago
Bengaluru, Karnataka, India LinkedIn Full timeTake on the Role of Observability Platforms Leader at LinkedIn and Make a Lasting Impact$320,000 - $380,000 per annumWe are seeking an experienced Observability Platforms Leader to join our Observability Experience group. As a key member of our engineering organization, you will lead the design and implementation of large-scale observability platforms that...
-
Cloud Observability Solutions Architect
4 days ago
Bengaluru, Karnataka, India Tredence Inc. Full timeAt Tredence Inc., we are seeking a highly skilled Cloud Observability Solutions Architect to join our team. This role will focus on implementing data observability solutions within the Google Cloud Platform (GCP) ecosystem.We estimate the salary for this position to be around $140,000 per year, based on industry standards and location.Job DescriptionData...
-
Observability Platform Engineer
6 days ago
Bengaluru, Karnataka, India LinkedIn Full timeOverview:The Observability Platform Engineer is responsible for designing, developing, and deploying large-scale observability platforms that meet business needs. This position requires strong technical skills, excellent problem-solving abilities, and collaboration with cross-functional teams.Key Responsibilities:- Develop and deploy scalable,...
-
Data Observability Expert
2 days ago
Bengaluru, Karnataka, India Tredence Inc. Full timeData Observability Engineer RoleAre you an expert in Google Cloud Platform (GCP) data services? Do you have a passion for building observability solutions to ensure data quality and reliability?We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join our team at Tredence Inc., a leading global data science solutions...
-
Cloud Observability Engineer
3 weeks ago
Bengaluru, Karnataka, India Tredence Inc. Full timeWe are seeking a seasoned Cloud Observability Engineer with 10+ years of experience to join our team at Tredence Inc. as an Infrastructure Strategist.As a key member of our global data science solutions provider, you will play a pivotal role in driving our technical strategy for Cloud Observability and Google's internal planet-scale time series database.This...
-
Data Observability Solutions Architect
4 days ago
Bengaluru, Karnataka, India Tredence Inc. Full timeWe are seeking an experienced Data Observability Solutions Architect to join our team at Tredence Inc.About the RoleThis is a hybrid role based in major cities across India, including Bangalore, Chennai, Pune, Gurgaon, and Kolkata. The successful candidate will have 6+ years of experience in data engineering, data observability, or data operations roles with...
-
Bengaluru, Karnataka, India Tredence Inc. Full timeRole Overview:We are seeking a highly skilled Cloud Observability Engineer to join our team at Tredence Inc. in India. As a key member of our engineering team, you will be responsible for designing, developing, and managing scalable and secure cloud infrastructure on Google Cloud Platform (GCP).About the Role:You will lead the overall technical strategy for...
-
Bengaluru, Karnataka, India LinkedIn Full time**Job Overview**LinkedIn is a leading professional network that aims to help members of all backgrounds and experiences achieve their career goals. Our vision is to create economic opportunities for every member of the global workforce.As a key member of our software engineering team, you will play a crucial role in building next-generation observability...
-
Senior Distributed Systems Engineer
6 days ago
Bengaluru, Karnataka, India LinkedIn Full timeCompany OverviewL' is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers. Our vision is to create economic opportunity for every member of the global workforce. Every day our members use our products to make connections, discover opportunities, build skills and gain...
-
Cloud Observability Solutions Architect
6 days ago
Bengaluru, Karnataka, India Warner Bros. Discovery Full timeWe're looking for an experienced Cloud Observability Solutions Architect to join our team at Warner Bros. Discovery. This key role will play a vital part in shaping our operational data strategy and driving innovation in our technical ecosystem.About Our Team:Our team is passionate about leveraging technology to deliver exceptional experiences for our...
-
Bengaluru, Karnataka, India LinkedIn Full timeWe are seeking a highly skilled and experienced Sr. Staff Software Engineer for Systems Infrastructure to join our team at LinkedIn. As a member of our engineering organization, you will have the opportunity to build the next generation of observability platforms, working closely with our development teams to ensure consistent and comprehensive...
-
Observability Platforms Specialist
6 days ago
Bengaluru, Karnataka, India LinkedIn Full timeAbout Our TeamOur Observability Engineering team is responsible for billions of operational metrics ingested every minute within LinkedIn. We maintain the platforms and products for metrics ingestion, storage, retrieval, visualization, alerting, incident creation & escalation, remediation, health-checking and experience platform.We are one of the very few...
-
Software Engineer
2 weeks ago
Bengaluru, Karnataka, India LinkedIn Full timeAbout the RoleWe are seeking a highly skilled Software Engineer to join our Observability Platforms team at LinkedIn. As a member of this team, you will play a key role in designing and building the next-generation observability platforms for LinkedIn, including instrumenting applications and infrastructure to collect meaningful metrics, logs, and traces.Key...
-
Bengaluru, Karnataka, India LinkedIn Full timeWe are looking for a highly skilled and experienced Observability Platform Architect to join our team at LinkedIn. Our company is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers.OverviewWe believe amazing things happen when we work together in an environment where everyone feels...
-
Cloud Data Platform Engineer
4 weeks ago
Bengaluru, Karnataka, India Guidewire Full timeJob DescriptionWe are seeking an experienced Cloud Data Platform Engineer to join our team at Guidewire. This role is responsible for designing, developing, and running cloud-native data platforms and analytics SaaS services.
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India DP World Australia Full timeJob Title: Data Engineer - Cloud PlatformsAbout the RoleWe are seeking an experienced Data Engineer to join our team in DP World Australia. As a key member of our data support team, you will be responsible for designing, building, and maintaining large-scale data systems on cloud platforms.Main Responsibilities* Design and implement data pipelines using...
-
Data Engineer for Cloud Data Platforms
3 weeks ago
Bengaluru, Karnataka, India Mercedes-Benz Full timeData Engineer - Cloud Data PlatformAt Mercedes-Benz, we're looking for a highly skilled Data Engineer to join our team and play a key role in shaping the future of our cloud data platforms.About the RoleThis is an exciting opportunity to work with cutting-edge technologies such as Azure Databricks, Python, Scala, and SQL. As a Data Engineer, you'll design,...
-
Highly Skilled Observability Engineer
3 weeks ago
Bengaluru, Karnataka, India LinkedIn Full timeRole Overview:The position of Highly Skilled Observability Engineer at LinkedIn offers a unique opportunity to join our world-class software engineering team in Bangalore, India. As part of this team, you will be responsible for building the next-generation observability platforms, including instrumenting applications and infrastructure to collect meaningful...
-
Bengaluru, Karnataka, India HEVO DATA Full timeUnlock Career Growth as a Data Engineering LeadWe're seeking an exceptional Data Engineering Lead to join our team at Hevo Data. In this role, you'll have the opportunity to own and build scalable platform services that support thousands of customers' data pipelines and ensure load data reliability to cloud warehouses.The Hevo platform core services will...
-
Cloud Native Platform Engineer
4 weeks ago
Bengaluru, Karnataka, India Nike Full time**About Us**Nike is a technology company that revolutionizes the future at the confluence of tech and sport. We invest in advances in technology, employ creative people, and give them the support to constantly innovate, iterate, and serve consumers more directly and personally.We are looking for a highly skilled Cloud Native Platform Engineer who excels in...