Gcp data quality observability engineer

2 weeks ago

Bangalore, India Tredence Inc. Full time

Role - GCP Dev Ops Observability Engineer Overall Experience:8 + years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), Dev Ops, Terraform, Python We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join our team. This role will focus on implementing data observability solutions within the Google Cloud Platform (GCP) ecosystem. You will be responsible for ensuring the reliability, performance, and quality of data pipelines using Google Monitoring services and other GCP-native tools. Key Responsibilities: Data Observability Design & Implementation Design and deploy observability frameworks across GCP-based data pipelines, integrating tools like Google Cloud Monitoring , Google Cloud Logging , and Google Cloud Trace . Build dashboards and metrics using Google Cloud Monitoring to provide real-time insights into the health and performance of data assets, including Big Query, Dataflow, and Cloud Storage. Monitoring & Alerting Implement automated monitoring and alerting solutions using Google Cloud Monitoring , setting up metrics for tracking data integrity, completeness, and latency across different stages of data pipelines. Configure alerts to proactively detect data anomalies and potential issues, ensuring rapid response to incidents through integrations with alerting tools like Opsgenie or Pager Duty . Collaboration with Data Teams Collaborate with data engineers and architects to incorporate Google Monitoring services at the design stage, ensuring comprehensive observability across all data assets. Work closely with Dev Ops teams to integrate monitoring and observability tools within CI/CD pipelines using Google Cloud Build and other GCP-native CI/CD tools. Troubleshooting & Root Cause Analysis Use Google Cloud Trace and Google Cloud Logging to perform in-depth troubleshooting of data incidents, identifying root causes and implementing corrective measures. Develop automated response workflows with Google Cloud Functions for resolving common data issues, reducing Mean Time to Resolution (MTTR). Data Quality & Compliance Implement data quality monitoring solutions using Google Cloud Monitoring and Dataform to ensure compliance with data governance frameworks (e.g., GDPR, CCPA). Set up data quality metrics, alerts, and dashboards to monitor and maintain data health across GCP services, ensuring data accuracy, completeness, and consistency. Performance Optimization Analyze performance metrics using Google Cloud Monitoring to identify and optimize data processing bottlenecks, enhancing speed and reliability of data flows. Required Skills & Qualifications: Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field. Experience: 6+ years of total experience in data engineering, data observability, or data operations roles, with a focus on Google Cloud Platform (GCP). Extensive hands-on experience using Google Cloud Monitoring , Google Cloud Logging , and Google Cloud Trace for building observability solutions. Experience with GCP data services such as Big Query, Dataflow, and Cloud Storage, and orchestration tools like Google Cloud Composer (Apache Airflow). Technical Skills: Proficiency in Python, SQL, and CI/CD tools like Google Cloud Build . Soft Skills: Strong problem-solving abilities, especially in troubleshooting and root cause analysis using GCP tools. Effective communication skills, capable of explaining technical solutions to non-technical stakeholders. Ability to work independently and as part of a team in a fast-paced environment. Why Join Us? Opportunity to work with cutting-edge Google Cloud technologies in data observability. Collaborative work culture with a focus on continuous learning and skill development. Competitive compensation, benefits, and clear pathways for career advancement. We are a global data science solutions provider focused on solving the last mile problem in AI, we have 2000+ strong active employees with offices in San Jose, Foster City, Chicago, Toronto, and Bangalore with largest companies in retail, CPG, hi-tech Telecom, healthcare, travel industries as clients. Why Join Us? Tredence is 2023 Great Place to Work-Certified by GPTW ‘Leader’ in 2023 Forrester Wave for Customer Analytics Recognized by Databricks as the ‘2022 & 2023 Partner of the Year’ in Retail and CPG Recognized by Microsoft as the ‘2022 Analytics Partner of the Year’ One of the 50 Best Firms for Data Scientists to Work For – 2023/2022 according to AIM Recognized by Entrepreneur Magazine as ‘2022 Entrepreneur of the Year’ in the Services Business

  • GCP Data Quality Observability Engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability Engineer Overall Experience:8 + years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, Python We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join...

  • Gcp data quality observability engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP Dev Ops Observability Engineer Overall Experience: 10+ years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), Dev Ops, Terraform, Python Roles and Responsibilities Lead the overall technical strategy for Cloud Observability...

  • Tredence Inc. | GCP Data Quality Observability Engineer

    2 weeks ago

    bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability EngineerOverall Experience:8+ yearsRelevant: 3+ yearsHybrid role from Bangalore, Chennai, Pune, Gurgaon, KolkataRequired Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, PythonWe are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join our team. This role will...

  • Tredence Inc. | GCP DevOps Observability Engineer | bangalore

    1 month ago

    bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability EngineerOverall Experience: 10+ yearsRelevant: 3+ yearsHybrid role from Bangalore, Chennai, Pune, Gurgaon, KolkataRequired Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, PythonRoles and ResponsibilitiesLead the overall technical strategy for Cloud Observability (e.g., Cloud Logging,...

  • Tredence Inc. | GCP DevOps Observability Engineer | bangalore

    1 month ago

    bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability EngineerOverall Experience:10+ yearsRelevant: 3+ yearsHybrid role from Bangalore, Chennai, Pune, Gurgaon, KolkataRequired Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, PythonRoles and ResponsibilitiesLead the overall technical strategy for Cloud Observability (e.g., Cloud Logging, Monitoring,...

  • Tredence Inc. | GCP DevOps Observability Engineer | bangalore

    1 month ago

    bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability Engineer Overall Experience: 10+ years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, Python Roles and Responsibilities Lead the overall technical strategy for Cloud Observability (e.g., Cloud Logging,...

  • Gcp data engineer

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore / Pune/ Chennai / Mumbai Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and...

  • GCP Data Engineer

    2 months ago

    bangalore, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • GCP Data Engineer

    2 months ago

    bangalore, India Tech Mahindra Full time

    Responsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...

  • Gcp data engineer

    3 weeks ago

    Bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: Big Query Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query. Analyze query performance and implement...

  • GCP Data Engineer

    2 months ago

    Bangalore Metropolitan Area, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • Splunk observability developer

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Role: Splunk developer Required Technical Skill Set: Splunk cloud experience Desired Experience Range: 8 to 10years Location of Requirement: Bangalore Desired Competencies (Technical/Behavioral Competency): Must-Have: Splunk architecture and components Experience on both Splunk On Premises and Cloud Splunk versions Hands on Splunk...

  • Splunk Observability developer

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!Role: Splunk Observability developerRequired Technical Skill Set: Splunk cloud Observability experienceDesired Experience: 6-10 yearsLocation: BengaluruMust-Have**Splunk Observability APM (application Performance Monitoring) , RUM (Realtime user monitoring) onboardingSplunk Cloud developer and admin skillsUnderstanding of Observability...

  • Splunk Observability Developer

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Role: Splunk developerRequired Technical Skill Set: Splunk cloud experienceDesired Experience Range: 8 to 10yearsLocation of Requirement: BangaloreDesired Competencies (Technical/Behavioral Competency):Must-Have:Splunk architecture and componentsExperience on both Splunk On Premises and Cloud Splunk versionsHands on Splunk Observability(certification...

  • Splunk Observability developer

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!Role: Splunk Observability developerRequired Technical Skill Set: Splunk cloud Observability experience Desired Experience: 6-10 years Location: BengaluruMust-Have**Splunk Observability APM (application Performance Monitoring) , RUM (Realtime user monitoring) onboardingSplunk Cloud developer and admin skillsUnderstanding of Observability...

  • Splunk Observability developer

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! Role: Splunk Observability developer Required Technical Skill Set: Splunk cloud Observability experience Desired Experience: 6-10 years Location: Bengaluru Must-Have** Splunk Observability APM (application Performance Monitoring) , RUM (Realtime user monitoring) onboarding Splunk Cloud developer and admin skills Understanding of...

  • Deloitte | GCP Data Engineer | bangalore

    1 month ago

    bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation...

  • Principal Data Engineer

    4 weeks ago

    Bangalore, India Rock interviews Full time

    What We Are Looking For : As a Principal Data Engineer, you will take ownership of the ideation, architecture, design, and development of our enterprise data platform. You will play a key role in collaborating with cloud and security architects to ensure a seamless integration within our broader technology strategy. We are looking for someone with a passion...

  • Deloitte | GCP Data Engineer | bangalore

    1 month ago

    bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: BigQuery Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery. Analyze query performance and implement optimization...