FirstHive - Lead DataOps Engineer - ETL/ELT Pipelines

1 week ago

Bengaluru, India FirstHive Full time

Job Designation : Senior Data Ops Engineer Team LeadJob Location : BengaluruKey Responsibilities :Leadership & Team Management :- Lead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.- Plan, assign, and review team tasks to ensure timely and quality delivery.- Collaborate with data engineers, data scientists, and business teams to prioritize data needs and ensure alignment with organizational goals.- Drive best practices in coding standards, documentation, and deployment automation.Technical Delivery :- Design and implement scalable ETL/ELT pipelines using Pentaho, StreamSets, and Python-based frameworks.- Manage real-time and batch data ingestion using Kafka for streaming and MySQL/Snowflake for storage and transformation.- Implement and maintain data quality checks, validation, and reconciliation frameworks.- Ensure pipeline observability, error handling, and alerting mechanisms for proactive issue resolution.- Optimize Snowflake and MySQL queries for performance and cost efficiency.- Lead migration or modernization initiatives (e.g., on-prem to Snowflake/cloud).Governance & Operations :- Maintain data security, access control, and compliance with enterprise standards.- Define and track DataOps KPIs such as pipeline success rates, latency, and data quality metrics.- Partner with Infrastructure and DevOps teams for seamless environment management and scalability.Technical Skills Required :Databases :- Strong expertise in MySQL (query optimization, stored procedures, schema design).- Advanced knowledge of Snowflake (data modelling, performance tuning, cost optimization).ETL & Data Pipeline Tools :- Hands-on experience with Pentaho Data Integration (Kettle) and/or StreamSets for ETL/ELT automation.Streaming :- In-depth understanding of Apache Kafka (topic configuration, producer/consumer setup, schema registry, stream processing).Programming :- Proficient in Python for data automation, transformation scripts, and integration with APIs.Monitoring & Observability :- Familiarity with Grafana, Prometheus, or similar tools for performance and error tracking.Cloud :- Exposure to AWS/Azure/GCP data stack (S3, Lambda, Glue, Dataflow, etc.). (ref:hirist.tech)

  • FirstHive - Lead DataOps Engineer - ETL/ELT Pipelines

    1 week ago

    Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 2,00,00,000 - ₹ 4,00,00,000 per year

    Job Designation :Senior Data Ops Engineer Team LeadJob Location :BengaluruKey ResponsibilitiesLeadership & Team Management :Lead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.Plan, assign, and review team tasks to ensure timely and quality delivery.Collaborate with data engineers, data scientists, and business...

  • Lead DataOps Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About us:FirstHive is a USA headquartered company with operations and customers across the US, India, and ASEAN and is a premier global Customer Data Platform - a tool for consumer marketing enterprises to consolidate all their opt-in first-party consumer data.We are building an AI led marketing tech product that is changing the fabric of marketing globally...

  • Lead Data Ops Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive Full time ₹ 12,00,000 - ₹ 20,00,000 per year

    About Us:FirstHive is a USA headquartered company with operations and customers across the US, India, and ASEAN and is a premier global Customer Data Platform - a tool for consumer marketing enterprises to consolidate all their opt-in first-party consumer data.We are building an AI led marketing tech product that is changing the fabric of marketing globally...

  • AWS Data Engineer

    6 days ago

    Bengaluru, India Xpheno Full time

    Job Overview :We are seeking an experienced Data Engineer with strong hands-on expertise in AWS data services, PySpark, Databricks, and orchestration tools. The ideal candidate will be responsible for building, optimizing, and maintaining scalable ETL/ELT pipelines to support our data analytics, reporting, and business intelligence needs. This role requires...

  • Lead Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India 5c292c78-aa36-42b5-b9a3-4c26cc408f73 Full time ₹ 19,00,000 - ₹ 20,00,000 per year

    Job Designation: Senior Data Ops Engineer – Team LeadJob Location: BengaluruKey Responsibilities:Leadership & Team ManagementLead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.Plan, assign, and review team tasks to ensure timely and quality delivery.Collaborate with data engineers, data scientists, and business...

  • ETL Architect

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Position- ETL ArchitectLocation- Bengaluru, chennaiExperience- 8 to 11 YearsNotice period- 0 to 6 o Days or Serving NPJob Description6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices.6+ years Data Warehouse/Data Lake Architecture and...

  • ETL Architect

    1 day ago

    Bengaluru, India Tata Consultancy Services Full time

    Position- ETL ArchitectLocation- Bengaluru, chennaiExperience- 8 to 11 YearsNotice period- 0 to 6 o Days or Serving NPJob Description- 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices.- 6+ years Data Warehouse/Data Lake Architecture and...

  • ETL Architect

    18 hours ago

    Bengaluru, India Tata Consultancy Services Full time

    Position- ETL ArchitectLocation- Bengaluru, chennaiExperience- 8 to 11 YearsNotice period- 0 to 6 o Days or Serving NPJob Description- 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices.- 6+ years Data Warehouse/Data Lake Architecture and...

  • FirstHive - DevOps Engineer - Cloud Infrastructure

    2 weeks ago

    Bengaluru, India FirstHive Full time

    Job Designation : DevOps EngineerJob Location : BangaloreKey Responsibilities :- Manage and maintain cloud infrastructure (preferably AWS/Azure) including networking (VPC, VPN, NAT, routing).- Administer and monitor Kubernetes clusters (EKS/AKS), ensuring high availability and security.- Implement infrastructure automation using Terraform or equivalent IAC...

  • Growth Sales Executive

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About us:FirstHive, is a Customer Data Platform (CDP) that delivers a disproportionate jump in Marketing ROI for consumer marketing companies. We are the world's first CDP to use Machine Learning to build Unified Customer Identities by ingesting data from across all sources of customer interactions and customer transactions (viz. ERP, CRM, Website, Social,...