FirstHive - Lead DataOps Engineer - ETL/ELT Pipelines
4 days ago
Job Designation :
Senior Data Ops Engineer Team Lead
Job Location :
Bengaluru
Key Responsibilities
Leadership & Team Management :
- Lead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.
- Plan, assign, and review team tasks to ensure timely and quality delivery.
- Collaborate with data engineers, data scientists, and business teams to prioritize data needs and ensure alignment with organizational goals.
- Drive best practices in coding standards, documentation, and deployment automation.
Technical Delivery
- Design and implement scalable ETL/ELT pipelines using Pentaho, StreamSets, and Python-based frameworks.
- Manage real-time and batch data ingestion using Kafka for streaming and MySQL/Snowflake for storage and transformation.
- Implement and maintain data quality checks, validation, and reconciliation frameworks.
- Ensure pipeline observability, error handling, and alerting mechanisms for proactive issue resolution.
- Optimize Snowflake and MySQL queries for performance and cost efficiency.
- Lead migration or modernization initiatives (e.g., on-prem to Snowflake/cloud).
Governance & Operations
- Maintain data security, access control, and compliance with enterprise standards.
- Define and track DataOps KPIs such as pipeline success rates, latency, and data quality metrics.
- Partner with Infrastructure and DevOps teams for seamless environment management and scalability.
Databases
Technical Skills Required :
- Strong expertise in MySQL (query optimization, stored procedures, schema design).
- Advanced knowledge of Snowflake (data modelling, performance tuning, cost optimization).
ETL & Data Pipeline Tools
- Hands-on experience with Pentaho Data Integration (Kettle) and/or StreamSets for ETL/ELT automation.
Streaming
- In-depth understanding of Apache Kafka (topic configuration, producer/consumer setup, schema registry, stream processing).
Programming
- Proficient in Python for data automation, transformation scripts, and integration with APIs.
Monitoring & Observability
- Familiarity with Grafana, Prometheus, or similar tools for performance and error tracking.
Cloud
- Exposure to AWS/Azure/GCP data stack (S3, Lambda, Glue, Dataflow, etc.).
)
-
Lead DataOps Engineer
6 days ago
Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout us:FirstHive is a USA headquartered company with operations and customers across the US, India, and ASEAN and is a premier global Customer Data Platform - a tool for consumer marketing enterprises to consolidate all their opt-in first-party consumer data.We are building an AI led marketing tech product that is changing the fabric of marketing globally...
-
Lead Data Ops Engineer
6 days ago
Bengaluru, Karnataka, India FirstHive Full time ₹ 12,00,000 - ₹ 20,00,000 per yearAbout Us:FirstHive is a USA headquartered company with operations and customers across the US, India, and ASEAN and is a premier global Customer Data Platform - a tool for consumer marketing enterprises to consolidate all their opt-in first-party consumer data.We are building an AI led marketing tech product that is changing the fabric of marketing globally...
-
Dataops Engineer or database administration
2 weeks ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 1,20,000 - ₹ 6,00,000 per yearJob descriptionWe are looking for a talented individual with minimum 5 years of experience to join a team of passionate and highly-skilled technology professionals in creating leading customer-centric software for the energy and finance sector.Roles & Responsibilities-Building and optimizing data pipelines to facilitate the extraction of data from multiple...
-
Lead Data Engineer
6 days ago
Bengaluru, Karnataka, India 5c292c78-aa36-42b5-b9a3-4c26cc408f73 Full time ₹ 19,00,000 - ₹ 20,00,000 per yearJob Designation: Senior Data Ops Engineer – Team LeadJob Location: BengaluruKey Responsibilities:Leadership & Team ManagementLead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.Plan, assign, and review team tasks to ensure timely and quality delivery.Collaborate with data engineers, data scientists, and business...
-
Growth Sales Executive
1 week ago
Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout us:FirstHive, is a Customer Data Platform (CDP) that delivers a disproportionate jump in Marketing ROI for consumer marketing companies. We are the world's first CDP to use Machine Learning to build Unified Customer Identities by ingesting data from across all sources of customer interactions and customer transactions (viz. ERP, CRM, Website, Social,...
-
Senior DataOps Engineer
2 days ago
Bengaluru, Karnataka, India Terralogic Full time ₹ 8,00,000 - ₹ 12,00,000 per yearOverview:Who are we looking for?The ideal candidate has an emphasis on data infrastructure to help operationalize and maintain machine learning models and pipelines. The candidate will love automating via Infrastructure as code (IaC), be comfortable with AWS cloud services, and can design and implement end-to-end data and analytic infrastructure solutions.As...
-
Senior Data Engineer
2 hours ago
Bengaluru, Karnataka, India Veraxion Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe're Hiring:Senior Data Engineer (Azure)We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization.If you love solving complex data problems, architecting scalable pipelines, and working with cutting-edge Azure technologies — this role is for...
-
ETL Developer
4 hours ago
Bengaluru, Karnataka, India Huron Consulting Group Full time ₹ 12,00,000 - ₹ 24,00,000 per yearHuron is a global consultancy that collaborates with clients to drive strategic growth, ignite innovation and navigate constant change. Through a combination of strategy, expertise and creativity, we help clients accelerate operational, digital and cultural transformation, enabling the change they need to own their future. Join our team as the expert you...
-
ETL Developer
6 days ago
Bengaluru, Karnataka, India Nutanix Full time ₹ 20,00,000 - ₹ 25,00,000 per yearHungry, Humble, Honest, with Heart.The OpportunityWe are looking for a highly skilledData Integration Engineerto design, build, and manage scalable data pipelines and integration solutions across cloud and on-premises platforms. The role requires strong expertise in ETL/iPaaS tools, APIs, and data platforms, with exposure toAI/ML-driven automationfor smarter...
-
ETL Azure Lead Developer
1 week ago
Bengaluru, Karnataka, India Aliqan Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are hiring ETL Azure Lead developer for one of our client MNC Position- ETL Azure Lead Developer. Exp-8 to 12 Years. Key skills- ADF, Azure Data Factory, Azure SQL, Synapse, Active Directory Must have worked on Data Integration, Data Warehouse project for at least 5 yrs.ADF, Azure Data Factory, Azure SQL, Synapse, Active Directory.Should have...