Data Engineering Lead

10 hours ago

Jamnagar, Gujarat, India ZettaMine Labs Pvt. Ltd. Full time

Job Description – Data Engineering Lead (AI for Data Quality & Analytics)

Exp Range :7+years

Location : Bengaluru/Hyderabad

Role Overview

We are seeking an experienced Data Engineering Lead with a strong foundation in data pipelines, data validation, and AI-enhanced quality frameworks. This role is responsible for building and maintaining high-quality data ingestion and validation processes from multiple upstream systems, while laying the foundation for AI-driven anomaly detection, business insight extraction, and scalable reporting solutions.

Key Responsibilities

  • Data Quality Management
  • Design and implement scalable data quality validation systems across multiple sources (e.g., Workday, Snowflake, Beeline, Excel logs).
  • Develop AI-driven tools that identify anomalies, detect irrational transactions, and provide early insight into data discrepancies.
  • Engineering & Automation
  • Lead development of data pipelines and validation scripts using Python, Alteryx, and integration into reporting tools.
  • Implement pre-processing checks for incoming files to detect issues before ETL pipelines are executed.
  • AI and Machine Learning Integration
  • Build and deploy AI models to automate issue detection, enhance data lineage tracking, and generate intelligent alerts on unexpected changes.
  • Collaborate with business analysts to incorporate predictive insights and pattern recognition from historical data anomalies.
  • Data Governance & Reporting
  • Partner with stakeholders (Fletcher, Aliana, etc.) to proactively identify and address reporting gaps or escalations.
  • Ensure auditability and traceability of decisions derived from enriched or corrected data.
  • Cross-Functional Collaboration
  • Work closely with business analysts, data scientists, and engineering teams across India and the U.S. to align system architecture with business needs.
  • Educate and influence non-technical business users on the importance of data quality and automated anomaly detection.
  • Team Leadership & Optimization
  • Lead a small, distributed team, mentoring junior engineers and analysts.
  • Optimize headcount through AI augmentation, enabling skilled team members to focus on higher-value initiatives.

Key Qualifications

  • 6–10 years of experience in data engineering, data quality, or analytics engineering roles.
  • Proficient in Python, Alteryx, SQL, and cloud data platforms like Snowflake.
  • Deep understanding of data pipelines, ETL/ELT processes, and data validation best practices.
  • Experience with AI/ML in data quality (anomaly detection, NLP-driven validation, etc.).
  • Familiarity with enterprise systems like Workday, Beeline, and custom Excel-based reporting.
  • Strong interpersonal and communication skills to work with executive stakeholders and distributed teams.

Preferred Attributes

  • Experience leading data modernization or AI transformation projects.
  • Prior exposure to dashboard adoption challenges and enterprise change management.

How to Apply:

Send your updated resume to: swetha.p@zettamine.com

Please include the following in your email:

  • Full Name
  • Contact Number
  • Total Experience
  • Relevant Experience
  • Current CTC
  • Expected CTC
  • Notice Period

  • Leading Data Engineer

    4 days ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,10,000

    As a Senior Data Engineer, you will lead the development of scalable data processing systems. Your expertise in cloud-based big data platforms and proficiency in programming languages like Python, Scala, and Spark will enable you to design and implement robust data pipelines.Key Responsibilities:Collaborate with cross-functional teams to integrate data...

  • Senior Data Engineering Project Lead

    19 hours ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Senior Data Engineering Project LeadAbout the Role:We are seeking a seasoned Technical Project Manager with expertise in data engineering to lead our data platform, AI, BI, and analytics projects. The ideal candidate will have 13+ years of experience in IT, with a proven track record of managing end-to-end data engineering, analytics, or AI/ML...

  • Azure Data Engineer and Team Lead

    1 week ago

    Jamnagar, Gujarat, India beBeeBigDataLeader Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Seeking a Technical Leader in Azure with expertise in Big Data platforms, Microsoft Azure, and Databricks to lead a team of talented data engineers.The ideal candidate will design and deliver scalable data pipelines and analytics platforms ensuring high performance, reliability, and security in a cloud-native environment.This role involves leading,...

  • Leading Data Architect

    2 days ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Senior Data Engineer RoleWe are seeking an experienced Senior Data Engineer to lead the design and implementation of scalable, high-performance data pipelines.Key Responsibilities:

  • Data Engineering Test Lead

    22 hours ago

    Jamnagar, Gujarat, India beBeeTesting Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityMcDonald's offers exciting corporate opportunities that serve as innovation and operations hubs.Our global offices bring together knowledge across business, technology, analytics, and AI.Key ResponsibilitiesLead comprehensive testing strategy and execution for complex data engineering pipelines and product delivery initiatives.Drive quality...

  • Lead Data Architect

    1 day ago

    Jamnagar, Gujarat, India RK HR Management Private Limited Full time

    Key Responsibilities: Define and lead enterprise data strategy & governance Oversee modern data platforms (Snowflake, Databricks, AWS, Kafka) Enable AI/ML for personalization, forecasting & analytics Partner cross-functionally with Marketing, Supply Chain, Finance & R&D Lead and mentor a high-performing data engineering teamWhat We're Looking For: 18+ years...

  • Lead Data Architect

    1 week ago

    Jamnagar, Gujarat, India Artefact Full time

    Data Lead, India officeLocation: Pune Employment Type: Full-timeArtefact is a global data and AI consulting services company that helps organizations transform data into tangible business results.We're looking for an experienced and dynamic Data Lead to drive the full lifecycle of our data engineering solutions, from strategic design to hands-on...

  • Lead Data Engineering Expert

    2 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior ETL Developer Job DescriptionWe are seeking a highly experienced Senior ETL Developer to join our team.The ideal candidate will have a strong background in data engineering and experience working with big data technologies.Main Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical...

  • Lead Enterprise Data Engineer

    2 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Apexon:We are a digital-first technology services firm.Our reputation is built on comprehensive engineering services and dedication to solving clients' toughest technology problems.About the Role:Seeking a highly skilled Data Engineer to provide L2 and L3 production support for enterprise-scale data platforms.Provide L2/L3 production support for...

  • Data Engineering Leader

    1 week ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled Senior Data Engineer Lead to design, develop and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Responsibilities include working with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms. You will...