Lead Data Engineer

13 hours ago


Bengaluru, Karnataka, India Infiniti Research Full time

Lead Engineer MarTech/Digital Engineering (Customer Data Management)

We are seeking a Lead Data Engineer to serve as the technical lead for the team responsible for managing and engineering customer data across Catalyst Brands.

The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable systems that collect, process, and activate customer data. In this role, you will lead a team of skilled engineers, promote engineering best practices, and drive the adoption of scalable solutions using both SaaS platforms and custom-built capabilities.

Working in an agile (Scrum) environment, you will collaborate closely with product owners, marketing stakeholders, data architects, and cross-functional teams to plan and execute key initiatives. You'll ensure the team has clear direction, adequate resources, and strong technical guidance to deliver high-quality, high-impact solutions. In addition, you'll play a key role in shaping system architecture, enforcing software quality standards, and fostering a culture of innovation and technical excellence.

Primary Responsibilities:

  • Lead agile data engineering team focused on customer data management and big data solutions that power marketing analytics, personalization, and engagement strategies across Catalyst Brands' digital ecosystem. Ensure initiatives are delivered on time, with high data integrity, performance, and scalability.
  • Collaborate with cross-functional partners including architecture, product management, DevOps, DataOps, marketing analytics, and business operations to define and execute a robust data product backlog and technical roadmap.
  • Ensure scalability, performance, and maintainability of big data pipelines, data lakes, and customer data platforms (CDPs) to support advanced marketing use cases such as segmentation and real-time personalization.
  • Serve as a technical lead on the design and delivery of complex data engineering projects involving customer data integration, identity resolution, and data synchronization across internal and third-party platforms.
  • Oversee development and data engineering practices, providing guidance through design/code reviews, architectural decisions, and best practices for building secure and compliant customer data solutions.
  • Mentor and guide in a dynamic, data-driven environment, promoting a culture of excellence, collaboration, and customer-centric data solutions.[RD1]

Core Competencies & Accomplishments:

  • 10+ years' experience, with 3+ years in a technical leadership role.
  • Lead the design and implementation of scalable data pipelines for ingesting, transforming, and activating customer data.
  • Develop and orchestrate workflows using Apache Airflow and Spark.
  • Leverage AWS services (e.g., S3, Glue, Athena, Redshift, EMR) to manage and optimize large-scale data infrastructure.
  • Write robust, modular, and testable code in Python to support data engineering use cases.
  • Experience developing or supporting AI-powered solutions is a strong plus.
  • Expert-level skills in SQL for data modeling, transformation, and analysis.
  • Hands-on experience with Snowflake, Redshift, and traditional data warehousing principles (star/snowflake schema, performance tuning, etc.)
  • Familiarity with real-time data streaming (Kafka) and event-based architectures.
  • Implement and manage CI/CD pipelines for data applications and infrastructure.
  • Exposure to CDPs (Customer Data Platforms) or Marketing Tech Platforms is a plus
  • Strong sense of urgency and ability to drive change.
  • Experience in agile methodologies (Scrum/Kanban/SAFE) and project management discipline.
  • Strong interpersonal and communication (written and verbal) skills.
  • Bachelor's degree in computer science or related field.
  • Experience in Retail is a plus.


  • Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Entry Operator

    1 week ago


    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Lead Data Scientist

    3 days ago


    Bengaluru, Karnataka, India Aptus Data Labs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Description: Senior/lead Data ScientistLocation: Bangalore/WFHEmployment Type: Full-timeAbout the RoleWe are seeking a highly skilled Senior /lead Data Scientist with strong expertise in Artificial Intelligence (AI), Machine Learning (ML), Deep Learning, and Natural Language Processing (NLP). The ideal candidate will also have hands-on exposure to...

  • Data Engineer

    3 days ago


    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    3 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Lead Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Infogain Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    The Azure Data Engineer (Lead) is a management-level role responsible for leading a team of data engineers to design, develop, and maintain data processing systems on the Azure platform. They work with data architects, data scientists, and other stakeholders to ensure data solutions meet business requirements.Core SkillsMastery of Azure data services such as...

  • Sr Data Engineer

    23 hours ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...