Lead Data Engineer

1 week ago

Bengaluru Kochi Thiruvananthapuram, India Experion Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role & responsibilities

  • Data Ingestion Framework:
  • Design & Development: Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization: Use AWS services such as AWS Glue, Lambda, EMR, ECS , EC2 and Step Functions to build highly scalable, resilient, and automated data pipelines.
  • Data Quality & Validation: Validation Processes: Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.
  • API Development: Design & Implementation: Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices: Create thorough API documentation and establish standards for API security, versioning, and performance optimization.
  • Collaboration & Agile Practices:
  • Cross-Functional Communication: Work closely with business stakeholders, data scientists, and operations teams to understand requirements and translate them into technical solutions.
  • Agile Development: Participate in sprint planning, code reviews, and agile ceremonies, while contributing to continuous improvement initiatives and CI/CD pipeline development (using tools like GitLab).

Preferred candidate profile

  • Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
  • Experience with additional AWS services such as Kinesis, Firehose, and SQS.
  • Familiarity with data lakehouse architectures and modern data quality frameworks.
  • Prior experience in a role that required proactive data quality management and API-driven integrations in complex, multi-cluster environments.

  • Technical Lead- Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Lead Data Engineer

    5 days ago

    Kochi, Thiruvananthapuram, India Place Elements Hr Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Manadatory skills : Strong in MS SQL and SSIS , Data Lake, Azure SQL, SSIS, ADF , Lead experience , Good communicationNotice period : immediate - 20 days

  • Lead data engineer

    22 hours ago

    Kochi, India Cozzera Full time

    Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks....

  • Offshore Data Engineer Tester

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Offshore Data Engineer Tester (Lead) to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Offshore Data Engineer Tester

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Offshore Data Engineer Tester (Lead) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Lead Data Engineer

    2 weeks ago

    Thiruvananthapuram, India Velodata Global Pvt Ltd Full time

    Were Hiring : Lead Data Engineer - MS FabricExperience : 8+ yearsWork Location : Trivandrum / KochiBudget : Up to 28 LPANotice Period : Immediate to 30 daysAbout the Role :We are looking for a highly skilled Lead Data Engineer with strong expertise in MS Fabric and the Azure Data stack. The ideal candidate will play a key role in designing, building, and...

  • Lead Data Scientist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Data Scientist - Computer Vision & Generative AI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). We are seeking...

  • Lead Data Engineer

    4 weeks ago

    Kochi, India Velodata Global Pvt Ltd Full time

    Total Experience - 10+ Years Work Location - Trivandrum, Kochi& Remote Note** - Candidates are required to attend the final round of the interview in person. The selected candidate must work from the office during the first month. Job Overview We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion...

  • Lead data engineer

    4 weeks ago

    Kochi, India Velodata Global Pvt Ltd Full time

    Total Experience - 10+ Years Work Location - Trivandrum, Kochi& Remote Note** - Candidates are required to attend the final round of the interview in person . The selected candidate must work from the office during the first month. Job Overview We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion...