Lead Data Engineer

2 weeks ago

Bengaluru Kochi Thiruvananthapuram, India Experion Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Role & responsibilities

  • Data Ingestion Framework:
  • Design & Development: Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization: Use AWS services such as AWS Glue, Lambda, EMR, ECS , EC2 and Step Functions to build highly scalable, resilient, and automated data pipelines.
  • Data Quality & Validation: Validation Processes: Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.
  • API Development: Design & Implementation: Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices: Create thorough API documentation and establish standards for API security, versioning, and performance optimization.
  • Collaboration & Agile Practices:
  • Cross-Functional Communication: Work closely with business stakeholders, data scientists, and operations teams to understand requirements and translate them into technical solutions.
  • Agile Development: Participate in sprint planning, code reviews, and agile ceremonies, while contributing to continuous improvement initiatives and CI/CD pipeline development (using tools like GitLab).

Preferred candidate profile

  • Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
  • Experience with additional AWS services such as Kinesis, Firehose, and SQS.
  • Familiarity with data lakehouse architectures and modern data quality frameworks.
  • Prior experience in a role that required proactive data quality management and API-driven integrations in complex, multi-cluster environments.

  • Lead Data Engineer

    2 weeks ago

    Kochi, Thiruvananthapuram, India IBS Software Services Full time US$ 80,000 - US$ 1,50,000 per year

    Role & responsibilitiesYou will be working as a lead data engineer building data pipelines following data lake architecture oriented towards the data mesh framework.You will guide and work with a team of 3-5 experienced data engineers driving the business objectives.You will be doing ETL/ELTs primarily with python programming to expose the data which...

  • Lead Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Velodata Global Pvt Ltd Full time

    Were Hiring : Lead Data Engineer - MS FabricExperience : 8+ yearsWork Location : Trivandrum / KochiBudget : Up to 28 LPANotice Period : Immediate to 30 daysAbout the Role :We are looking for a highly skilled Lead Data Engineer with strong expertise in MS Fabric and the Azure Data stack. The ideal candidate will play a key role in designing, building, and...

  • Lead Data Engineer

    2 weeks ago

    Bengaluru, Kochi, Thiruvananthapuram, India Experion Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role & responsibilitiesThe job duties and requirements are defined for the role of Informatica IICS data engineer.The senior role provides technical leadership and mentorship to junior team members.The candidate should have relevant experience working in at least 2 to 4 end to end project involving IICS.This position ensures the performance of all duties in...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Lead Data Engineer

    1 week ago

    Kochi, Thiruvananthapuram, India Place Elements Hr Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Manadatory skills : Strong in MS SQL and SSIS , Data Lake, Azure SQL, SSIS, ADF , Lead experience , Good communicationNotice period : immediate - 20 days

  • Lead Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Velodata Global Pvt Ltd Full time ₹ 4,00,000 - ₹ 5,00,000 per year

    RoleMandatory SkillsetExperienceWork LocationNPBudgetLead Data EngineerBig Query, LookerTotal years - 8+ years Relevant 6+ YearsTVM/Kochi/RemoteImmediate only25 LPAJob PurposeWe are looking for an experienced Lead Data Engineer with strong expertise in Google BigQuery andworking knowledge of Looker to support a data modernization engagement. The candidate...

  • Leading Data Engineer Position

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Lead Data Engineer OpportunityJob Title: Lead Data EngineerA leading organization seeks an experienced Lead Data Engineer to join their team. This is a full-time role that requires 8+ years of experience in Enterprise-level Data Engineering roles.The ideal candidate will have expertise in OLAP design, data warehousing concepts, and writing complex SQL...

  • Lead Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Staffington Consulting PVT Ltd Full time

    We are seeking a highly skilled and experienced Lead Data Engineer to join our team.The ideal candidate will be a hands-on expert in Microsoft Fabric and the broader Azure data stack, with a proven track record of designing, building, and managing robust data pipelines and analytics solutions.This role requires a strong leader who can architect scalable data...

  • Data Platform Engineering Lead

    6 days ago

    Thiruvananthapuram, Kerala, India ThinkWise Consulting LLP Full time

    Job Title: Data Platform Engineering LeadLocation: Hybrid – Hyderabad/RemoteType: Full-TimeAbout the RoleWe are hiring a hands-on Data Platform Engineering Lead to architect and scale the core data foundation behind our enterprise SaaS and AI-driven products. You'll lead the design of clean, scalable models, drive data platform strategy, and enable a...

  • Leading Data Engineering Expertise

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Lead Data Engineer Role SummaryWe are seeking a seasoned data engineering leader to join our organization. The ideal candidate will have expertise in designing and implementing scalable, high-performance data solutions that support various business functions.Key Responsibilities:Design and implement complex data pipelines using Databricks and Azure...