Lead Data Engineer – AWS

6 days ago

Cochin, Kerala, India Experion Technologies Full time ₹ 7,00,000 - ₹ 28,00,000 per year

Job Location: KochiRemoteTrivandrum

Job Purpose

  • We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in building and managing big data pipelines using modern AWS-based technologies, and who is passionate about driving quality and efficiency in data processing systems.

Job Description / Duties and Responsibilities

  • Architect, develop, and maintain end-to-end data ingestion framework for extracting, transforming, and loading data from diverse sources
  • Use AWS services (Glue, Lambda, EMR, ECS, EC2, Step Functions) to build scalable, resilient automated data pipelines
  • Develop and implement automated data quality checks, validation routines, and error-handling mechanisms
  • Establish comprehensive monitoring, logging, and alerting systems for data quality issues
  • Architect and develop secure, high-performance APIs for data services integration
  • Create thorough API documentation and establish standards for security, versioning, and performance
  • Work with business stakeholders, data scientists, and operations teams to understand requirements
  • Participate in sprint planning, code reviews, and agile ceremonies
  • Contribute to CI/CD pipeline development using GitLab

Job Specification / Skills and Competencies

  • 5+ years experience in data engineering with analytical platform development focus
  • Proficiency in Python and/or PySpark
  • Strong SQL skills for ETL processes and large-scale data manipulation
  • Extensive AWS experience (Glue, Lambda, Step Functions, S3)
  • Familiarity with big data systems (AWS EMR, Apache Spark, Apache Iceberg)
  • Database experience with DynamoDB, Aurora, Postgres, or Redshift
  • Proven experience designing and implementing RESTful APIs
  • Hands-on CI/CD pipeline experience (preferably GitLab)
  • Agile development methodology experience
  • Strong problem-solving abilities and attention to detail
  • Excellent communication and interpersonal skills
  • Ability to work independently and collaboratively
  • Capacity to quickly learn and adapt to new technologies
  • 10+ years total experience

Any Additional Information/Specifics

  • Bachelor's/Master's in Computer Science, Data Engineering or related field (preferred)
  • Experience with additional AWS services (Kinesis, Firehose, SQS)
  • Familiarity with data lakehouse architectures and modern data quality frameworks
  • Experience with proactive data quality management in multi-cluster environments
  • Adhere to Information Security Management policies and procedures

  • Lead Data Engineer(AWS)

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 23,00,000 per year

    Job Title: Lead Data Engineer – AWS, Python, PySparkLocation: Kochi/ThiruvananthapuramExperience: 7+ YearsBudget: Up to 23 LPANotice Period: Immediate to 15 daysJob OverviewWe are seeking an experienced Lead Data Engineer to design and manage a scalable data ingestion framework with strong focus on data quality, validation, and API development. The ideal...

  • Lead Data Engineer

    2 weeks ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time

    Job Title : Lead Data Engineer - AWSLocation : Kochi / : 6- 8 YearsNotice Period : Immediate to 15 DaysJob Overview :We are looking for a highly skilled Lead Data Engineer (AWS) to architect, build, and manage scalable data pipelines with a strong emphasis on data quality, governance, and secure API integrations. The role requires deep expertise in AWS...

  • AWS Cloud Data Engineer

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Unlock the Power of Data EngineeringSteps AI is a fast-growing AI startup that's revolutionizing the way businesses interact with customers. We're looking for an AWS-focused Data Engineer to join our team and help us power our platform with real-time, intelligent insights.The ideal candidate has 1–2 years of experience in data engineering and is excited to...

  • Data/QA Engineer _ AWS Cloud

    1 week ago

    Cochin, Kerala, India Inforizon Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Description: QA Engineer (Agentic AI AWS)Key ResponsibilitiesDevelop and execute test plans, test cases, and automation scripts for AI-powered applications on AWS.Test data pipelines (ETL/ELT, streaming, batch) for correctness, completeness, and performance.Validate AI/ML workflows (model training, inference, fine-tuning, and retraining...

  • AWS AI Architect Lead

    2 days ago

    Cochin, Kerala, India beBeeCloud Full time ₹ 4,00,00,000 - ₹ 5,00,00,000

    Job Title: AWS AI Architect LeadAbout the Role:We are seeking a highly skilled and experienced AWS AI Solutions / AI Architect to lead the design and implementation of advanced agentic AI solutions within cloud environments, specifically leveraging AWS services.Key Responsibilities:Architect and lead the design of agentic AI systems utilizing AWS services...

  • Senior Data Engineering Lead

    1 week ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Data Engineer Leadership RoleWe are seeking a senior data engineer to lead the development of a scalable data ingestion framework that ensures high-quality and validated data. The ideal candidate will have experience in building and managing big data pipelines using modern AWS-based technologies and is passionate about driving quality and efficiency in data...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time

    Job Overview :We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India A2Z Hire Full time ₹ 20,00,000 - ₹ 23,00,000 per year

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable dataingestion framework while ensuring high data quality and validation. The successful candidatewill also be responsible for designing and implementing robust APIs for seamless dataintegration. This role is ideal for someone with deep expertise in building...

  • Data Engineering Team Lead

    2 weeks ago

    Cochin, Kerala, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleAbout the RoleThis is a leadership position where you will oversee the technical direction, quality, and delivery of cross-functional teams working on strategic data products. You will lead by example: designing solutions, writing code, mentoring engineers, and working closely with architects and stakeholders to drive results.This is a hands-on...