Lead Data Engineer – AWS

20 hours ago

Ernakulam, India Experion Technologies Full time

Job Location: KochiRemoteTrivandrum

Job Purpose

  • We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in building and managing big data pipelines using modern AWS-based technologies, and who is passionate about driving quality and efficiency in data processing systems.

Job Description / Duties and Responsibilities

  • Architect, develop, and maintain end-to-end data ingestion framework for extracting, transforming, and loading data from diverse sources
  • Use AWS services (Glue, Lambda, EMR, ECS, EC2, Step Functions) to build scalable, resilient automated data pipelines
  • Develop and implement automated data quality checks, validation routines, and error-handling mechanisms
  • Establish comprehensive monitoring, logging, and alerting systems for data quality issues
  • Architect and develop secure, high-performance APIs for data services integration
  • Create thorough API documentation and establish standards for security, versioning, and performance
  • Work with business stakeholders, data scientists, and operations teams to understand requirements
  • Participate in sprint planning, code reviews, and agile ceremonies
  • Contribute to CI/CD pipeline development using GitLab

Job Specification / Skills and Competencies

  • 5+ years experience in data engineering with analytical platform development focus
  • Proficiency in Python and/or PySpark
  • Strong SQL skills for ETL processes and large-scale data manipulation
  • Extensive AWS experience (Glue, Lambda, Step Functions, S3)
  • Familiarity with big data systems (AWS EMR, Apache Spark, Apache Iceberg)
  • Database experience with DynamoDB, Aurora, Postgres, or Redshift
  • Proven experience designing and implementing RESTful APIs
  • Hands-on CI/CD pipeline experience (preferably GitLab)
  • Agile development methodology experience
  • Strong problem-solving abilities and attention to detail
  • Excellent communication and interpersonal skills
  • Ability to work independently and collaboratively
  • Capacity to quickly learn and adapt to new technologies
  • 10+ years total experience

Any Additional Information/Specifics

  • Bachelor's/Master's in Computer Science, Data Engineering or related field (preferred)
  • Experience with additional AWS services (Kinesis, Firehose, SQS)
  • Familiarity with data lakehouse architectures and modern data quality frameworks
  • Experience with proactive data quality management in multi-cluster environments
  • Adhere to Information Security Management policies and procedures

  • Lead Data Engineer(AWS)

    20 hours ago

    Ernakulam, India Velodata Global Pvt Ltd Full time

    Job Title: Lead Data Engineer – AWS, Python, PySpark Location: Kochi/Thiruvananthapuram Experience: 7+ Years Budget: Up to 23 LPA Notice Period: Immediate to 15 days Job Overview We are seeking an experienced Lead Data Engineer to design and manage a scalable data ingestion framework with strong focus on data quality, validation, and API development. The...

  • Lead Data Engineer

    22 hours ago

    Ernakulam, India A2Z Hire Full time

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...

  • AWS AI/ML Engineer

    19 hours ago

    Ernakulam, India Inforizon Full time

    Job Description: Senior AWS Solutions/AI Architect (Agentic AI & Cloud Solutions) ====================================================== Responsibilities Lead architecture design for agentic AI systems leveraging AWS services (Bedrock, SageMaker, Lambda, Step Functions, EventBridge, OpenSearch, DynamoDB). Define multi-agent orchestration strategies for...

  • Lead Data Engineers

    22 hours ago

    Ernakulam, India Velodata Global Pvt Ltd Full time

    1) Lead Data Engineer – MS Fabric Experience: 8+ years Location: Trivandrum / Kochi Budget: Up to 28 LPA Notice Period: Immediate – 30 Days Mandatory Skills: MS Fabric (6 months–2 years hands-on), Azure Stack (ADF, Data Lake, Lakehouse, Power BI) 2) Lead Data Engineer – SSIS & SQL Experience: 6+ years Location: Kochi / Trivandrum Budget:...

  • AWS MLOps

    21 hours ago

    Ernakulam, India Linnk Group Full time

    AWS MLOps & LLMOps Engineer – Reinforcement Learning & Cloud AI Specialist Location: Kochi Employment Type: Full-Time Job Overview We are seeking ahands-on and customer-facing AWS MLOps & LLMOps Engineerwith expertise inreinforcement learning,SageMaker,Feature Store, andcontinuous ML lifecycle management. You'll lead the deployment and monitoring of ML...

  • Senior Data Engineer

    20 hours ago

    Ernakulam, India Velodata Global Pvt Ltd Full time

    Role:Lead/ Senior Data Engineer - AWS, Python, Pyspark Mandatory Skills:AWS, Python, Pyspark Notice Period:Immediate to 15 days Experience Range:7+ Years Location:Kerala (Local candidates only – Kochi/Trivandrum) Budget:23 LPA Job Overview We are seeking an experiencedSenior Data Engineerto lead the development of a scalable data ingestion framework while...

  • Data Engineer

    22 hours ago

    Ernakulam, India TECHNOPARKJOBS Full time

    Job Title: Data Engineer Domain: Agentic AI – AWS Annual CTC: ₹ 7 LPA Position Overview: We are seeking skilled Data Engineers to design, build, and manage robust data pipelines that power Agentic AI solutions on AWS. The role focuses on developing efficient ETL/ELT workflows, ensuring data quality, security, and scalability to support AI/ML model...

  • Data Engineer

    22 hours ago

    Ernakulam, India VGreenTek Full time

    Job Role: Data Engineer Experience: 5+ years Mode: Work from office / Hybrid (Kochi) Job Type: Full-time, Permanent Notice Period: days Job Description: This role is a hands-on position responsible for the build and continued evolution of the data platform, business applications and integration tools. We are looking for a hands-on engineer that can recommend...

  • AWS DevOps

    3 days ago

    Cochin / Kochi / Ernakulam, India Cydez Technologies Private Limited Full time

    Job Description About the Role: We are seeking an AWS DevOps / MLOps Engineer to support our Agentic AI projects. The role involves building, automating, and managing cloud infrastructure and machine learning workflows on AWS, ensuring smooth deployment and operation of AI solutions. Key Responsibilities: 1. Design, deploy, and manage AWS infrastructure...

  • Data Engineer

    20 hours ago

    Ernakulam, India Qubryx Full time

    Job Title: Data Engineer Geospatial Development Location: Kochi (Remote) Job Type: Full Time Experience: 3+ years in Data Engineering with hands-on Geospatial Development Job Summary: We are seeking a highly skilled Data Engineer with experience in geospatial data processing and visualization. The ideal candidate will have strong Python skills along...