Lead Data Engineer(AWS)
2 days ago
Job Title: Lead Data Engineer – AWS, Python, PySpark
Location: Kochi/Thiruvananthapuram
Experience: 7+ Years
Budget: Up to 23 LPA
Notice Period: Immediate to 15 days
Job Overview
We are seeking an experienced Lead Data Engineer to design and manage a scalable data ingestion framework with strong focus on data quality, validation, and API development. The ideal candidate will have proven expertise in AWS-based big data pipelines and thrive in collaborative Agile environments.
Key Responsibilities
Architect and maintain end-to-end data ingestion frameworks using AWS services (Glue, Lambda, EMR, Step Functions, ECS, EC2).
Develop and implement data quality checks, validation routines, monitoring & alerting systems.
Design and deploy secure, high-performance RESTful APIs for seamless integration.
Collaborate with business stakeholders, data scientists, and operations teams.
Contribute to Agile development, sprint planning, CI/CD (GitLab).
Required Skills & Qualifications
5+ years in Data Engineering, with strong background in analytical platform development.
Expertise in Python, PySpark, SQL for ETL and large-scale data manipulation.
Hands-on experience with AWS services (Glue, S3, Lambda, EMR, Step Functions).
Strong knowledge of databases (Aurora, Postgres, DynamoDB, Redshift).
Proven RESTful API design & implementation experience.
Experience with CI/CD pipelines and Agile methodology.
Excellent problem-solving and communication skills.
Preferred Qualifications
Bachelor's/Master's in Computer Science or related field.
Experience with AWS Kinesis, Firehose, SQS.
Familiarity with data lakehouse architectures & data quality frameworks.
Important Note: Only candidates who are immediately available (0–15 days notice) and match the job requirements should apply.
-
Lead Data Engineer
2 weeks ago
Cochin, Kerala, India Careersteer services private limited Full time ₹ 10,00,000 - ₹ 23,00,000 per yearWe are seeking a highly skilled Lead Data Engineer with strong hands-on experience in AWS, Python, and PySpark. The ideal candidate will design, develop, and manage scalable data pipelines and architectures, lead a team of data engineers, and ensure data availability, reliability, and performance to support analytics, reporting, and business intelligence...
-
Lead Data Engineer
3 days ago
Cochin, Kerala, India A2Z Hire Full time ₹ 20,00,000 - ₹ 23,00,000 per yearJob OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...
-
Lead Data Engineer
11 hours ago
Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable dataingestion framework while ensuring high data quality and validation. The successful candidatewill also be responsible for designing and implementing robust APIs for seamless dataintegration. This role is ideal for someone with deep expertise in building...
-
Data/QA Engineer _ AWS Cloud
2 days ago
Cochin, Kerala, India Inforizon Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: QA Engineer (Agentic AI AWS)Key ResponsibilitiesDevelop and execute test plans, test cases, and automation scripts for AI-powered applications on AWS.Test data pipelines (ETL/ELT, streaming, batch) for correctness, completeness, and performance.Validate AI/ML workflows (model training, inference, fine-tuning, and retraining...
-
AWS AI/ML Engineer
2 days ago
Cochin, Kerala, India Inforizon Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Description: Senior AWS Solutions/AI Architect (Agentic AI & Cloud Solutions)======================================================ResponsibilitiesLead architecture design for agentic AI systems leveraging AWS services (Bedrock, SageMaker, Lambda, Step Functions, EventBridge, OpenSearch, DynamoDB). Define multi-agent orchestration strategies for...
-
Machine Learning Engineer – AWS
6 days ago
Cochin, Kerala, India DBiz ai solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Summary:We are seeking a highly skilled and motivated Machine Learning Engineer with a strong foundation in programming and machine learning, hands-on experience with AWS Machine Learning services (especially SageMaker), and a solid understanding of Data Engineering and MLOps practices. You will be responsible for designing, developing, deploying, and...
-
Senior Data Engineer
15 hours ago
Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per yearRole:Lead/ Senior Data Engineer - AWS, Python, PysparkMandatory Skills:AWS, Python, PysparkNotice Period:Immediate to 15 daysExperience Range:7+ YearsLocation:Kerala (Local candidates only – Kochi/Trivandrum)Budget:23 LPAJob OverviewWe are seeking an experiencedSenior Data Engineerto lead the development of a scalable data ingestion framework while...
-
Senior Data Engineer
1 week ago
Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...
-
AWS MLOps
3 days ago
Cochin, Kerala, India Linnk Group Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAWS MLOps & LLMOps Engineer – Reinforcement Learning & Cloud AI Specialist Location: Kochi Employment Type: Full-TimeJob OverviewWe are seeking ahands-on and customer-facing AWS MLOps & LLMOps Engineerwith expertise inreinforcement learning,SageMaker,Feature Store, andcontinuous ML lifecycle management. You'll lead the deployment and monitoring of ML and...
-
Lead Data Architect
1 week ago
Cochin, Kerala, India Tamcherry Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: Data and AI Lead ArchitectWe are seeking an experienced Data and AI Lead Architect with 12–15 years of expertise in large-scale data and cloud architecture, particularly on AWS or Google Cloud, who has successfully supported enterprise customers across the US and UK/Europe. The ideal candidate will be based in Kochi (Kerala in general) or...