Lead Data Engineer
12 hours ago
Job Title:
Lead Data Engineer
Location:
Kochi / Trivandrum
Experience:
10+ years
Notice Period:
Immediate to 15 days
Budget:
Up to ₹23 LPA
Primary Skills
- Core:
AWS, Python
Job Overview
Seeking an experienced
Senior/Lead Data Engineer
to design and implement scalable
data ingestion frameworks
, ensure
data quality and validation
, and build
robust APIs
for seamless data integration. The ideal candidate will have hands-on expertise with
AWS-based big data pipelines
, automation, and high-performance API development.
Key Responsibilities
- Data Ingestion Framework:
- Architect and maintain ETL pipelines using
AWS Glue, Lambda, EMR, ECS, EC2, Step Functions
. - Optimize data ingestion for scalability, resiliency, and automation.
- Data Quality & Validation:
- Build automated validation and error-handling mechanisms.
- Implement monitoring, logging, and alerting for data quality assurance.
- API Development:
- Design and develop
secure RESTful APIs
for internal/external data integration. - Maintain API documentation and ensure adherence to best practices.
- Collaboration & Agile:
- Partner with business stakeholders, data scientists, and operations.
- Contribute to
CI/CD pipelines
(preferably GitLab) and Agile processes.
Required Qualifications
- Experience:
Minimum 5+ years in data engineering / analytical platform development. - Programming:
Strong in
Python / PySpark / SQL
for ETL and large-scale data handling. - AWS Expertise:
Hands-on with
AWS Glue, Lambda, Step Functions, S3
, and
data platforms
(EMR, Apache Spark, Iceberg). - Database Exposure:
DynamoDB, Aurora, Postgres, Redshift. - API Development:
Proven REST API design & integration skills. - DevOps:
Experience with
GitLab CI/CD
, Agile methodology.
Preferred Qualifications
- Bachelor's/Master's in Computer Science, Data Engineering, or related field.
- Familiarity with
AWS Kinesis, Firehose, SQS
, and
data lakehouse architectures
. - Experience with
data quality frameworks
and
API-driven integrations
in multi-cluster setups. - Commitment to
Information Security policies and best practices
.
-
Lead Data Engineer
2 days ago
Cochin, Kerala, India Tothr Full time ₹ 6,00,000 - ₹ 18,00,000 per year7+ years of hands-on experience in data engineering roles 3+ years in a technical leadership position, managing data engineering Proven track record of building and maintaining BI/analytics platforms • Experience with Databricks and Delta Lake
-
Ai Data Science Lead
2 weeks ago
Cochin, Kerala, India Talrop Full time ₹ 4,80,000 per yearJob Overview:We are seeking a highly skilled AI / Data Science Lead to spearhead our AIinitiatives and drive data-based innovation across the organization. This role involvesleading end-to-end AI/ML model development, guiding the tech team, andtransforming data into meaningful insights that support product and business growth.Key Responsibilities:● Lead...
-
Senior Data Engineer
2 weeks ago
Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...
-
Senior Data Engineer
6 days ago
Cochin, Kerala, India Milestone Technologies, Inc. Full timeRole Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...
-
Data Engineer
2 days ago
Cochin, Kerala, India ChiSquarelabs Full time ₹ 8,00,000 - ₹ 12,00,000 per yearWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.IMMEDIATE JOINERS PREFERREDResponsibilitiesBuild & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.Data Architecture & Engineering: Work on...
-
Data Engineer
1 week ago
Cochin, Kerala, India VGreen Technology Solutions (VGreenTEK) Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Role: Data EngineerExperience: 4 to 5yearsJob Location: Kochi, KeralaJob Type: Full-time, PermanentNotice: Immediate/15 days or currently serving (LWD within 30 days)Candidates from Kerala are the first priority.We are seeking an experienced and driven Data Engineer with 4-5 years of hands-on experience in building scalable data infrastructure and...
-
Data Warehouse Lead
1 week ago
Cochin, Kerala, India Gapblue Software Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Data Warehouse Lead Experience: 10+ Years Location: Kochi, IndiaJob SummaryWe are seeking a highly skilled and experienced Data Warehouse Lead to oversee our enterprise data initiatives. The ideal candidate will have strong expertise in SQL, Data Warehousing concepts, ETL, and data modeling, with the ability to lead teams, design scalable...
-
Data Engineer
2 weeks ago
Cochin, Kerala, India DIGITRELL Full time ₹ 6,00,000 - ₹ 8,00,000 per yearWe are seeking an experienced and driven Data Engineer with 3-5 years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise,...
-
Data Engineer
6 days ago
Cochin, Kerala, India Pumex Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per yearWe are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions.Job Title: Data...
-
Senior Data Engineer
2 weeks ago
Cochin, Kerala, India Entri Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Description: Senior Data EngineerLocation: KochiExperience: 3-5 YearsTeam: Data EngineeringDepartment: EngineeringAbout EntriEntri is a leading vernacular EdTech platform helping millions of learners acquire skills and secure meaningful jobs. Our engineering vision stands on three core pillars - Stability at Scale,Innovation at the Bleeding...