Senior/Lead Data Engineer

14 hours ago

Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

Job Title : Lead Data Engineer

Location : Kochi / Trivandrum

Experience : 10 years

Notice Period : Immediate to 15 days

Primary Skills : AWS, Python

Job Overview :

Seeking an experienced Senior/Lead Data Engineer to design and implement scalable data ingestion frameworks, ensure data quality and validation, and build robust APIs for seamless data integration. The ideal candidate will have hands-on expertise with AWS-based big data pipelines, automation, and high-performance API development.

Key Responsibilities :

Data Ingestion Framework :

- Architect and maintain ETL pipelines using AWS Glue, Lambda, EMR, ECS, EC2, Step Functions.

- Optimize data ingestion for scalability, resiliency, and automation.

Data Quality & Validation :

- Build automated validation and error-handling mechanisms.

- Implement monitoring, logging, and alerting for data quality assurance.

API Development :

- Design and develop secure RESTful APIs for internal/external data integration.

- Maintain API documentation and ensure adherence to best practices.

Collaboration & Agile :

- Partner with business stakeholders, data scientists, and operations.

- Contribute to CI/CD pipelines (preferably GitLab) and Agile processes.

Required Qualifications :

- Experience : Minimum 5 years in data engineering / analytical platform development.

- Programming : Strong in Python / PySpark / SQL for ETL and large-scale data handling.

- AWS Expertise : Hands-on with AWS Glue, Lambda, Step Functions, S3, and data platforms (EMR, Apache Spark, Iceberg).

- Database Exposure : DynamoDB, Aurora, Postgres, Redshift.

- API Development : Proven REST API design & integration skills.

Preferred Qualifications :

- Bachelors/Masters in Computer Science, Data Engineering, or related field.

- Familiarity with AWS Kinesis, Firehose, SQS, and data lakehouse architectures.

- Experience with data quality frameworks and API-driven integrations in multi-cluster setups.

- Commitment to Information Security policies and best practices.

  • Senior Data Engineer

    1 week ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time

    Role Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...

  • Lead Data Engineer

    2 days ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Lead Data EngineerLocation:Kochi / TrivandrumExperience:10+ yearsNotice Period:Immediate to 15 daysBudget:Up to ₹23 LPAPrimary SkillsCore: AWS, PythonJob OverviewSeeking an experiencedSenior/Lead Data Engineerto design and implement scalabledata ingestion frameworks, ensuredata quality and validation, and buildrobust APIsfor seamless data...

  • Senior Data engineer

    4 days ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Overview: Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management. Core Responsibilities:Build and manage high-volume data pipelines using...

  • Senior Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Role:Lead/ Senior Data Engineer - AWS, Python, PysparkMandatory Skills:AWS, Python, PysparkNotice Period:Immediate to 15 daysExperience Range:7+ YearsLocation:Kerala (Local candidates only – Kochi/Trivandrum)Budget:23 LPAJob OverviewWe are seeking an experiencedSenior Data Engineerto lead the development of a scalable data ingestion framework while...

  • Senior Data Engineer

    2 weeks ago

    Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...

  • Senior Data Engineer

    1 week ago

    Cochin, Kerala, India Milestone Technologies Full time

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Lead Data Engineer

    7 days ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable dataingestion framework while ensuring high data quality and validation. The successful candidatewill also be responsible for designing and implementing robust APIs for seamless dataintegration. This role is ideal for someone with deep expertise in building...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India A2Z Hire Full time ₹ 20,00,000 - ₹ 23,00,000 per year

    Job OverviewWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...

  • Data Engineering Lead

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the job : Location : Kochi / Bangalore (initially in Kochi)Role Summary : We are seeking a Data Engineering Lead to architect, build, and optimize scalable data pipelines and data platforms that power critical business decisions. The ideal candidate will have deep expertise in PySpark, ETL frameworks, SQL Stored Procedures, and Data Modeling,...

  • Lead Data Engineer – AWS

    6 days ago

    Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: KochiRemoteTrivandrumJob PurposeWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for...