Senior Data Engineer

2 days ago

Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Location: KochiRemoteTrivandrum

Experience

5+ Years

Job Purpose

  • We are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data solutions on the AWS cloud. You will make critical architectural decisions, choosing the best-fit services from the AWS ecosystem to handle everything from real-time event streaming to large-scale batch processing.

Job Description / Duties and Responsibilities

  • Lead design of data solutions on AWS, selecting optimal services for data processing (EMR, Glue, EMR Serverless, Lambda), storage (Cassandra, Elasticsearch), and messaging (Kafka, SNS/SES)
  • Develop, test, and deploy scalable data pipelines using PySpark and Scala for batch and real-time streaming
  • Engineer and optimize OLTP data persistence layer using Cassandra for high-throughput workloads
  • Utilize Elasticsearch for search and analytics needs
  • Build and maintain real-time data backbone using Apache Kafka for event streaming
  • Implement AWS SNS/SES for asynchronous notifications
  • Create and manage complex data workflows using Apache Airflow
  • Work with product managers and developers to translate requirements into technical specifications
  • Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and cost-efficiency

Job Specification / Skills and Competencies

  • 5+ years experience building and managing complex data systems
  • Expert-level proficiency in PySpark and/or Scala
  • Deep hands-on AWS experience (EMR, Glue, Lambda, S3, EC2)
  • Strong experience designing data models in Cassandra and Elasticsearch
  • Demonstrable experience with real-time streaming using Apache Kafka
  • Proven ability with workflow orchestration using Apache Airflow
  • Strong analytical skills for technology selection and system design
  • Excellent problem-solving abilities and attention to detail
  • Strong communication and interpersonal skills
  • Ability to work independently and collaboratively
  • Capacity to quickly learn and adapt to new technologies
  • Good presentation skills
  • Pro-active problem solver and self-leader
  • 7+ years total experience

Any Additional Information/Specifics

  • Bachelor's/Master's in Computer Science, Data Science, Engineering or related field
  • Snowflake knowledge (good to have)
  • Prior consulting/contracting experience with tight deadlines
  • Ability to manage and nurture team of data engineers
  • Adhere to Information Security Management policies and procedures

  • Senior Data engineer

    2 weeks ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Overview: Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management. Core Responsibilities:Build and manage high-volume data pipelines using...

  • Senior Data Engineer

    2 days ago

    Cochin, Kerala, India Entri Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Job Description: Senior Data EngineerLocation:  KochiExperience:  3-5 YearsTeam:  Data EngineeringDepartment:  EngineeringAbout EntriEntri is a leading vernacular EdTech platform helping millions of learners acquire skills and secure meaningful jobs. Our engineering vision stands on three core pillars - Stability at Scale,Innovation at the Bleeding...

  • Senior/Lead Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Job Title : Lead Data EngineerLocation : Kochi / TrivandrumExperience : 10 years Notice Period : Immediate to 15 daysPrimary Skills : AWS, PythonJob Overview : Seeking an experienced Senior/Lead Data Engineer to design and implement scalable data ingestion frameworks, ensure data quality and validation, and build robust APIs for seamless data...

  • Senior Data Engineer

    1 week ago

    Cochin, Kerala, India Careersteer services private limited Full time ₹ 96,000 - ₹ 1,80,000 per year

    SQL, Databricks, and Microsoft Fabric – foundational tools for data modelling, ETL, and data pipelinesETL Development & Data Automation – experience building and maintaining robust data pipelineCI/CD & Azure DevOps – managing code repositories and deployment workflowsCloud Platforms – proficiency in Azure services including Data Factory, Blob...

  • Senior Data Engineer

    2 days ago

    Cochin, Kerala, India DBiz ai solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About the Company: Dbiz is a high-performing product & engineering company that partners up with organizations to help build out digital solutions with the right technology at the right time, whilst being innovative by using technology in different ways. Requirements:Azure Synapse Analytics/ Azure DatabricksAzure Cloud , Azure Data Lake , Azure SQLData...

  • Lead Data Engineer

    2 weeks ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Lead Data EngineerLocation:Kochi / TrivandrumExperience:10+ yearsNotice Period:Immediate to 15 daysBudget:Up to ₹23 LPAPrimary SkillsCore: AWS, PythonJob OverviewSeeking an experiencedSenior/Lead Data Engineerto design and implement scalabledata ingestion frameworks, ensuredata quality and validation, and buildrobust APIsfor seamless data...

  • Senior Systems Engineer

    2 days ago

    Cochin, Kerala, India MBUZZ Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role DescriptionThis is a full-time role located in Kochi for aSenior Systems Engineer (Server)to join our dynamic Infrastructure team. The ideal candidate will bring deep technical expertise in server architecture, data center environments, and GPU-based computing solutions.The Senior Systems Engineer will be responsible for the design, implementation, and...

  • Data Architect

    6 days ago

    Cochin, Kerala, India G10X Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Opportunity : Role : Senior Data Architect (15 Years Experience). We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technical expertise and strong stakeholder management skills.Key Responsibilities : - Act as the architectural authority for Data...

  • Data Engineer

    2 weeks ago

    Cochin, Kerala, India ChiSquarelabs Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.IMMEDIATE JOINERS PREFERREDResponsibilitiesBuild & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.Data Architecture & Engineering: Work on...

  • Senior Data Analyst

    2 days ago

    Cochin, Kerala, India First Screen Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're Hiring: Senior Data Analyst with 7+ Years Experience in Power BI – Join Our New Kochi OfficeWe are a multinational company headquartered in the UAE, expanding to India with a new office in Infopark, Kochi—a leading IT hub in the region. This is an exciting opportunity to be part of our journey from the very beginning, contributing to the growth...