Senior Data Engineer

3 days ago

Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Location: KochiRemoteTrivandrum

Experience

5+ Years

Job Purpose

  • We are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data solutions on the AWS cloud. You will make critical architectural decisions, choosing the best-fit services from the AWS ecosystem to handle everything from real-time event streaming to large-scale batch processing.

Job Description / Duties and Responsibilities

  • Lead design of data solutions on AWS, selecting optimal services for data processing (EMR, Glue, EMR Serverless, Lambda), storage (Cassandra, Elasticsearch), and messaging (Kafka, SNS/SES)
  • Develop, test, and deploy scalable data pipelines using PySpark and Scala for batch and real-time streaming
  • Engineer and optimize OLTP data persistence layer using Cassandra for high-throughput workloads
  • Utilize Elasticsearch for search and analytics needs
  • Build and maintain real-time data backbone using Apache Kafka for event streaming
  • Implement AWS SNS/SES for asynchronous notifications
  • Create and manage complex data workflows using Apache Airflow
  • Work with product managers and developers to translate requirements into technical specifications
  • Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and cost-efficiency

Job Specification / Skills and Competencies

  • 5+ years experience building and managing complex data systems
  • Expert-level proficiency in PySpark and/or Scala
  • Deep hands-on AWS experience (EMR, Glue, Lambda, S3, EC2)
  • Strong experience designing data models in Cassandra and Elasticsearch
  • Demonstrable experience with real-time streaming using Apache Kafka
  • Proven ability with workflow orchestration using Apache Airflow
  • Strong analytical skills for technology selection and system design
  • Excellent problem-solving abilities and attention to detail
  • Strong communication and interpersonal skills
  • Ability to work independently and collaboratively
  • Capacity to quickly learn and adapt to new technologies
  • Good presentation skills
  • Pro-active problem solver and self-leader
  • 7+ years total experience

Any Additional Information/Specifics

  • Bachelor's/Master's in Computer Science, Data Science, Engineering or related field
  • Snowflake knowledge (good to have)
  • Prior consulting/contracting experience with tight deadlines
  • Ability to manage and nurture team of data engineers
  • Adhere to Information Security Management policies and procedures

  • Senior Data Engineer

    2 weeks ago

    Cochin, Kerala, India Careersteer services private limited Full time ₹ 96,000 - ₹ 1,80,000 per year

    SQL, Databricks, and Microsoft Fabric – foundational tools for data modelling, ETL, and data pipelinesETL Development & Data Automation – experience building and maintaining robust data pipelineCI/CD & Azure DevOps – managing code repositories and deployment workflowsCloud Platforms – proficiency in Azure services including Data Factory, Blob...

  • Senior Data Engineer

    3 days ago

    Cochin, Kerala, India DBiz ai solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About the Company: Dbiz is a high-performing product & engineering company that partners up with organizations to help build out digital solutions with the right technology at the right time, whilst being innovative by using technology in different ways. Requirements:Azure Synapse Analytics/ Azure DatabricksAzure Cloud , Azure Data Lake , Azure SQLData...

  • Data Architect

    7 days ago

    Cochin, Kerala, India G10X Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Opportunity : Role : Senior Data Architect (15 Years Experience). We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technical expertise and strong stakeholder management skills.Key Responsibilities : - Act as the architectural authority for Data...

  • Data Engineer

    3 days ago

    Cochin, Kerala, India NOV Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    This role is part of the Digital Technology Services team at NOV. As a Data Engineer, you'll support data and analytics initiatives by helping to build and maintain data pipelines, data infrastructure, and operationalize analytics applications. You'll have the opportunity to learn a wide variety of technologies and work closely with experienced engineers,...

  • Senior Data Analyst

    3 days ago

    Cochin, Kerala, India First Screen Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're Hiring: Senior Data Analyst with 7+ Years Experience in Power BI – Join Our New Kochi OfficeWe are a multinational company headquartered in the UAE, expanding to India with a new office in Infopark, Kochi—a leading IT hub in the region. This is an exciting opportunity to be part of our journey from the very beginning, contributing to the growth...

  • Data Engineer

    1 day ago

    Cochin, Kerala, India DIGITRELL Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    We are seeking an experienced and driven Data Engineer with 3-5 years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise,...

  • Data Engineer

    2 weeks ago

    Cochin, Kerala, India VGreenTek Full time ₹ 70,000 - ₹ 1,20,000 per year

    Job Role: Data EngineerExperience: 5+ yearsMode: Work from office / Hybrid (Kochi)Job Type: Full-time, PermanentNotice Period: daysJob Description:This role is a hands-on position responsible for the build and continued evolution of the data platform, business applications and integration tools. We are looking for a hands-on engineer that can recommend best...

  • Data Engineer

    3 days ago

    Cochin, Kerala, India Dynamed Healthcare Solutions Pvt. Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Engineer – Microsoft BI StackLocation: KochiJob Type: Full-timeExperience Level: 2-3 YearsJob Summary:We are seeking a skilledData Engineerwith hands-on experience in theMicrosoft BI stack, includingMS SQL Server, SSIS, SSAS, SSRS, ETL, andPower BI. The ideal candidate will be responsible for designing, building, and maintaining robust data...

  • Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description : Data Engineer Position : Data Engineer Experience : 2-4 Years Location : Remote Employment Type : Contract (6 Months) About the Role : We are seeking a motivated and skilled Data Engineer to join our data team on a 6-month contractual basis. The role focuses on developing and optimizing ETL pipelines, managing SQL Server...

  • Senior Ui Engineer

    1 day ago

    Cochin, Kerala, India Inciem Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Senior UI Engineers (2 positions)We're looking for Senior UI Engineers to craft seamless user experiencesIf you have hands-on experience with React, Laravel, , or WordPress, we want you on our team. Turn ideas into intuitive, high-quality interfaces that delight users.Experience: 35 years