Senior Data Engineer

1 day ago

Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Location: KochiRemoteTrivandrum

Experience

5+ Years

Job Purpose

  • We are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data solutions on the AWS cloud. You will make critical architectural decisions, choosing the best-fit services from the AWS ecosystem to handle everything from real-time event streaming to large-scale batch processing.

Job Description / Duties and Responsibilities

  • Lead design of data solutions on AWS, selecting optimal services for data processing (EMR, Glue, EMR Serverless, Lambda), storage (Cassandra, Elasticsearch), and messaging (Kafka, SNS/SES)
  • Develop, test, and deploy scalable data pipelines using PySpark and Scala for batch and real-time streaming
  • Engineer and optimize OLTP data persistence layer using Cassandra for high-throughput workloads
  • Utilize Elasticsearch for search and analytics needs
  • Build and maintain real-time data backbone using Apache Kafka for event streaming
  • Implement AWS SNS/SES for asynchronous notifications
  • Create and manage complex data workflows using Apache Airflow
  • Work with product managers and developers to translate requirements into technical specifications
  • Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and cost-efficiency

Job Specification / Skills and Competencies

  • 5+ years experience building and managing complex data systems
  • Expert-level proficiency in PySpark and/or Scala
  • Deep hands-on AWS experience (EMR, Glue, Lambda, S3, EC2)
  • Strong experience designing data models in Cassandra and Elasticsearch
  • Demonstrable experience with real-time streaming using Apache Kafka
  • Proven ability with workflow orchestration using Apache Airflow
  • Strong analytical skills for technology selection and system design
  • Excellent problem-solving abilities and attention to detail
  • Strong communication and interpersonal skills
  • Ability to work independently and collaboratively
  • Capacity to quickly learn and adapt to new technologies
  • Good presentation skills
  • Pro-active problem solver and self-leader
  • 7+ years total experience

Any Additional Information/Specifics

  • Bachelor's/Master's in Computer Science, Data Science, Engineering or related field
  • Snowflake knowledge (good to have)
  • Prior consulting/contracting experience with tight deadlines
  • Ability to manage and nurture team of data engineers
  • Adhere to Information Security Management policies and procedures

  • Senior Data Engineer

    1 day ago

    Cochin, Kerala, India Entri Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Job Description: Senior Data EngineerLocation:  KochiExperience:  3-5 YearsTeam:  Data EngineeringDepartment:  EngineeringAbout EntriEntri is a leading vernacular EdTech platform helping millions of learners acquire skills and secure meaningful jobs. Our engineering vision stands on three core pillars - Stability at Scale,Innovation at the Bleeding...

  • Senior Data Analyst

    1 week ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Senior Data Engineer

    2 weeks ago

    Cochin, Kerala, India Beinex Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    HighlightsExperience2 - 4 YearsJoining DateImmediate or max 30 days' Notice PeriodQualificationBachelor's Degree or Post Graduation in Computer Science, IT, or a related fieldJob DescriptionBeinex is looking for exceptional Data Engineers to join the league of extraordinary Data Analysts and Data Scientists of Beinex's esteemed client lineup. Out there, you...

  • Senior Systems Engineer

    1 day ago

    Cochin, Kerala, India MBUZZ Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role DescriptionThis is a full-time role located in Kochi for aSenior Systems Engineer (Server)to join our dynamic Infrastructure team. The ideal candidate will bring deep technical expertise in server architecture, data center environments, and GPU-based computing solutions.The Senior Systems Engineer will be responsible for the design, implementation, and...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Lead Data EngineerLocation:Kochi / TrivandrumExperience:10+ yearsNotice Period:Immediate to 15 daysBudget:Up to ₹23 LPAPrimary SkillsCore: AWS, PythonJob OverviewSeeking an experiencedSenior/Lead Data Engineerto design and implement scalabledata ingestion frameworks, ensuredata quality and validation, and buildrobust APIsfor seamless data...

  • Senior Network Engineer

    2 weeks ago

    Cochin, Kerala, India Japheth LLP Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are seeking a Senior Network Engineer with a minimum of 10 years of experience to drive the network infrastructure for complex AI and HPC projects, focusing on NVIDIA (Mellanox) and high-speed Ethernet/InfiniBand fabrics.Core ResponsibilitiesThe Senior Network Engineer will ensure the high performance, availability, and security of mission-critical data...

  • Data Engineer

    1 day ago

    Cochin, Kerala, India Populace World Solutions Full time ₹ 7,50,000 - ₹ 15,00,000 per year

    Position:Data Engineer LeadLocation:Kochi (Hybrid WFO)Experience:8+ yearsJob SummarySeeking a Data Engineer Lead with strong expertise in Databricks, PySpark, and cloud data engineering to modernize SAS-based applications into Python and Databricks-native solutions.Required QualificationsBachelor's degree in a relevant technical discipline.8+ years in data...

  • Data Engineer

    2 weeks ago

    Cochin, Kerala, India ChiSquarelabs Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.IMMEDIATE JOINERS PREFERREDResponsibilitiesBuild & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.Data Architecture & Engineering: Work on...

  • Data Engineer

    1 day ago

    Cochin, Kerala, India Dynamed Healthcare Solutions Pvt. Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Engineer – Microsoft BI StackLocation: KochiJob Type: Full-timeExperience Level: 2-3 YearsJob Summary:We are seeking a skilledData Engineerwith hands-on experience in theMicrosoft BI stack, includingMS SQL Server, SSIS, SSAS, SSRS, ETL, andPower BI. The ideal candidate will be responsible for designing, building, and maintaining robust data...

  • Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 10,80,000 - ₹ 60,00,000 per year

    Job Title: Data Engineer (Contract – 6 Months)Location: RemoteDuration: 6 MonthsCompensation: ₹90,000 per monthAbout the Role:We are looking for an experienced Data Engineer (4–6 years) to join on a 6-month contract. The role involves building and maintaining ETL pipelines, working with SQL Server 2019/2022 and SSIS, and integrating data from systems...