Big Data Engineer

1 week ago


Cochin, Kerala, India NarrowLabs Technologies Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role: Big Data Engineer

Exp: 4 - 8 Years

Mode of Work: On-site

Employment Type: Full-time

Location: KochiJob Description

Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems

Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.

Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases.

Optimize and tune data pipelines for performance, scalability, and reliability.

Monitor and troubleshoot pipeline performance issues, identifying and resolving bottlenecks.

Ensure data quality and integrity throughout the pipeline, implementing data validation and error handling mechanisms.

Stay updated on emerging technologies and best practices in big data processing and analytics, incorporating them into our data engineering practices.

Document design decisions, technical specifications, and data workflows.

Mandatory Qualification:

Bachelor's degree in computer science, Engineering, or related field. Master's degree preferred.

Proven experience (3+ years) as a Data Engineer or similar role, with a focus on big data processing.

Strong proficiency in programming languages such as Python, Java, & Scala.

Experience with big data processing frameworks and technologies such as Apache Hadoop, Spark, Kafka, Flink, etc.

Hands-on experience with distributed computing, parallel processing, and cloud-based data platforms (e.g., AWS, Azure, Google Cloud).

Proficiency in SQL and database technologies (e.g., SQL Server, PostgreSQL, MySQL).

Experience with data warehousing, ETL (Extract, Transform, Load) processes, and data modeling.

Familiarity with containerization technologies (e.g., Docker, Kubernetes) and DevOps practices.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Tools and Technologies:

IDEs: IntelliJ IDEA, Eclipse

Build Tools: Maven, Gradle

Testing Frameworks: JUnit, Mockito, TestNG

Containerization: Docker, Kubernetes

API Documentation: Swagger, OpenAPI

Monitoring and Logging: Prometheus, Grafana, ELK Stack

Database: MySQL, PostgreSQL, MongoDB, Redis

ORM Frameworks: Hibernate, Spring Data

Message Brokers: Kafka


  • Data Engineer

    2 weeks ago


    Cochin, Kerala, India Prevalent AI Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role purpose Are you passionate about cutting-edge technology and big data? At Prevalent AI, we're at the forefront of building innovative solutions to handle petabyte-scale data. As a Data Engineer, you will play a pivotal role in supporting the development of key data engineering components for our Data Fabric and Exposure Management products.In this...


  • Cochin, Kerala, India DBiz ai solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Dbiz is a high-performing product and engineering company that partners with organizations to build digital solutions using the right technology at the right time. We pride ourselves on our innovative approach, leveraging technology in diverse and impactful ways.We are looking for an Experienced Data Engineer with a strong background in DataBricks or...

  • Senior Data engineer

    2 weeks ago


    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Overview: Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management. Core Responsibilities:Build and manage high-volume data pipelines using...


  • Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: KochiRemoteTrivandrumJob PurposeWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for...

  • Data Architect

    4 days ago


    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Architect Job Summary:We are looking for a seasoned and visionary Data Architect with over 14 years of experience to lead the design and implementation of enterprise-grade data architecture, governance frameworks, and scalable data platforms. This role requires deep expertise in modern data technologies, big data ecosystems, and cloud-native solutions....

  • Data Architect

    2 weeks ago


    Cochin, Kerala, India Litmus7 Systems Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Architect is responsible to define and lead the Data Architecture, Data Quality, Data Governance, ingesting, processing, and storing millions of rows of data per day. This hands-on role helps solve real big data problems.You will be working with our product, business, engineering stakeholders, understanding our current eco-systems, and then building...


  • Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...

  • Data Scientist

    1 week ago


    Cochin, Kerala, India Simelabs - Digital, AIML, Automation, Robotics, Gen AI. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a passionate and innovativeAI/ML Engineerto join our team and drive cutting-edge AI solutions across traditional machine learning, deep learning, and generative AI. If you enjoy solving complex problems, experimenting with the latest AI technologies, and building real-world applications, we'd love to connect.Key ResponsibilitiesDesign,...


  • Cochin, Kerala, India BIG Security Networks Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title:Documentation Engineer: (ELV/Telecom Systems)Location:Kochi, KeralaEmployment Type:Full-timEWe are seeking a detail-oriented Documentation Generation Engineer to manage, prepare, and maintain all project documentation for our TELECOM/ELV (Extra Low Voltage) systems, including TELECOM/IT/CCTV, Access Control, Public Address, Fire Alarm, BMS, and...

  • Data Architect

    3 days ago


    Cochin, Kerala, India Milestone Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...