Big Data Engineer

2 weeks ago

Cochin, Kerala, India NarrowLabs Technologies Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role: Big Data Engineer

Exp: 4 - 8 Years

Mode of Work: On-site

Employment Type: Full-time

Location: KochiJob Description

Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems

Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.

Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases.

Optimize and tune data pipelines for performance, scalability, and reliability.

Monitor and troubleshoot pipeline performance issues, identifying and resolving bottlenecks.

Ensure data quality and integrity throughout the pipeline, implementing data validation and error handling mechanisms.

Stay updated on emerging technologies and best practices in big data processing and analytics, incorporating them into our data engineering practices.

Document design decisions, technical specifications, and data workflows.

Mandatory Qualification:

Bachelor's degree in computer science, Engineering, or related field. Master's degree preferred.

Proven experience (3+ years) as a Data Engineer or similar role, with a focus on big data processing.

Strong proficiency in programming languages such as Python, Java, & Scala.

Experience with big data processing frameworks and technologies such as Apache Hadoop, Spark, Kafka, Flink, etc.

Hands-on experience with distributed computing, parallel processing, and cloud-based data platforms (e.g., AWS, Azure, Google Cloud).

Proficiency in SQL and database technologies (e.g., SQL Server, PostgreSQL, MySQL).

Experience with data warehousing, ETL (Extract, Transform, Load) processes, and data modeling.

Familiarity with containerization technologies (e.g., Docker, Kubernetes) and DevOps practices.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Tools and Technologies:

IDEs: IntelliJ IDEA, Eclipse

Build Tools: Maven, Gradle

Testing Frameworks: JUnit, Mockito, TestNG

Containerization: Docker, Kubernetes

API Documentation: Swagger, OpenAPI

Monitoring and Logging: Prometheus, Grafana, ELK Stack

Database: MySQL, PostgreSQL, MongoDB, Redis

ORM Frameworks: Hibernate, Spring Data

Message Brokers: Kafka

  • Data Engineer Big Data

    2 days ago

    Cochin, Kerala, India Litmus7 Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems.Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases.Optimize...

  • Data Engineer

    8 hours ago

    Cochin, Kerala, India Pumex Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions.Job Title: Data...

  • Senior Data Engineer

    19 hours ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time

    Role Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...

  • Data Engineer II

    4 days ago

    Cochin, Kerala, India Reply Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Valorem Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems. Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience implementing Big Data with Advanced Analytics...

  • Data Architect

    1 week ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Architect Job Summary:We are looking for a seasoned and visionary Data Architect with over 14 years of experience to lead the design and implementation of enterprise-grade data architecture, governance frameworks, and scalable data platforms. This role requires deep expertise in modern data technologies, big data ecosystems, and cloud-native solutions....

  • Senior Data Engineer

    1 week ago

    Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...

  • Data Scientist

    2 weeks ago

    Cochin, Kerala, India Simelabs - Digital, AIML, Automation, Robotics, Gen AI. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a passionate and innovativeAI/ML Engineerto join our team and drive cutting-edge AI solutions across traditional machine learning, deep learning, and generative AI. If you enjoy solving complex problems, experimenting with the latest AI technologies, and building real-world applications, we'd love to connect.Key ResponsibilitiesDesign,...

  • Data Architect

    1 week ago

    Cochin, Kerala, India Milestone Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • ELV/Telecom Documentation Engineer

    2 weeks ago

    Cochin, Kerala, India BIG Security Networks Full time ₹ 4,50,000 - ₹ 9,00,000 per year

    Documentation for ELV/Telecom including:Method StatementsMaterial SubmittalsITP DocumentsCommissioning Procedure (SAT, FAT )Test Reports & Inspection ChecklistsCo-ordinationCoordinate with onsite project engineers to collect technical data.

  • QA Engineer

    2 weeks ago

    Cochin, Kerala, India VidPro Consultancy Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    About The RoleWe are looking for talented QA professionals at multiple levels (Lead, Sr. QA, and QA Engineer) to join our team. The ideal candidates should have strong experience inData Testing, UI Testing, and Automation, with exposure toBig Data projects (Azure DBT, MSBI, etc.). Candidates should also be open to learning and adoptingAI-driven testing...