Data Engineer

6 days ago


Kottayam, Kerala, India SourceFuse Full time

SourceFuse Technologies hiring for Data Engineer with 3+ years for experience

Job Summary:

As a Data Engineer, you'll manage the invisible backbone of our analytics, building scalable data pipelines that fuel real-time insights for 630+ ships worldwide. Your work will turn raw data points into actionable intelligence, propelling machine learning models and AI-driven decisions that redefine how global operate. This isn't just ETL; it's mission-critical infrastructure.

You'll engineer the systems that feed our NOVA analytics dashboards for both our office colleagues and clients — ensuring our PARIS platform stays leagues ahead in a data-driven industry. If you're the type who thrives on taming chaotic data streams into crystal-clear insights, let's build the lighthouse that guides maritime innovation.

Key Responsibilities:

Build & Optimise Data Systems

(Focus: Core engineering work with a balance of pipelines and infrastructure)

● Create & maintain data highways: Develop and manage cloud-based data lakes, warehouses, and ETL/ELT pipelines [VK1] that ingest, process, and deliver data from 630+ ships and external sources

● Keep systems shipshape: Monitor cloud infrastructure performance, resolve bottlenecks, and ensure scalability/reliability for 24/7 maritime operations—no room for "set and forget."

● Secure the cargo: Implement data quality checks, encryption, and compliance standards (GDPR, SOC2) to protect sensitive maritime telemetry and operational data

● Automate the mundane: Use tools like Airflow to streamline workflows and reduce manual intervention in pipeline maintenance

Support Analytics & Troubleshoot Issues

(Focus: Enabling insights while keeping systems running smoothly)

● Fuel AI/ML engines: Partner with Data Scientists to prep datasets for predictive models (e.g., fuel efficiency, preventative maintenance, etc.) and troubleshoot pipeline issues impacting their work

● Solve data mysteries: Diagnose root causes of pipeline failures, data discrepancies, or MLOps hiccups—then implement fixes that prevent repeat headaches.

● Map the data terrain: Document source-to-target mappings, conduct data profiling, and clarify dependencies so analysts can self-serve without guesswork

● Stay curious: Experiment with new tools and techniques to improve data quality, system performance and pipeline resilience

Collaborate & Learn

(Focus: Teamwork and growth in a fast-paced environment)

● Be the glue: Work closely with onshore and offshore developers, IT Operations, and stakeholders across to deliver solutions that balance technical rigor with real-world usability

● Communicate clearly: Break down complex data concepts for non-technical audiences (think ship captains, not just engineers) and ask questions to avoid ambiguity

● Learn by doing: Shadow senior engineers, participate in code reviews, and absorb best practices to level up your craft—no prior maritime experience required, but curiosity is a must.

Experience & Qualifications:

● 3+ years' experience in a Data Engineering role using SQL, PySpark and AirFlow

● Strong understanding in Data Lake and Data Warehouse design best practices and principles

● Practical hands-on experience in cloud-based data services for ETL/ELT covering AWS EC2, S3 Storage and EMR

● Ability to manage and enhance infrastructure related to environments covering Spark, Hive, Presto

● Experience with databases such as Postgres, MySQL, Oracle

● Strong work ethic and ability to work independently on agreed goals

● Clear communication skills in English – both in speaking and writing

DESIRABLE

● Deployment experience and management of MLOps framework, such as AWS SageMaker AI, ECR

● Experience in other cloud platform and hybrid cloud infrastructure, e.g. GCP, Azure

● Experience in the maritime industry

Competencies:

Analysis & Problem Solving (Level 2): Uses critical thinking to address problems. Able to perform root cause analysis on complex problems to identify underlying trends and put forward well-thought out solutions to address the causes

Listening & Communication (Level 2): Focuses on the individual they are communicating with. Writes and expresses thoughts clearly adjusting as necessary to the audience. Asks questions to clarify.

Collaboration, Inclusion & Teamwork (Level 1): A good team player that is personable, friendly, polite and takes the time to know people. Collaborates with onshore and offshore colleagues well.

Customer Focus (Level 2): Understands the needs of the customer clarifying requirements and expectations. Adapts as necessary to changing requirements and is responsive, helpful with all requests. Sets high quality for service delivery.

Planning & Organising (Level 2): Uses the supplied tools for structured project planning for optimal time use. Balances competing priorities. Promptly Updates people when plans change and keeps them apprised of progress. Adjusts own plans based on FML strategies and plans.

Initiative (Level 2): Challenges existing ways of doing things. Looking for continuous improvement without being asked. Identifies ways to improve efficiency and effectiveness in own work and others in the team.

Accountability (Level 2): Responsible for delivery own work without unnecessary supervision. Always demonstrates integrity and ethical behavior being a role model for others. Invites constructive feedback adjusting actions accordingly. Thinks through mistakes made and finds ways to prevent reoccurrence.


  • Data Engineer

    2 days ago


    Kottayam, Kerala, India ValueLabs Full time

    Job Title: Data EngineerExperience: 6+ yrsLocation: HyderabadPrimary skill-Data Engineer, AWS Glue, Lambda, ETL, Python, Airflow ,SnowflakeJob Description:We are seeking a Data Engineer responsible for building, maintaining, and optimizing the infrastructure that enables data collection, storage, processing, and analysis. Responsibilities-* Design, develop,...

  • Data Engineer

    4 weeks ago


    Kottayam, Kerala, India VicTree Solutions Full time

    VicTree Solutions is hiring for a Data Engineer for a contract role.Job Title: Data EngineerLocation: RemoteExperience: 5-9 YearsEmployment Type: Contract (6 months renewable)Budget: 10-12 LPAShift – Australian shiftPositions - 2Requirements:Google Cloud Platform experienceAzure Databricks experienceExperience in DBTExperience with secure coding...

  • Data Engineering Lead

    11 hours ago


    Kottayam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview We are seeking an experienced data engineer to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. Design and develop data pipelines and workflows using AWS and Databricks.Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.Leverage Databricks for data...

  • Senior Data Scientist

    23 hours ago


    Kottayam, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineer PositionWe are seeking a skilled Big Data Engineer to lead the design, development, and maintenance of scalable data pipelines and ETL processes.About the RoleThe ideal candidate will have a strong background in data engineering and experience working with big data ecosystems. They will collaborate with stakeholders to gather requirements...

  • Chief Data Engineer

    16 hours ago


    Kottayam, Kerala, India beBeeDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Python DeveloperWe are seeking a skilled Python developer to join our team. As a key member of our engineering group, you will be responsible for designing, developing, and automating scalable ETL workflows using Python and Pandas.Key responsibilities include:Designing, developing, and automating scalable ETL workflows using Python and PandasImplementing and...


  • Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a seasoned data professional to lead our Global Intelligence Practice.The ideal candidate will have strong foundational skills in data warehousing and engineering, with exposure to various data architecture types.The successful candidate will work closely with client stakeholders to capture requirements,...


  • Kottayam, Kerala, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...


  • Kottayam, Kerala, India beBeeDataReconciliation Full time ₹ 18,73,000 - ₹ 23,45,000

    **Job Overview**We're seeking an experienced software engineer to spearhead data reconciliation between SQL and Snowflake platforms.**Key Responsibilities**Design, develop, and execute automated tests for data reconciliation between SQL and Snowflake Administer Streamlit data tools for comprehensive testing**Requirements**4-10 years of experience in software...


  • Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    The Role:We are seeking an experienced Data Engineer to join our team.


  • Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description">As a highly skilled Data Engineer, you will play a pivotal role in our organization by leveraging your expertise in data engineering and cloud technologies to drive business growth and innovation.With a strong background in Apache Ray, you will design, develop, and implement scalable and efficient data processing systems that meet the...