Senior data engineer – etl

1 day ago

Malappuram, India AIMLEAP Full time

Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 2 Educational Qualification: B. E / B. Tech / M. Tech / MCA / Computer Science / IT Industry: IT / Data / AI / Legal Tech / Enterprise Solutions Notice Period: Immediate Joiners Preferred What We Are Looking For: 7–12 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL. Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers). Solid experience in writing complex SQL queries , optimizing database performance, and designing schemas for large-scale systems. Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines. Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, Big Query, etc.). Practical exposure to Docker, Kubernetes , and CI/CD pipelines for automating and deploying ETL and data workloads. Familiarity with AI-driven data pipelines or automation workflows is an added advantage. Responsibilities: Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems. Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality. Build and maintain high-performance SQL queries and database structures to support analytics and AI teams. Develop and integrate API-based data ingestion systems (internal and external). Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control. Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions . Implement data validation, monitoring, and alerting mechanisms for production pipelines. Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments. Qualifications: Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. Proficiency in Python (Fast API, Flask, or Django) , SQL , and REST API design . Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster). Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components. Hands-on exposure to Docker, Kubernetes , and Git-based CI/CD workflows. Excellent problem-solving, debugging, and analytical skills with an ownership mindset .

  • Senior data engineer

    6 days ago

    Malappuram, India SAIVA AI Full time

    We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.This is a fully remote role, open to candidates based in Europe or India, with...

  • Data Engineer

    3 weeks ago

    Malappuram, India Velodata Global Pvt Ltd Full time

    Data EngineerPosition DetailsRole: Data EngineerExperience: 5 + yrsWork Mode: First week in office, Remote/HybridLocations: Trivandrum (Primary), Kochi (Secondary)Budget: ₹9.6L – ₹14LNotice Period: Immediate joinersWorking Hours: Normal shiftJoining Date: 27 October 2025Key ResponsibilitiesDevelop & maintain ETL pipelines for multiple source systems...

  • Data Engineer

    3 weeks ago

    Malappuram, India Velodata Global Pvt Ltd Full time

    Data EngineerPosition DetailsRole: Data EngineerExperience: 5 + yrsWork Mode: First week in office, Remote/HybridLocations: Trivandrum (Primary), Kochi (Secondary)Budget: ₹9.6L – ₹14LNotice Period: Immediate joinersWorking Hours: Normal shiftJoining Date: 27 October 2025Key ResponsibilitiesDevelop & maintain ETL pipelines for multiple source systems...

  • Data engineer

    3 weeks ago

    Malappuram, India Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • ETL Testing(SQL+Bigquery)

    6 hours ago

    Malappuram, India UST Full time

    Job Description We are looking for a meticulous and proactive ETL Tester to ensure the accuracy, reliability, and performance of data pipelines built on Google Cloud Platform. This role involves validating ETL workflows, reconciling data across systems, and collaborating with developers and business stakeholders to uphold data quality standards. The ideal...

  • Data Engineer

    3 weeks ago

    Malappuram, India Manuh Technologies Full time

    Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines to process structured and unstructured data.Build and optimize data lakes and data warehouses using AWS services (e.g., S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using Python for data integration, validation, and transformation.Collaborate with data analysts, data...

  • Aws data engineer

    2 days ago

    Malappuram, India Randstad Digital Full time

    Job Role: Aws Data Engineer Location: Kochi Experience:-6-13years Note: Inperson Interview-Kochi Immediate joiners or below 10 days Notice period candidates preferred Job Description Key Responsibilities Typical job descriptions include the following core responsibilities: Data Pipeline Development: Design, build, and maintain Extract, Transform, Load (ETL)...

  • Senior Associate, Data Management

    2 days ago

    Malappuram, India Whatjobs IN C2 Full time

    KMK is a global data analytics and technology consulting company empowering leaders across the Life Sciences industries to make better data-driven decisions. Our data analytics and software platforms support data science, commercial operations, real-world evidence, and cloud information management. We help to optimize business strategy and operations by...

  • Sr. Data Architect

    4 weeks ago

    Malappuram, India Reflections Info Systems Full time

    We are looking for 10+ years experienced Sr. Data Architect - A minimum of 10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lake platforms. - The candidate should possess a strong background in both Snowflake and SAP BW/ECC environments, demonstrating leadership in technical design, architecture,...

  • Data Consultant

    17 hours ago

    Malappuram, India Plative Full time

    The Data Consultant plays a key role in designing, implementing, and supporting data integration and analytics solutions across Salesforce, NetSuite, and other enterprise systems. This position focuses primarily (~80%) on Salesforce–NetSuite integration and data migration projects, ensuring seamless data flow across front-office and back-office platforms....