Data Integration Engineer

1 day ago

Bengaluru Karnataka India, Karnataka LumenData Full time

Job Title: Data Integration Engineer

Location: [Add Location or mention “Remote/Hybrid”]

Company: LumenData

Role Overview

We are seeking a Data Integration Engineer with expertise in building and orchestrating data pipelines using Apache Airflow to integrate data from diverse sources into Snowflake.

The ideal candidate will have strong experience with JDBC and API-based integrations (REST/JSON), hands-on proficiency with Postman, and solid skills in SQL encryption/decryption, Python development, and pipeline monitoring.

Key Responsibilities

  • Design, develop, and maintain Airflow DAGs to orchestrate end-to-end data workflows.
  • Integrate structured and unstructured data from multiple systems into Snowflake using JDBC connectors, APIs, and flat-file ingestion.
  • Use Postman and other tools to test, validate, and automate API integrations.
  • Implement SQL encryption/decryption techniques to protect sensitive datasets.
  • Perform data quality checks, including row-level validation, hash-based reconciliation, and exception handling.
  • Develop transformation logic using Python and SQL, ensuring performance, scalability, and maintainability.
  • Implement detailed logging, monitoring, and alerting to ensure pipeline reliability and compliance.
  • Collaborate with stakeholders to understand requirements and deliver scalable, production-ready solutions.

Required Skills & Experience

  • Strong proficiency in Apache Airflow for workflow orchestration.
  • Hands-on experience with Snowflake as a data warehouse.
  • Proven ability to integrate data via JDBC drivers, REST APIs, and Postman-tested endpoints.
  • Advanced knowledge of SQL, including encryption/decryption techniques.
  • Strong programming skills in Python for ETL/ELT development.
  • Experience with logging, monitoring, and data observability practices.

  • Data Entry Operator

    2 hours ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Integration Engineer

    4 days ago

    Bengaluru, Karnataka, India Employee Hub Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Data Integration EngineerLocation: BangaloreEmployment Type: Full-timeRole OverviewWe are seeking a motivated and skilled Data Integration Engineer to join our dynamic engineering team. In this role, you will play a key part in integrating, transforming, and managing large-scale data that drives intelligent decision-making across the organization.Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Integration Engineer

    4 days ago

    Bengaluru, Karnataka, India Grizmo Labs Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Description : Position : Data Integration Engineer Experience : 2-5 Years Location : Bangalore Industry Type : Logistics / Supply Chain Technology (Assumed) Education : Bachelor's degree in Computer Science or a related field.Job Summary : We are seeking a proactive Data Integration Engineer with 2-5 years of hands-on experience in building...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Integration Engineer

    1 hour ago

    Bengaluru, Karnataka, India RM Technologies Full time ₹ 14,00,000 - ₹ 15,00,000 per year

    Job Title:Data Integration EngineerLocation:BangaloreJob Type:Full-timeExp: 4+Immediate Joiners Only max 30 daysBudget 15 LPABudjet:14 LPARole OverviewWe are seeking a highly motivatedData Integration Engineerto join our engineering team. In this role, you will be responsible for designing and maintaining scalable data pipelines, integrating diverse data...

  • Systems Integration Analyst

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Design and implement integration flows using IDMC CAI, supporting real-time and batch data processes. Develop and manage REST/SOAP APIs, event-driven services, and process orchestration workflows. Collaborate with cross-functional teams to translate integration requirements into scalable and maintainable solutions. Configure and maintain connections to...

  • Data & AI Engineer Lead

    7 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...

  • Data Integration Engineer

    2 days ago

    Bengaluru, Karnataka, India Synclovis Systems Pvt Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role OverviewWe are seeking a motivated Data Integration Engineer to join our engineering team. This individual will play a critical role in integrating and transforming large-scale data to power intelligent decision-making systems.Key ResponsibilitiesDesign, build, and maintain data pipelines and APIs using Python.Integrate data from various sources...