Data Engineer

3 days ago

bangalore, India Keasis Full time

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities Data Ingestion & Pipeline Development= Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables. Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed. Optimize NiFi workflows for scalability, reliability, and monitoring. Data Lakehouse Enablement Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data. Ensure schema evolution, partitioning, and metadata management in Iceberg. Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & Orchestration Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights. Collaborate with Databricks teams to enable advanced analytics and machine learning use cases. Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & Governance Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization. Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable). Work with governance teams to enable lineage, metadata tracking, and auditability. Qualifications Bachelor’s degree in Computer Science, Information Systems, or related field. 5+ years of data engineering experience, with at least 2+ years working with Apache NiFi. Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark). Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction). Working knowledge of Snowflake and Databricks integration patterns. Proficiency in SQL and one programming language (Python, Java, or Scala). Understanding of data lakehouse architectures and ETL/ELT best practices.

  • Lead Data Engineer

    6 days ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    7 days ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Sr. Data Science

    3 weeks ago

    Bangalore, India NTT DATA Full time

    Job Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Data Engineer

    4 weeks ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key Responsibilities Data...

  • Lead Data Architect

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Architect to join our team in Bangalore Karnxc4x81taka IN-KA India IN Position Overview We are seeking a highly...

  • Azure Data Migration

    4 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 317094NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Data Migration to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Primary Responsibility...

  • Sr. Data Science

    4 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 312452NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Sr Data Science AIML GenAI Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties...

  • Mid Data Science

    4 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 312426NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties...

  • Technical specialist

    7 days ago

    Bangalore, India NTT DATA, Inc. Full time

    Senior L3+ Network Security Engineer (Fortinet SASE) Job Type: Full-time Experience: 6+ years in network security implementation We are seeking a Senior L3+ Network Security Engineer with 6+ years of hands-on implementation experience in Fortinet SASE/Cybersecurity. The ideal candidate will be responsible for designing, deploying, optimizing, and...

  • Data engineer

    4 weeks ago

    Bangalore, India Insight Global Full time

    JOB DESCRIPTION Insight Global is seeking a junior Data Engineer to join a large retail client remotely based in India. The Junior Data Engineer will support the identification and implementation of complex data, monitor and troubleshoot data engineering incidents and more. The Junior-level Data Engineer is expected to have 3+ years of experience. As a Data...