Data Engineer

4 days ago


india, IN Keasis Full time

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms.

Key Responsibilities

Data Ingestion & Pipeline Development=

Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables.

Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed.

Optimize NiFi workflows for scalability, reliability, and monitoring.

Data Lakehouse Enablement

Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data.

Ensure schema evolution, partitioning, and metadata management in Iceberg.

Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases.

Integration & Orchestration

Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights.

Collaborate with Databricks teams to enable advanced analytics and machine learning use cases.

Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers).

Performance, Security & Governance

Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization.

Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable).

Work with governance teams to enable lineage, metadata tracking, and auditability.

Qualifications

Bachelor’s degree in Computer Science, Information Systems, or related field.

5+ years of data engineering experience, with at least 2+ years working with Apache NiFi.

Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark).

Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction).

Working knowledge of Snowflake and Databricks integration patterns.

Proficiency in SQL and one programming language (Python, Java, or Scala).

Understanding of data lakehouse architectures and ETL/ELT best practices.


  • Data Engineer

    2 weeks ago


    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    4 days ago


    india, IN Insight Global Full time

    Job DescriptionInsight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion. You will be assisting the Data and Analytics team on one of the company's largest game titles set to launch this fall. Your day-to-day will be...

  • Data Engineer

    19 hours ago


    , India, IN KPG99 INC Full time

    Role- Databricks EngineerLocation- Remote Duration- 12+ months with ExtensionsREQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles- Strong hands-on experience with Databricks for data processing and pipeline development.- Proficiency in SQL for data querying, transformation, and troubleshooting.- Solid programming skills in...

  • Data Engineer

    19 hours ago


    india, IN Insight Global Full time

    Position: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...

  • Data Engineer

    2 weeks ago


    india, IN Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    4 days ago


    india, IN Response Informatics Full time

    We’re Hiring | Data Engineering Experts (Hyderabad / Remote)We’re looking for passionate and experienced Data Engineering professionals to join our growing team.If you love building scalable data pipelines, optimizing cloud-based workflows, and leading innovation in data infrastructure — we’d love to meet you! Open Positions:Data Engineer – 8 to...

  • Data Engineer

    4 days ago


    india, IN NuVision Auto Glass Full time

    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield replacement and expert auto glass services, ensuring convenience and safety at every step.With seamless insurance claims, easy financing options for cash payments,...

  • Data Engineer

    3 days ago


    india, IN Magma Consultancy Part time

    Location: RemoteType: Part-time (20–25 hours per week)About the RoleWe are seeking a skilled Data Engineer to support our growing data operations on a part-time basis. The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers, and business teams to...

  • Data Engineer

    4 days ago


    india, IN Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Data Engineer

    2 weeks ago


    india, IN Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing web...