Data Engineer

17 hours ago

New Delhi, India Mastek Full time

Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms.Key Responsibilities:Data Ingestion & Pipeline Development Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables. Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed. Optimize NiFi workflows for scalability, reliability, and monitoring. Data Lakehouse Enablement Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data. Ensure schema evolution, partitioning, and metadata management in Iceberg. Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & Orchestration Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights. Collaborate with Databricks teams to enable advanced analytics and machine learning use cases. Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & Governance Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization. Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable). Work with governance teams to enable lineage, metadata tracking, and auditability.Qualifications:Bachelor’s degree in Computer Science, Information Systems, or related field. 5+ years of data engineering experience, with at least 2+ years working with Apache NiFi. Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark). Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction). Working knowledge of Snowflake and Databricks integration patterns. Proficiency in SQL and one programming language (Python, Java, or Scala). Understanding of data lakehouse architectures and ETL/ELT best practices.

  • Senior Data Engineer

    2 weeks ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    6 days ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Technical Specialist

    3 weeks ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Senior/Lead Data Engineer

    2 weeks ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Senior Software Engineer/Technical Lead

    4 days ago

    New Delhi, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Software Engineer

    4 days ago

    New Delhi, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products fromCisco, VMware, NetApp, Amazon AWS, EMC,...

  • Data Engineer

    4 days ago

    New Delhi, India Vista Applied Solutions Group Inc Full time

    Job Summary: Client is looking for Data Engineer and this is hybrid position in Bengaluru.Responsibilities: Data Engineering expertise is required with specific experience in data modeling using Google BigQuery as well as more advanced SQL capabilities. Minimum 5-10 years Data Engineering background, with specific Google BigQuery skills are mandatory....