Data Engineer

3 days ago

Nagpur, India Keasis Full time

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms. Key Responsibilities Data Ingestion & Pipeline Development=Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables.Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed.Optimize NiFi workflows for scalability, reliability, and monitoring. Data Lakehouse EnablementBuild and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data.Ensure schema evolution, partitioning, and metadata management in Iceberg.Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & OrchestrationWork with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights.Collaborate with Databricks teams to enable advanced analytics and machine learning use cases.Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & GovernanceTune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization.Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable).Work with governance teams to enable lineage, metadata tracking, and auditability. QualificationsBachelor’s degree in Computer Science, Information Systems, or related field.5+ years of data engineering experience, with at least 2+ years working with Apache NiFi.Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark).Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction).Working knowledge of Snowflake and Databricks integration patterns.Proficiency in SQL and one programming language (Python, Java, or Scala).Understanding of data lakehouse architectures and ETL/ELT best practices.

  • Data Engineer

    3 weeks ago

    Nagpur, India Digivance Solutions Full time

    Senior Data Engineer (C2H)7+ yearsHyderabad (Hybrid)Need Immediate joiners Only Key skills :Strong Software Engineering experience with proficiency in at least one of the following programming languages: Java, Scala, Python or equivalent.Distributed data technologies (e.g. Hadoop, MapReduce, Spark, Kafka, Flink etc) for building efficient, large-scale ‘big...

  • Data Engineer

    2 weeks ago

    Nagpur, Maharashtra, India Betasys AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: Data Engineer + DatabricksLocation : MumbaiKey Skills & Experience:2+ years of hands-on experience with Databricks , including job optimization and performance tuning.4+ years in Data Engineering , with a solid foundation in data pipeline design, development, and implementation.Expertise in  PySpark  for large-scale data processing and...

  • Electrical Engineering Innovation Lead

    4 weeks ago

    Nagpur, India BDx Data Centers Full time

    COMPANY OVERVIEW: Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect...

  • Data Engineer Developer

    4 weeks ago

    Nagpur, India SHUL Ventures Pvt Ltd Full time

    Job Description: Position: Data Engineer Developer Experience: 5 to 8 years Salary: ₹2,00,000 – ₹3,00,000 per month Location: Nagpur Qualification : Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or related field. About the Role: We are looking for an experienced Data Engineer Developer with strong expertise in data...

  • Senior data engineer

    15 hours ago

    Nagpur, India Invoria Global Solutions Full time

    Invoria Global Solutions (IGS) is associated with a network of strategic consulting partners who work closely with top enterprise clients across India. This opportunity is being offered through our strategic partner, who holds a direct engagement with the end client. Selected candidates will be on our partner’s payroll and will be deployed to the...

  • Big Data Engineer

    4 weeks ago

    Nagpur, India Naukri E Hire Campaign Full time

    Role- Big data Experience- 3 to 5 yrs Location- Nagpur Interview mode- 2 Virtual round Notice period- 30 days Interview date- 23rd Aug Job Summary: We are looking for a skilled Big Data Developer with strong expertise in Apache Spark, Scala, and Linux to join our dynamic data engineering team. The ideal candidate will design, develop, and maintain big data...

  • Infocepts - Data Engineer

    7 days ago

    Nagpur, Maharashtra, India InfoCepts Technologies Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : - Position : Data Engineer Databricks. - Purpose of the Position : - Develop, support and steer end-to-end business intelligence using Databricks. - Location : Nagpur/ Pune/ Chennai/ Bangalore. Key Responsibilities : - Work with business analysts and data architects to translate requirements into technical...

  • Data Engineer with HRIS

    2 weeks ago

    Nagpur, India MyRemoteTeam Inc Full time

    About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Job Title: Senior Data Engineer (HRIS)Experience: 8+ YearsWork Mode: Remote - Pan IndiaShift:...

  • Data Engineer IRC273229

    4 weeks ago

    Nagpur, India GlobalLogic Full time

    DescriptionKeyskills – Must Have  Spark  Shell-Scripting  SQL  Scala  Big Data  AWS  AWS Glue  Redshift  AWS S3  AWS Lambda RequirementsBig Data Engineer, ETL Spark-Scale, SQL, AWS Glue & Redshift Job Description Requirements gathering and design/implementation for Big Data Lake on AWS cloud  Designing and implementing...

  • Data Engineer IRC273229

    2 weeks ago

    Nagpur, Maharashtra, India GlobalLogic Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    DescriptionKeyskills – Must Have Spark Shell-Scripting SQL Scala Big Data AWS AWS Glue Redshift AWS S3 AWS LambdaRequirementsBig Data Engineer, ETL Spark-Scale, SQL, AWS Glue & RedshiftJob Description Requirements gathering and design/implementation for Big Data Lake on AWS cloud Designing and implementing data ingestion...