Data Engineer

4 weeks ago

New Delhi, India Mastek Full time

Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a critical role in enabling scalable, governed, and high-performance data platforms.Key Responsibilities:Data Ingestion & Pipeline Development Design, configure, and maintain NiFi data flows to extract, transform, and load data from Cloudera into Iceberg tables. Implement streaming and batch ingestion pipelines with NiFi processors and custom scripting where needed. Optimize NiFi workflows for scalability, reliability, and monitoring. Data Lakehouse Enablement Build and manage Apache Iceberg-based datasets for structured, semi-structured, and unstructured data. Ensure schema evolution, partitioning, and metadata management in Iceberg. Develop integration flows from Iceberg to Snowflake and Databricks for analytics, ML, and reporting use cases. Integration & Orchestration Work with Snowflake to ingest curated data from Iceberg for enterprise reporting and commercial insights. Collaborate with Databricks teams to enable advanced analytics and machine learning use cases. Integrate NiFi pipelines with orchestration tools (Airflow, Oozie, or AWS/Azure/GCP schedulers). Performance, Security & Governance Tune NiFi flows and Snowflake/Databricks ingestion for performance and cost optimization. Implement role-based security and ensure compliance (HIPAA, GDPR, SOX if applicable). Work with governance teams to enable lineage, metadata tracking, and auditability.Qualifications:Bachelor’s degree in Computer Science, Information Systems, or related field. 5+ years of data engineering experience, with at least 2+ years working with Apache NiFi. Strong experience with Cloudera ecosystem (HDFS, Hive, Impala, Spark). Hands-on expertise with Apache Iceberg (schema evolution, time travel, partitioning, compaction). Working knowledge of Snowflake and Databricks integration patterns. Proficiency in SQL and one programming language (Python, Java, or Scala). Understanding of data lakehouse architectures and ETL/ELT best practices.

  • Senior Data Engineer

    4 days ago

    New Delhi, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Scientist

    3 weeks ago

    New Delhi, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    3 weeks ago

    New Delhi, India Crayon Data Full time

    Role:Sr Data Scientist Experience level:5 to 7 years Location:ChennaiWhy Crayon? Why now? Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Technical Specialist

    2 days ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...

  • Azure Data Engineer

    2 days ago

    New Delhi, India Mars Data Insights Full time

    Hiring Azure Data Engineer (Azure / MS Fabric / SAP BW/BFC) position in remote locationsSkills: Microsoft Fabric (MS Fabric), SAP BW/BFC Data Integration, Apache Kafka, Azure cloud services, Azure Functions, Docker Containers, and Kafka for real-time data processing, python, DW, Data Gov & Security, data modelling, ETL/ELT processes, and performance tuning,...

  • Data Activity Monitoring

    2 days ago

    New Delhi, India NTT DATA, Inc. Full time

    Role: Data Activity Monitoring (DAM) Engineers – L1 & L2 Location:Chennai, India Education:BE / B.Tech / MCAinElectronics, Electrical, or Computer SciencePosition 1: DAM Engineer – L1 Experience:2 years Budget:₹5.85 LPA Key Responsibilities: Support day-to-day operations ofData Activity Monitoring tools . Monitor database and application activity to...

  • Senior Tableau Data Consultant

    3 weeks ago

    New Delhi, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams: Partner...

  • Senior Data Engineer

    1 week ago

    Delhi, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Software Engineer

    3 weeks ago

    New Delhi, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: HybridWho are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Senior Software Engineer

    3 weeks ago

    New Delhi, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai,...