Data Engineer – Apache NiFi

2 weeks ago

Bengaluru, Karnataka, India DIATOZ: Digital A to Z Solutions Full time US$ 90,000 - US$ 1,20,000 per year

Position Overview

We are seeking a highly skilled 
Data Engineer
 with strong expertise in 
Apache NiFi
 and 
Groovy scripting
 to design and implement robust data pipelines. The role involves building scalable data flows, automating ingestion and transformation, and integrating multiple enterprise systems using NiFi and Groovy.

Key Responsibilities

  • Design, develop, and maintain 
    end-to-end data pipelines
     using Apache NiFi.
  • Write and maintain 
    Groovy scripts
     for advanced data transformation, parsing, validation, and enrichment.
  • Build reusable components and templates for 
    data ingestion, routing, and processing
    .
  • Integrate NiFi with 
    databases, APIs, messaging systems (Kafka, JMS, MQTT), and cloud platforms (AWS/Azure/GCP)
    .
  • Implement 
    data quality checks, schema validation, and error handling
     within NiFi flows.
  • Ensure 
    data lineage, provenance, and governance compliance
     across all pipelines.
  • Monitor, troubleshoot, and optimize NiFi flows for 
    scalability, performance, and reliability
    .
  • Work closely with Data Scientists, Analysts, and Architects to deliver business-ready datasets.
  • Support 
    CI/CD automation for NiFi pipelines
     and version control using Git.

Required Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, or related field.
  • 3+ years of hands-on experience
     in building pipelines with 
    Apache NiFi
    .
  • Strong expertise in 
    Groovy scripting
     for NiFi data transformations and custom logic.
  • Experience with 
    data formats
    : JSON, XML, CSV, Avro, Parquet.
  • Solid understanding of 
    databases (SQL/NoSQL)
     and API integrations.
  • Familiarity with 
    Linux/Unix environments
    , shell scripting, and automation.
  • Experience with 
    version control (Git/GitLab/Bitbucket)
    .

Preferred / Nice to Have

  • Exposure to 
    real-time streaming platforms
     (Kafka, Spark Streaming, Flink).
  • Experience with 
    cloud data services
     (AWS Glue, S3, Kinesis, Azure Data Factory, GCP Dataflow).
  • Knowledge of 
    DevOps practices
     (Docker, Kubernetes, Jenkins, Ansible).
  • Familiarity with 
    monitoring/observability tools
     (Prometheus, Grafana, ELK stack).
  • Awareness of 
    data governance, security, and compliance standards
     (GDPR, HIPAA).

Soft Skills

  • Strong analytical and problem-solving ability.
  • Ability to translate business requirements into 
    data pipelines and flows
    .
  • Collaborative mindset for working with cross-functional teams.
  • Self-motivated and eager to learn emerging data engineering tools.

Compensation & Benefits

  • Competitive salary and benefits package.
  • Health insurance and employee wellness programs.
  • Hybrid/remote working options.
  • Professional development and certification sponsorship.
  • Collaborative and innovative work culture.

  • Apache NiFi Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Myliara Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're Hiring: NiFi Data Engineer (Contract | 6–10 Years Experience)Location:Hyderabad (Preferred) | Bangalore | Mumbai | Chennai | Ahmedabad | PuneWork Mode:Hybrid – 2 Days/Week from Mindtrilogy Office (Mandatory)Notice Period:Immediate Joiners OnlyNo. of Positions:2Job Type:ContractAbout the RoleMindtrilogyis seekingexperienced NiFi Data Engineers...

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryJD Data Pipeline Engineer 1 Position(U4) Key Responsibilities: Design, develop, and maintain data pipelines using Apache NiFi Translate functional requirements into clear technical tasks and implementation logic Integrate and interact with relational or NoSQL databases for data ingestion and storage Collaborate with cross functional teams to...

  • Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Location : Bangalore Experience : 10-15 Company : EdgeVerve Systems Limited About EdgeVerve : EdgeVerve, a subsidiary of Infosys, is a global leader in building innovative products that enable digital transformation for enterprises. Our AI-powered platforms are redefining the future of work, enabling clients to unlock operational...

  • Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Location : Bangalore Experience : 10-15 Company : EdgeVerve Systems Limited About EdgeVerve : EdgeVerve, a subsidiary of Infosys, is a global leader in building innovative products that enable digital transformation for enterprises. Our AI-powered platforms are redefining the future of work, enabling clients to unlock operational efficiency, drive...

  • Big Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data ArchitectLocation - Bangalore/ PuneExperience: 10Yrs to 16 YearsExperienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling Integrator/Talend/Informatica.)...

  • Big Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data Architect Location - Bangalore/ Pune Experience: 10Yrs to 16 Years Experienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling...

  • Lead Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Michael Page Full time

    Job Description- Be a part of large Conglomorate's central team- Stable and large scale of operationsJob Description- Architect and build scalable data ingestion, transformation, and processing pipelines on Azure Data Lake and Databricks.- Lead migration from legacy systems to modern, cloud-native data platforms.- Implement data governance and cataloging...

  • Principal Apache Hive Engineer

    1 week ago

    Bengaluru, Karnataka, India BairesDev Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.When you apply for this position, you're...

  • Technical Lead- Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • GCP Engineer

    3 days ago

    Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    **Job Title: Cloud FullStack / GCP EngineerTotal Experience: 5+ YearsRelevant Experience: 5+ YearsLocation : BangaloreJob SummaryWe are seeking an experiencedGCP Cloud Engineer / FullStack Cloud Developerto manage and administerGoogle Cloud Platform services**. The ideal candidate will have hands-on experience with GCP products, cloud administration, and...