MonoSpear Technologies

We are seeking a highly skilled and experienced Apache NiFi Engineer to join our data engineering team.

In this fully remote role, you will design, build, and manage robust and scalable data pipelines using Apache NiFi, supporting real-time and batch data processing.

The ideal candidate will have a strong background in data integration and workflow automation.

Experience with Cloudera DataFlow (CDF) or Cloudera NiFi is a strong advantage.

Key Responsibilities :.

- Design and implement complex data flows and pipelines using Apache NiFi.

- Develop reusable NiFi templates and optimize processor performance.

- Integrate NiFi with various systems including Kafka, databases, APIs, S3, HDFS, and cloud platforms.

- Monitor, debug, and maintain data flow performance and reliability.

- Ensure data security, governance, and compliance within the flow lifecycle.

- Work closely with DevOps and cloud engineering teams to support CI/CD processes.

- Mentor junior engineers and contribute to team-wide best practices.

Required Skills & Qualifications :.

- 5+ years of professional experience in data engineering, integration, or ETL development.

- Strong hands-on experience with Apache NiFi in enterprise environments.

- Experience with data formats like JSON, XML, Avro, Parquet.

- Familiarity with common protocols : REST APIs, SFTP, JDBC, Kafka, MQTT.

- Proficiency in Linux environments and scripting languages (e.g, Bash, Python).

- Solid understanding of data flow architecture, orchestration, and scheduling.

- Hands-on experience with cloud platforms (AWS, Azure, or GCP).

- Version control (Git), and experience working with CI/CD pipelines.

Preferred Qualifications :.

- Experience with Cloudera DataFlow (CDF) or deployments of NiFi within Cloudera platforms.

- Knowledge of related technologies : Apache Kafka, Hadoop, Spark, Hive.

- Exposure to monitoring/logging tools : Prometheus, Grafana, ELK Stack.

- Experience with containerization tools : Docker, Kubernetes.

- Relevant certifications (e.g Cloudera, AWS, or other big data platforms).