Freelance Apache NiFi + GCP Data Engineer

7 days ago

Delhi, India ThreatXIntel Full time

Company DescriptionThreatXIntel is a startup cybersecurity company specializing in protecting businesses and organizations from cyber threats. We offer services including cloud security, web and mobile security testing, DevSecOps, and cloud security assessments to deliver customized, affordable solutions tailored to client needs. Committed to proactive security, we continuously monitor and test digital environments to mitigate vulnerabilities before they can be exploited. Our mission is to empower businesses of all sizes with high-quality cybersecurity services to protect their digital assets and enable business growth.Role DescriptionWe are seeking an experiencedFreelance Data Engineerwith strong expertise inApache NiFiand theGoogle Cloud Platform (GCP)ecosystem. The consultant will design and implement real-time data ingestion pipelines, integrate with GCP services, and ensure secure, scalable, and high-performance data delivery for analytics and downstream platforms.Key ResponsibilitiesDesign and buildreal-time ingestion pipelinesusingApache NiFifor structured and unstructured datasets.Integrate NiFi pipelines with theGCP ecosystem , includingBigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer (Airflow) .Implementlow-latency, high-throughputdata movement across ingestion, storage, and processing layers.Develop and optimizeSQL queriesfor BigQuery and relational systems.BuildPython scriptsfor data transformations, automation tasks, and custom NiFi processors.Applydata quality , validation, deduplication, and error-handling frameworks within ingestion flows.Work with analysts, data scientists, and platform teams to deliver clean, reliable, analytics-ready datasets.EnforceGCP IAM ,VPC Service Controls , encryption policies, and secure-by-design practices.Monitor, troubleshoot, and tune NiFi processor performance and GCP data pipelines.Document data flows, architecture standards, and operational best practices.Required Skills & QualificationsStrong hands-on experience with Apache NiFifor real-time ingestion, routing, transformation, and flow orchestration.Deep expertise across theGCP ecosystem :Pub/Sub (event ingestion & streaming)BigQuery (data warehousing & SQL optimization)Dataflow / Apache Beam (stream & batch processing)Cloud Storage (data lake)Dataproc (Spark/Hadoop processing)Composer/Airflow (workflow orchestration)Strong proficiency inSQL(analytic functions, optimization, partitioning, clustering).StrongPythondevelopment for automation and data processing.Solid understanding ofreal-time streamingconcepts: windowing, late data handling, deduplication, event ordering.Knowledge ofdata architecturepatterns (ETL/ELT, data lakes, data warehouses).Experience withCI/CD , Git-based workflows, and infrastructure-as-code (nice to have).Understanding ofcloud security , IAM roles, governance controls, and compliance in GCP environments.

  • Freelance – Apache NiFi

    3 days ago

    Delhi, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a dynamic cybersecurity startup dedicated to protecting businesses and organizations against cyber threats. Specializing in services such as cloud security, DevSecOps, and vulnerability testing, the company offers tailored, cost-effective solutions to meet clients' unique requirements. Focused on startups and small...

  • Freelance GCP Data Engineer

    5 days ago

    Delhi, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup specializing in cybersecurity, offering tailored and cost-effective solutions for businesses and organizations of all sizes. Our expertise spans cloud security, web and mobile security testing, cloud security assessments, DevSecOps, and more. Driven by a proactive approach, we monitor and test our clients' digital...

  • Freelance – Apache NiFi

    3 days ago

    Delhi, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a dynamic cybersecurity startup dedicated to protecting businesses and organizations against cyber threats. Specializing in services such as cloud security, DevSecOps, and vulnerability testing, the company offers tailored, cost-effective solutions to meet clients' unique requirements. Focused on startups and small...

  • Freelance GCP Data Engineer

    4 days ago

    New Delhi, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup specializing in cybersecurity, offering tailored and cost-effective solutions for businesses and organizations of all sizes. Our expertise spans cloud security, web and mobile security testing, cloud security assessments, DevSecOps, and more. Driven by a proactive approach, we monitor and test our clients' digital...

  • Freelance – Apache NiFi

    2 days ago

    New Delhi, India ThreatXIntel Full time

    Company Description ThreatXIntel is a dynamic cybersecurity startup dedicated to protecting businesses and organizations against cyber threats. Specializing in services such as cloud security, DevSecOps, and vulnerability testing, the company offers tailored, cost-effective solutions to meet clients' unique requirements. Focused on startups and small...

  • Data Solutions Specialist

    2 days ago

    delhi, India beBeeDataEngineer Full time

    Job OpportunityWe are seeking a Freelance Data Engineer to develop scalable solutions leveraging Apache NiFi and Google Cloud Platform services.The ideal candidate will design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured datasets, integrate ingestion and processing pipelines with the GCP ecosystem, ensure...

  • Cloud Data Engineer Position

    4 days ago

    delhi, India beBeeData Full time

    Cloud Data Engineer RoleWe are seeking a skilled Freelance GCP Data Engineer to design, implement and optimize real-time data pipelines.Create efficient data ingestion pipelines using Apache NiFi for structured and unstructured data.Integrate data pipelines with the GCP ecosystem including BigQuery, Pub/Sub, Dataflow, Dataproc and Cloud Storage.Evaluate...

  • Apache NiFi

    3 weeks ago

    Delhi, India SES IT Full time

    We are looking for an 7-10 years experienced Apache NiFi developer with strong hands-on expertise in end-to-end implementation, API integration, and 3rd-party software integrations. Role Highlights - Build & optimize end-to-end Apache NiFi data flows - Integrate with REST APIs, SaaS tools, CRMs/ERPs, partner systems - Handle transformations (JSON/XML/CSV) &...

  • Data Integration Engineer

    2 weeks ago

    Delhi, India LogFix SCM Solutions Pvt Ltd Full time

    Job DescriptionPosition: NiFi DeveloperExperience: 4+ YearsLocation:ChennaiEmployment Type: Full-TimeJob Summary:We are seeking an experienced NiFi Developer with a strong background in data integration, data flowdesign, and data modeling. The ideal candidate will be responsible for building, optimizing, andmaintaining robust data pipelines using Apache NiFi...

  • Nifi Developer

    1 day ago

    Delhi, Delhi, India SightSpectrum Full time ₹ 5,00,000 - ₹ 7,00,000 per year

    The Role: Key Responsibilities:Design, develop, and maintain data ingestion pipelines using Apache NiFi for structured and unstructured data.Implement data integration workflows between various databases, APIs, and cloud storage systems.Develop and optimize SQL queries, stored procedures, and database objects to support ETL processes.Build data models...