Freelance Real-Time Data Processing Specialist

6 days ago

india beBeeDataEngineer Full time

Real-Time Data EngineerWe are seeking a skilled Freelance Data Engineer with expertise in Apache NiFi and Google Cloud Platform (GCP) to design and implement real-time data ingestion and processing pipelines.Design and implement efficient real-time data ingestion pipelines using Apache NiFi for both structured and unstructured datasets.Integrate ingestion and processing pipelines with GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.The ideal candidate will develop scalable solutions leveraging NiFi and GCP services such as BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer. This role requires hands-on technical execution, collaboration with cross-functional teams, and a deep understanding of data engineering best practices.Key Skills:Develop and optimize SQL queries for BigQuery and relational databases to support analytics and reporting.Build Python scripts for data transformation, automation, and developing custom NiFi processors.Implement data quality checks, validation rules, deduplication, late-arriving data handling, and robust error-handling frameworks.Collaborate with data analysts, data scientists, and platform engineering teams to deliver analytics-ready datasets.Apply data security, GCP IAM policies, VPC Service Controls, and encryption standards to maintain compliance.Requirements:Strong hands-on experience with Apache NiFi for real-time ingestion, routing, transformation, and orchestration.Deep knowledge of key GCP services, including Pub/Sub, BigQuery, Dataflow / Apache Beam, Dataproc, Cloud Storage, Composer / Airflow, and Advanced SQL skills for querying, optimization, and data modeling.Proficiency in Python for automation, ETL tasks, and scripting custom processors.Benefits:This role offers the opportunity to work on cutting-edge projects, collaborate with experienced professionals, and grow your career in a dynamic environment.

  • Real-Time Data Engineering Specialist

    6 days ago

    india beBeeDataEngineer Full time

    ThreatXIntel is a dynamic cybersecurity startup dedicated to protecting businesses and organizations against cyber threats.As a Freelance Data Engineer, you will design and build real-time data ingestion and processing pipelines using Apache NiFi and the Google Cloud Platform (GCP) ecosystem. This includes BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud...

  • Freelance Data Quality Specialist

    1 week ago

    india beBeeDataQuality Full time

    As a Freelance Data Quality Specialist, you'll be working independently to build and maintain data quality frameworks that drive business success. This is an excellent opportunity for experienced professionals with a strong background in data quality and Python programming.This freelance role is perfect for individuals who value flexibility and autonomy in...

  • Senior Real-Time Data Engineer

    1 week ago

    india beBeeData Full time

    ThreatXIntel is seeking a skilled Freelance GCP Data Engineer to join their team.Job Overview:Design, implement, and optimize real-time data pipelines for structured and unstructured data using Apache NiFi. Collaborate with data analysts, scientists, and engineers to deliver high-quality datasets while ensuring reliability, accuracy, and security within the...

  • Freelance Data Architect

    3 weeks ago

    India Leading MNC Full time

    Looking for a Freelance Data Architect to join a team of rockstar developers. The candidate should have a minimum of 12+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Freelance Data Architect

    3 weeks ago

    India Leading MNC Full time

    Looking for a Freelance Data Architect to join a team of rockstar developers. The candidate should have a minimum of 12+ yrs. of experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Freelance Azure Data Engineering Specialist

    1 week ago

    india beBeeData Full time

    Empowering Businesses with Proactive Cyber Security SolutionsAt the heart of our approach lies a deep understanding of the ever-evolving cyber security landscape. We take a proactive stance, continuously monitoring and assessing digital environments to prevent vulnerabilities. This allows us to tailor affordable solutions that meet the unique needs of...

  • Freelance Machine Learning Specialist

    1 week ago

    india beBeeMachineLearning Full time

    Expert Machine Learning Specialist WantedWe are seeking a highly skilled Freelance Machine Learning Engineer to join our team of experts. This is a freelance/part-time opportunity, ideal for those looking to work with top developers in the industry.Key Responsibilities:Develop and deploy ML models into production-grade environments, ensuring scalability,...

  • Logistical Process Improvement Specialist

    1 week ago

    india beBeeOperations Full time

    Logistics Operations AssistantWe are seeking a highly motivated and organized Logistics Operations Assistant to support our daily logistics operations and contribute to process optimization. The ideal candidate will be responsible for assisting in day-to-day logistics execution, coordinating with freelance delivery professionals, analyzing operational data...

  • Data Pipeline Specialist

    6 days ago

    india beBeeEngineer Full time

    Job OpportunityWe are seeking a skilled Data Engineer to join our team.This is a freelance position that involves designing and building real-time data ingestion and processing pipelines using Apache NiFi and the Google Cloud Platform (GCP) ecosystem.The ideal candidate will develop scalable solutions using NiFi and GCP services such as BigQuery, Pub/Sub,...

  • Freelance Data Solutions Specialist

    1 week ago

    india beBeeDataQuality Full time

    Job PostingWe are seeking a skilled Freelance Data Quality Engineer to enhance our data solutions.This position involves designing and maintaining robust data quality frameworks across datasets, pipelines, and AI/ML platforms.The ideal candidate should have strong expertise in Python, SQL, LLM & RAG, and Data Quality Frameworks.About the RoleThis freelance...