Expert NiFi Data Ingestion Specialist Wanted
1 week ago
Job OpportunityWe are seeking a Freelance Data Engineer with strong expertise in Apache NiFi and the Google Cloud Platform (GCP) ecosystem to design and build real-time data ingestion and processing pipelines.The ideal candidate will develop scalable solutions leveraging NiFi and GCP services including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.Design and implement real-time data ingestion pipelines using Apache NiFi for both structured and unstructured datasets.Integrate ingestion and processing pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.Ensure low-latency and high-throughput data movement across ingestion, processing, and storage layers.Develop and optimize SQL queries for BigQuery and relational databases to support analytics and reporting.Build Python scripts for data transformation, automation, and developing custom NiFi processors.Implement data quality checks, validation rules, deduplication, late-arriving data handling, and robust error-handling frameworks.Collaborate with data analysts, data scientists, and platform engineering teams to deliver analytics-ready datasets.Apply data security, GCP IAM policies, VPC Service Controls, and encryption standards to maintain compliance.Monitor, troubleshoot, and optimize pipeline performance to ensure stability and reliability.Document data flows, architecture diagrams, transformation logic, and operational best practices.
-
GCP Data Pipeline Specialist
2 weeks ago
pushkar, India beBeeDataEngineer Full timeAt ThreatXIntel, we empower businesses with reliable and accessible cybersecurity services. Our mission is to monitor and test clients' digital environments to identify vulnerabilities before they can be exploited.We seek a skilled Freelance GCP Data Engineer with expertise in Apache NiFi, SQL, and API integrations to design, implement, and optimize...
-
Expert in Cloud Data Engineering
7 days ago
pushkar, India beBeeDatabricks Full timeAzure Databricks ProfessionalOur organization is seeking a seasoned Azure Databricks expert with strong hands-on experience in Microsoft Azure services including Data Factory, Storage, Synapse, and Key Vault.The ideal candidate will be proficient in managing data ingestion pipelines (batch and real-time), handling ETL/ELT processes, and ensuring effective...
-
pushkar, India beBeeDataAnnotation Full timeData Annotation Specialist RoleWe are a leading data engineering organization, working with prominent technology companies worldwide.Our team combines cutting-edge machine learning and artificial intelligence technologies with a global workforce of subject matter experts to help drive AI advancements.This role involves reviewing and labeling online content...
-
Data Engineering Expert
3 days ago
pushkar, India beBeeDataEngineering Full timeJob Title: Data Engineering ExpertWe are seeking a skilled Data Engineer to help build and scale our centralized data foundation.You will be responsible for designing reliable data pipelines, shaping analytics-ready datasets, managing modern lakehouse architectures, and enabling reporting, forecasting, and data-driven decision-making across teams.Design and...
-
Data Migration Expert
2 weeks ago
pushkar, India beBeeData Full timeEnterprise Data Integration SpecialistWe are seeking an experienced Enterprise Data Integration Specialist to drive end-to-end integration and data migration solutions into cloud-based systems.Owning all integration deliverables as the Subject Matter Expert (SME)Leading complex phases: requirements, design, build, testing, deployment, and hypercareDeveloping...
-
Data Support Specialist
2 weeks ago
pushkar, India beBeeData Full timeSeeking an experienced Data Support Expert to serve as the primary point of contact for complex data-related issues. This individual will be responsible for providing high-level technical support, collaborating with internal teams, and ensuring optimal system performance.The ideal candidate should possess a strong background in SQL, Python, and cloud...
-
Azure data engineer
4 days ago
Pushkar, India LogFix SCM Solutions Pvt Ltd Full timePosition: Azure Data EngineerExperience: 5+ YearsLocation: RemoteEngagement: ContractJob DescriptionWe are seeking an experienced Azure Data Engineer to design and implement a scalable, Azure-based Central Asset Registry that integrates data from 120+ SQL Server e-Quip databases and 130+ CSV-based hospital systems.The engineer will be responsible for...
-
Highly Skilled Data Professional Wanted
2 weeks ago
pushkar, India beBeeDataEngineer Full timeJob Title: Data EngineerJob DescriptionWe are seeking a skilled data professional to lead the design, development, and optimization of ETL/ELT pipelines using Python, PySpark, and AWS Glue. The ideal candidate will have hands-on experience with Snowflake for data modeling, performance tuning, and query optimization.The successful applicant will be...
-
Data Architect Lead
2 weeks ago
pushkar, India beBeeDataEngineering Full timeSenior Data Engineering SpecialistWe are seeking a highly skilled and experienced Senior Data Engineering Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data solutions using cloud-based technologies.Your primary responsibility will be to lead the...
-
AI Training Data Specialist
3 days ago
pushkar, India beBeeAnnotation Full timeWe are seeking a detail-oriented and tech-savvy individual to join our team as an annotation specialist. In this role, you will play a crucial part in helping us build high-quality AI training datasets.As an annotation specialist, your primary responsibility will be to review and label online content, ensuring data accuracy and consistency. Your work will...
