Senior Real-Time Data Engineering Expert

7 days ago

varanasi, India beBeeData Full time

Job OpportunityThreatXIntel is a pioneering cybersecurity organization dedicated to safeguarding businesses and organizations against cyber threats.As a Freelance Data Engineer with expertise in Apache NiFi and Google Cloud Platform (GCP), you'll design and build real-time data ingestion and processing pipelines using NiFi and GCP services like BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.Key Responsibilities:Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured datasets.Integrate ingestion and processing pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.Ensure low-latency and high-throughput data movement across ingestion, processing, and storage layers.Develop and optimize SQL queries for BigQuery and relational databases to support analytics and reporting.Build Python scripts for data transformation, automation, and developing custom NiFi processors.Implement data quality checks, validation rules, deduplication, late-arriving data handling, and robust error-handling frameworks.Collaborate with data analysts, data scientists, and platform engineering teams to deliver analytics-ready datasets.Apply data security, GCP IAM policies, VPC Service Controls, and encryption standards to maintain compliance.Monitor, troubleshoot, and optimize pipeline performance to ensure stability and reliability.Document data flows, architecture diagrams, transformation logic, and operational best practices.

  • Senior Real-Time Data Engineer

    2 weeks ago

    varanasi, India beBeeBackend Full time

    Real-Time Communications Backend SpecialistThis role involves designing resilient back-end services that power real-time communications analytics and automation at scale. You'll design APIs, process streaming data, and integrate with voice/telephony and cloud services to deliver low-latency, high-reliability experiences.Design and ship backend APIs...

  • # Data Expert

    2 weeks ago

    varanasi, India beBeeDataExpert Full time

    Expert Data ArchitectWe are seeking an experienced data expert to design, build, and optimize end-to-end data solutions.The ideal candidate will implement contemporary data architecture patterns, create robust data pipelines, and deliver insight-driven analytics to drive business decisions.Design and implement scalable data architectures using ADF, Microsoft...

  • Real-Time Communications Expert

    5 days ago

    varanasi, India beBeeBackend Full time

    Real-Time Communications ExpertThis position involves designing and implementing scalable backend architectures, developing real-time data pipelines, and troubleshooting complex SIP/VoIP issues. You will collaborate on cloud deployment strategies and apply distributed-systems patterns to ensure fault tolerance.The ideal candidate has experience with Python,...

  • Senior Data Engineering Lead

    2 weeks ago

    varanasi, India beBeeDataEngineer Full time

    Senior Data Engineer Job DescriptionAbout the RoleWe are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.The...

  • Senior Data Integration Expert

    4 days ago

    varanasi, India beBeeDataIntegration Full time

    Senior Data Integration ExpertWe are seeking a Senior Data Integration Expert to join our team and lead data migration projects.Main Responsibilities:Develop and execute data integration strategies to ensure seamless data flow across systems.Leverage expertise in ETL/ELT processes to design, implement, and maintain efficient data pipelines.Collaborate with...

  • Senior Data Engineering Specialist

    2 weeks ago

    varanasi, India beBeeData Full time

    We are currently seeking a seasoned Senior Data Engineer to design, build and own robust, scalable and automated ETL/ELT pipelines in Python for ingesting and processing large-scale text datasets.Key Responsibilities:Design, develop and own ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets.Implement rigorous data cleaning,...

  • Senior Unix

    2 weeks ago

    varanasi, India beBeeUnixDataEngineer Full time

    Job Title: Senior Unix & Cloud Data EngineerAbout the JobWe're looking for an experienced Senior Unix & Cloud Data Engineer to join our application development team. The ideal candidate will have a strong foundation in Unix system administration, cloud-based data services, and ETL pipelines.Key Responsibilities:Administer and support Unix/Linux-based...

  • Senior Data Specialist

    2 days ago

    varanasi, India beBeeData Full time

    As a senior Data specialist, you will be working on building and fine-tuning advanced machine learning models. This includes experimenting with various modalities such as audio, video and text. You will also design automated evaluation frameworks for image, audio and video quality scoring, and experiment with synchronization techniques.Key...

  • Data Expert

    1 week ago

    varanasi, India beBeeData Full time

    About the Role:We are seeking a skilled Data Analyst to contribute to the development and refinement of cutting-edge AI systems. As an advocate for user-centric thinking, you will be responsible for producing natural and realistic data that enhances AI performance.Collaborate with cross-functional teams to develop and refine AI systemsEmploy a user-centric...

  • Data Expert

    24 hours ago

    varanasi, India beBeeData Full time

    Senior Data Architect Position OverviewWe are seeking a highly skilled and experienced Senior Data Architect to join our team. The successful candidate will have a strong background in data architecture and a proven track record of delivering complex data solutions.The Senior Data Architect will be responsible for designing, developing, and implementing...