Real-Time Data Ingestion and Processing Expert

3 days ago

vijayawada, India beBeeData Full time

Job DescriptionWe are seeking an expert Data Engineer to design and build real-time data ingestion and processing pipelines using Apache NiFi.We require a strong expertise in designing and implementing real-time data ingestion pipelines using Apache NiFi for both structured and unstructured datasets.The ideal candidate should integrate ingestion and processing pipelines with the Google Cloud Platform (GCP) ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer (Airflow).The Freelance Data Engineer will ensure low-latency and high-throughput data movement across ingestion, processing, and storage layers.The role involves developing and optimizing SQL queries for BigQuery and relational databases to support analytics and reporting.The Freelance Data Engineer will build Python scripts for data transformation, automation, and developing custom NiFi processors.The position requires implementing data quality checks, validation rules, deduplication, late-arriving data handling, and robust error-handling frameworks.The Freelance Data Engineer will collaborate with data analysts, data scientists, and platform engineering teams to deliver analytics-ready datasets.The role involves applying data security, GCP IAM policies, VPC Service Controls, and encryption standards to maintain compliance.The Freelance Data Engineer will monitor, troubleshoot, and optimize pipeline performance to ensure stability and reliability.The Freelance Data Engineer will document data flows, architecture diagrams, transformation logic, and operational best practices.

  • Data Ingestion Specialist

    7 days ago

    vijayawada, India beBeeDatabricks Full time

    Job Title: Databricks ExpertWe are seeking a skilled Databricks Expert to manage data ingestion pipelines and handle ETL/ELT processes.Strong knowledge of Microsoft Azure services, including Data Factory, Storage, Synapse, and Key Vault.Proficiency in Databricks cluster management, job execution, and troubleshooting.Experience in data ingestion jobs,...

  • Expert Real-Time Data Solutions Specialist

    5 days ago

    vijayawada, India beBeeData Full time

    Real-Time Data Engineer RoleWe are seeking a skilled Freelance GCP Data Engineer to design, implement and optimize real-time data pipelines using Apache NiFi. This role involves working with the Google Cloud Platform (GCP) ecosystem to ensure high-performance data processing, transformation, and delivery to downstream systems for analytics and reporting.Key...

  • Cloud Data Engineer

    1 day ago

    vijayawada, India beBeeDataEngineer Full time

    As a cloud data engineering expert, you will be responsible for managing data ingestion pipelines, handling ETL/ELT processes and ensuring effective incident management.We are looking for someone with strong hands-on experience in cloud data platforms such as Azure Synapse, Data Factory, Storage and Key Vault.Familiarity with DevOps practices like CI/CD and...

  • Real Estate Expert

    5 days ago

    vijayawada, India beBeeRealEstateExpert Full time

    Real Estate Expert Job SummaryThis is a senior-level, full-time role for an expert in real estate. The position involves conducting thorough due diligence, drafting detailed reports, engaging with clients, and providing strategic advice on transactions.The successful candidate will work closely with clients to manage cases, provide legal guidance, and assist...

  • Cloud Data Specialist

    5 days ago

    vijayawada, India beBeeDatabricks Full time

    Cloud Data SpecialistWe are seeking a skilled data specialist to manage and optimize cloud-based data platforms. The candidate should be proficient in Databricks, including cluster management, job execution, and troubleshooting.Develop and implement effective data ingestion pipelines (batch and real-time), ensuring seamless ETL/ELT processes and efficient...

  • Data Expert

    7 days ago

    vijayawada, India beBeeData Full time

    Data Scientist RoleAre you a data expert looking to drive business growth through strategic decision-making? As a Data Scientist, you will play a pivotal role in our organization's success by leveraging cutting-edge technology and analytical expertise.Develop and implement end-to-end GenAI powered systems for real-world applications.Provide guidance on...

  • Enterprise Data Solution Designer

    5 days ago

    vijayawada, India beBeeDataArchitecture Full time

    Data Architecture SpecialistAs a Data Architecture Specialist, you will be responsible for designing and implementing data architecture solutions that drive business growth and success.Key Responsibilities:Define and execute the enterprise data architecture strategy in alignment with business goals and future growth needs.Architect, design, and implement...

  • Real-Time Communications System Engineer

    7 days ago

    vijayawada, India beBeeBackend Full time

    Help build and deploy scalable back-end solutions for real-time communications analytics and automation.You'll design and implement APIs, process streaming data, and integrate with voice/telephony and cloud services to deliver low-latency, high-reliability experiences.Key Responsibilities:Designing and shipping backend APIs (Django/DRF), background/async...

  • Vehicles AI Data Scientist

    15 hours ago

    vijayawada, India beBeePredictive Full time

    We're looking for a skilled professional to join our team in developing predictive models that detect early warning signals in high-frequency vehicle sensor data.Key ResponsibilitiesPredictive Modeling: Develop machine learning models that improve uptime outcomes by identifying potential issues before they become major problems.Data Pipeline Engineering:...

  • Senior Data Engineering Lead

    7 days ago

    vijayawada, India beBeeDataArchitect Full time

    Data Architect We're seeking a seasoned Senior Data Engineer to lead the development of large-scale data pipelines for AI training. Your primary mission is to design and build robust, scalable systems that transform massive datasets into pristine formats. As a senior individual contributor, you will be the team's expert on data ingestion, processing, and...