Real-Time Data Engineer

1 day ago

bhavnagar, India beBeeData Full time

Job SummaryWe are seeking a skilled Freelance Data Engineer with expertise in designing and building real-time data ingestion and processing pipelines using Apache NiFi and the Google Cloud Platform (GCP) ecosystem.Design and implement real-time data ingestion pipelines using Apache NiFi for both structured and unstructured datasets.Integrate ingestion and processing pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer (Airflow).Ensure low-latency and high-throughput data movement across ingestion, processing, and storage layers.About the RoleThis role requires a strong background in Apache NiFi, along with advanced SQL skills and proficiency in Python programming language.Key Responsibilities:Develop and optimize SQL queries for BigQuery and relational databases to support analytics and reporting.Build Python scripts for data transformation, automation, and developing custom NiFi processors.Implement data quality checks, validation rules, deduplication, late-arriving data handling, and robust error-handling frameworks.RequirementsTo be successful in this role, you will need strong hands-on experience with Apache NiFi and a deep understanding of key GCP services.Strong knowledge of key GCP services, including:Pub/Sub (event ingestion & streaming)BigQuery (warehouse, SQL optimization)Dataflow / Apache Beam (data processing pipelines)Dataproc (Spark/Hadoop processing)Cloud Storage (data lake)Composer / Airflow (workflow orchestration)What We OfferThis is an exciting opportunity to work on cutting-edge data engineering projects and collaborate with experienced professionals in the field.Collaborate with data analysts, data scientists, and platform engineering teams to deliver analytics-ready datasets.Apply data security, GCP IAM policies, VPC Service Controls, and encryption standards to maintain compliance.Monitor, troubleshoot, and optimize pipeline performance to ensure stability and reliability.How You Can GrowIn this role, you will have the opportunity to develop your skills in data engineering and contribute to innovative projects that shape the future of cloud-based data environments.Document data flows, architecture diagrams, transformation logic, and operational best practices.Stay up-to-date with the latest developments in cloud computing, data engineering, and related technologies.

  • Real-Time Systems Engineer

    1 day ago

    bhavnagar, India beBeeBackend Full time

    Job Title: Principal EngineerWe are seeking an experienced professional to help build and scale real-time systems at the core of our global marketplace.This role is responsible for designing and implementing custom algorithms and data models to support pricing, availability, and inventory workflows. The successful candidate will own end-to-end modules from...

  • Senior Real-Time Communications Software Developer

    5 days ago

    bhavnagar, India beBeeBackEnd Full time

    Job Role: A Backend Engineer position is available to contribute to the development of real-time communications analytics and automation at scale.We're seeking an experienced software developer to design, build, and maintain resilient back-end services. Key responsibilities include designing APIs, processing streaming data, integrating with voice/telephony...

  • Data Engineer

    7 days ago

    Bhavnagar, India ProductSquads Full time

    About the Company Company Profile: ProductSquads was founded with a bold mission: to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence. We're building an AI-native platform that redefines how software teams deliver value-whether through code written by humans, agents, or both. Our stack...

  • Senior AI Engineer – Real-Time Video Analytics

    1 day ago

    bhavnagar, India beBeeComputerVision Full time

    About the role, we are seeking a skilled individual with hands-on experience in Computer Vision and Artificial Intelligence.Key Responsibilities:Develop and optimize computer vision models using YOLO for object detection and tracking.Implement and integrate Face Recognition systems into real-time applications.Build, fine-tune, and deploy AI/ML models for...

  • Chief Data Engineer

    3 days ago

    bhavnagar, India beBeeDataEngineering Full time

    Job TitleData Architect - Enterprise Data EngineeringOverviewWe are seeking a highly skilled and experienced Data Architect to lead the design and implementation of our enterprise data engineering solutions. The ideal candidate will have a strong technical background in data architecture, as well as excellent leadership and collaboration skills.Key...

  • Freelance Azure Data Engineer

    3 days ago

    bhavnagar, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company focused on empowering businesses and organizations to defend against evolving cyber threats. Offering a comprehensive suite of services, including cloud security, web and mobile security testing, DevSecOps, and cloud security assessments, we tailor affordable solutions to suit the needs of...

  • AWS Data Engineer

    4 weeks ago

    Bhavnagar, India Coforge Full time

    We are seeking a highly skilled and experienced AWS Data Engineer with strong expertise in Streaming Data and Big Data Technologies, AWS, Python, & Spark. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.Key Responsibilities:Architect and implement...

  • Technical Architect

    1 day ago

    bhavnagar, India beBeeData Full time

    Job OverviewWe are seeking an experienced Technical Architect with hands-on coding skills to join our team. As a key member of our architecture group, you will be responsible for designing and implementing data engineering solutions that drive business value.Key Responsibilities:Design and implement data crawling solutions using public internet resources,...

  • Data Engineer

    1 day ago

    bhavnagar, India Infilon Technologies Pvt ltd Full time

    Infilon Technologies is hiring an experienced Data Engineer (Immediate Joiner) for our US-based client, CalcuQuote - www.calcuquote.com. You'll play a key role in building and optimizing data pipelines, ensuring data is clean, secure, and accessible for analytics and operations. This role offers the chance to work closely with talented teams, solve...

  • Part-Time Business Intelligence Specialist

    5 days ago

    bhavnagar, India beBeeData Full time

    Job Opportunity: Data AnalystWe are looking for a skilled and experienced Data Analyst to join our team on a part-time basis. The successful candidate will have the ability to independently own analytics and reporting work across various tools such as Power BI, SQL, Google Sheets, and data engineering tasks.You will be responsible for supporting multiple...