Senior Real-Time Data Pipeline Specialist
1 week ago
Job OpportunityWe are seeking a skilled Data Engineer to design, implement, and optimize real-time data pipelines for a cybersecurity startup that offers tailored solutions to businesses. Our expertise spans cloud security, web and mobile security testing, cloud security assessments, DevSecOps, and more.The ideal candidate will have expertise in Apache NiFi, SQL, and API integrations, with experience in designing and implementing real-time data ingestion pipelines using structured and unstructured data.Data Pipeline Development: Design and implement high-throughput data delivery systems for analytics and reporting, integrating data pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer/Airflow.SQL Optimization: Develop and optimize SQL queries for BigQuery and relational databases to ensure data transformation and analysis.Python Scripting: Write Python scripts for data transformation, automation, and custom NiFi processors when required.Error Handling and Quality Assurance: Implement data quality, validation, and error-handling mechanisms within ingestion pipelines to ensure reliability and accuracy.Collaboration and Communication: Collaborate with data analysts, data scientists, and platform engineers to deliver consistent and high-quality datasets.Security and Compliance: Ensure data security, governance, and compliance with GCP IAM, VPC Service Controls, and encryption standards.
-
Real-Time Data Processing Expert Wanted
6 days ago
madurai, India beBeeData Full timeJob Description:ThreatXIntel, a dynamic cybersecurity startup, is dedicated to protecting businesses against cyber threats. We specialize in cloud security, DevSecOps, and vulnerability testing, offering tailored solutions to meet clients' unique requirements.We are seeking a Freelance Data Engineer with expertise in Apache NiFi and the Google Cloud Platform...
-
Real Time Systems Developer
1 week ago
madurai, India beBeeCommunication Full timeBackend Engineer – Real-Time Communications We are seeking a skilled Backend Engineer to help build resilient back-end services that power real-time communications analytics and automation at scale. Key Responsibilities: Design and ship backend APIs, background/async jobs, and secure integrations with external services. Build and optimize real-time data...
-
Senior Real-Time Collaboration Engineer
2 days ago
Madurai, India KPG99 INC Full timeSenior Real-Time Collaboration EngineerLocation: Offshore Remote (Pune, India preferred)Engagement: Contract → Full-time after 1 year (Pune office)Job Description:We are seeking a Senior Real-Time Collaboration Engineer to design, deploy, and support enterprise real-time communication platforms. The role focuses on Microsoft Teams Telephony & Meetings,...
-
Senior Real-Time Collaboration Engineer
2 days ago
Madurai, India KPG99 INC Full timeSenior Real-Time Collaboration EngineerLocation: Offshore Remote (Pune, India preferred)Engagement: Contract → Full-time after 1 year (Pune office)Job Description:We are seeking a Senior Real-Time Collaboration Engineer to design, deploy, and support enterprise real-time communication platforms. The role focuses on Microsoft Teams Telephony & Meetings,...
-
Data Integration Specialist
6 days ago
madurai, India beBeeDataIntegration Full timeData Integration SpecialistWe are seeking an experienced Data Integration Specialist to join our team. As a key member of our data engineering group, you will play a critical role in designing, developing and optimizing large-scale data pipelines.The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata and Google Cloud Platform...
-
Data Pipeline Engineer
6 days ago
Madurai, India Techmango Technology Services Private Limited Full timeAbout TechMango:Founded in 2014, Techmango Technology Services Private Limited is a trusted global technology partner with a presence in India, the USA, and the UAE. The company specializes in delivering transformative digital solutions by integrating Generative AI, Data Analytics, and Intelligent Automation with advanced engineering expertise. Techmango...
-
Data Modeling Specialist
1 day ago
madurai, India beBeeData Full timeWe are seeking an accomplished Data Modeling Specialist to spearhead the development of high-grade predictive models that detect early warning signals in real-time sensor data, driving exceptional uptime outcomes.You will design and implement robust data pipelines to process massive amounts of IoT data from vehicle systems, collaborating with engineering...
-
Real Time Systems Developer
4 days ago
madurai, India beBeeSoftware Full timeBackend Software Engineer for Real-Time CommunicationsWe are seeking a skilled Backend Software Engineer to help build resilient back-end services that power real-time communications analytics and automation at scale.Key Responsibilities:Design and ship backend APIs, background/async jobs, and secure integrations with external services using Python and...
-
Senior Data Acquisition Specialist
1 week ago
madurai, India beBeeDataEngineer Full timeAbout this RoleWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure, Databricks, Snowflake, and Kafka.You will be responsible for designing, developing, and maintaining robust data acquisition frameworks...
-
Senior Data Scientist
3 weeks ago
Madurai, India Recro Full timeAbout the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine...
