Data Expert with Advanced Pipeline Optimization Skills

2 weeks ago

Aurangābad, India beBeeDataEngineer Full time

Job OverviewWe are seeking a seasoned data expert with expertise in Apache NiFi, SQL, and API integrations to design, implement, and optimize real-time data pipelines.Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured data sources.Integrate data pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer/Airflow.Ensure seamless data delivery to downstream systems for analytics and reporting.Develop and optimize SQL queries for BigQuery and relational databases to ensure data transformation and analysis.Write Python scripts for data transformation, automation, and custom NiFi processors when required.Implement data quality, validation, and error-handling mechanisms within ingestion pipelines to ensure reliability and accuracy.Collaborate with data analysts, data scientists, and platform engineers to deliver consistent and high-quality datasets.Ensure data security, governance, and compliance with GCP IAM, VPC Service Controls, and encryption standards.Monitor, troubleshoot, and optimize data pipeline performance to ensure smooth operations.Document data flows, architecture, and best practices to maintain consistency across teams.

  • Expert Data Pipeline Architect

    2 weeks ago

    Aurangābad, India beBeeDataEngineering Full time

    Job Title: Data Engineering ExpertiseRole OverviewThe Role of Data Engineer plays a vital part in our mission to provide exceptional cyber security services. This position requires the expertise to design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).This role involves building and managing API integrations...

  • Data Pipeline Expert

    4 days ago

    Aurangābad, India beBeeData Full time

    Job Overview:We are seeking a skilled Data Support Specialist to collaborate with client projects involving asset management firms.Role Summary:The Data Support Team is responsible for monitoring data pipelines with state-of-the-art applications. Any issue or break in the pipelines is fixed on priority within defined guidelines or escalated to relevant...

  • Mastering Big Data Pipelines

    2 weeks ago

    Aurangābad, India beBeeDataEngineering Full time

    Senior Data EngineerWe are seeking a seasoned Data Engineering professional to join our team and contribute to the design, development, and optimization of our modern data platform on AWS.This is a full-time position requiring 8+ years of experience in data engineering and pipeline development, along with expertise in AWS services, Apache Iceberg, and legacy...

  • Scalable Data Solutions Expert

    2 weeks ago

    Aurangābad, India beBeeDataEngineer Full time

    About This RoleWe're seeking a seasoned data expert to join our team. As a Data Engineer, you will design and implement scalable data pipelines, develop robust data models, and work closely with cross-functional teams to drive business growth.Develop and maintain ETL/ELT data pipelines using Snowflake and DatabricksCreate and optimize data warehousing...

  • Expert Data Strategist

    2 weeks ago

    Aurangābad, India beBeeData Full time

    Key Responsibilities of this role include Strategic Architecture & Advisory for the Banking, Financial Services, and Insurance sector. This involves Solution Articulation, where you will translate complex business challenges into clear solutions using Snowflake Data Cloud.Additionally, Architecture Design is a critical aspect of this job, requiring you to...

  • Planning and Optimization Specialist

    1 week ago

    Aurangābad, India beBeeOptimization Full time

    Delmia Quintiq Planning ExpertAbout the RoleWe are looking for a Delmia Quintiq Planning Expert to design and implement advanced planning and optimization solutions.Key ResponsibilitiesConfigure and optimize Delmia Quintiq applications (Macro Planner, Scheduler, Logistics, Workforce).Translate business requirements into Quintiq models, rules, and planning...

  • Expert Coding Model Trainer

    2 weeks ago

    Aurangābad, India beBeeCoding Full time

    Job Title: Expert Coding Model TrainerWe are seeking a skilled and experienced coding model trainer to join our team. As an expert in large language models (LLMs), you will be responsible for training, fine-tuning, and evaluating advanced coding models in multiple languages.Key Responsibilities:Create strategies to train and fine-tune LLMs for coding tasks...

  • Senior Cloud Data Solutions Specialist

    2 weeks ago

    Aurangābad, India beBeeAzureDataEngineer Full time

    Key Azure Data Engineer RoleWe seek a seasoned Azure expert to spearhead modern data engineering initiatives within the cloud ecosystem.Drive large-scale SQL workload migration from on-premises environments to Azure, ensuring high data integrity, minimal downtime and optimal performance.Design, develop and manage end-to-end data pipelines using Azure Data...

  • Principal Data Scientist

    2 weeks ago

    Aurangābad, India beBeeDataEngineer Full time

    Job OpportunityData Engineering PositionWe are seeking an experienced Data Engineer to design, develop, and maintain efficient data pipelines, ensuring seamless integration and advanced analytics across the organization.Develop scalable data processing solutions using Python, PySpark, and AWS services.Implement data ingestion, transformation, and integration...

  • Visionary Data Architect

    4 days ago

    Aurangābad, India beBeeDataEngineering Full time

    Job OverviewData engineers at our organization are responsible for designing, building and optimizing end-to-end data solutions using Microsoft's data platforms. They work closely with clients to deliver insight-driven analytics that shape the future of business decisions.The ideal candidate will implement contemporary data architecture patterns and create...