Expert Data Pipeline Architect

2 weeks ago

Aurangābad, India beBeeDataEngineering Full time

Job Title: Data Engineering ExpertiseRole OverviewThe Role of Data Engineer plays a vital part in our mission to provide exceptional cyber security services. This position requires the expertise to design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).This role involves building and managing API integrations for seamless data exchange between systems.Data Engineers will write and optimize SQL queries and stored procedures for data transformation, analysis, and performance tuning.The ideal candidate should have experience implementing and managing Azure cloud services, including Azure Data Lake, Azure SQL Database, ensuring scalability and high performance.Skill Requirements:E-xperience with designing, developing, and maintaining ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark)Familiarity with building and managing API integrations for seamless data exchange between systemsAbility to write and optimize SQL queries and stored procedures for data transformation, analysis, and performance tuningXpertise in implementing and managing Azure cloud services, including Azure Data Lake, Azure SQL Database, ensuring scalability and high performancePrioritization of proficiency with Python-based data processing solutions for automation, orchestration, and transformation tasksIntegration and configuration of Vectr for log management and real-time data streaming, optimizing data pipelines and ensuring data flow integrityLeveraging Cribl for data observability, transforming and routing data efficiently while filtering out unnecessary dataData security, governance, and compliance with industry standards and best practicesMonitoring, troubleshooting, and optimization of the performance of data workflows, ensuring reliability and scalabilityCollaboration with cross-functional teams to resolve production issues and provide timely data-related solutionsBenefitsThe selected candidate will be offered a competitive salary package, flexible working hours, opportunities for professional growth and development, and a dynamic work environment.OthersPlease submit your application with your resume, cover letter, and relevant certifications to support your application.The application deadline is as soon as possible.

  • Data Pipeline Expert

    4 days ago

    Aurangābad, India beBeeData Full time

    Job Overview:We are seeking a skilled Data Support Specialist to collaborate with client projects involving asset management firms.Role Summary:The Data Support Team is responsible for monitoring data pipelines with state-of-the-art applications. Any issue or break in the pipelines is fixed on priority within defined guidelines or escalated to relevant...

  • Data Expert with Advanced Pipeline Optimization Skills

    2 weeks ago

    Aurangābad, India beBeeDataEngineer Full time

    Job OverviewWe are seeking a seasoned data expert with expertise in Apache NiFi, SQL, and API integrations to design, implement, and optimize real-time data pipelines.Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured data sources.Integrate data pipelines with the GCP ecosystem, including BigQuery,...

  • Chief Data Architect

    4 days ago

    Aurangābad, India beBeeData Full time

    We are seeking a seasoned data professional to architect and build scalable, automated systems that transform massive raw datasets into pristine model-ready formats.As a senior individual contributor, you will be the team's expert on data ingestion, processing, and quality for all AI training.You're responsible for designing developing and owning robust,...

  • Expert Data Architect

    4 days ago

    Aurangābad, India beBeeDataEngineer Full time

    Job Title:Senior Data EngineerWe are seeking an experienced Senior Data Engineer to architect robust data pipelines across on-prem and cloud ecosystems.About the Role:Design, develop, and optimize ETL/ELT data pipelines using Oracle Data Integrator (ODI)Build and automate data ingestion workflows through Python and shell scriptingIntegrate structured and...

  • Expert AI Systems Architect

    2 weeks ago

    Aurangābad, India beBeeaiengineer Full time

    Job Title: Expert AI Systems Architect About the RoleWe are seeking an experienced AIAI Systems Architect to lead our team in designing and implementing large-scale Generative AI systems, including intelligent agents and automation workflows. As a key member of our AI engineering team, you will be responsible for architecting, developing, and deploying...

  • Expert Data Strategist

    2 weeks ago

    Aurangābad, India beBeeData Full time

    Key Responsibilities of this role include Strategic Architecture & Advisory for the Banking, Financial Services, and Insurance sector. This involves Solution Articulation, where you will translate complex business challenges into clear solutions using Snowflake Data Cloud.Additionally, Architecture Design is a critical aspect of this job, requiring you to...

  • Scalable Data Solutions Expert

    2 weeks ago

    Aurangābad, India beBeeDataEngineer Full time

    About This RoleWe're seeking a seasoned data expert to join our team. As a Data Engineer, you will design and implement scalable data pipelines, develop robust data models, and work closely with cross-functional teams to drive business growth.Develop and maintain ETL/ELT data pipelines using Snowflake and DatabricksCreate and optimize data warehousing...

  • Mastering Big Data Pipelines

    2 weeks ago

    Aurangābad, India beBeeDataEngineering Full time

    Senior Data EngineerWe are seeking a seasoned Data Engineering professional to join our team and contribute to the design, development, and optimization of our modern data platform on AWS.This is a full-time position requiring 8+ years of experience in data engineering and pipeline development, along with expertise in AWS services, Apache Iceberg, and legacy...

  • Azure Data Architect

    2 weeks ago

    Aurangābad, India beBeeData Full time

    Job Title:Azure Data Architect - Strategic SolutionsOverview:As an Azure Data Architect, you will be responsible for leading and designing scalable data engineering solutions on the Azure platform. This role requires a strong understanding of cloud computing and experience in working with data engineering environments.Responsibilities:Designing and...

  • Chief Cloud Architect

    4 days ago

    Aurangābad, India beBee CloudFluency Full time

    Senior DevOps ArchitectThe Senior DevOps Architect plays a pivotal role in designing and implementing cloud-agnostic infrastructure architecture, next-gen CI/CD pipelines, and security frameworks. Key responsibilities include architecting complex environments across AWS and GCP, implementing Terraform code, and ensuring seamless deployment for traditional...