Current jobs related to Data Pipeline Specialist - kozhikode - beBeeDataEngineer


  • kozhikode, India beBeeMachineLearningEngineer Full time

    MLOps Engineering RoleWe are seeking an experienced MLOps Engineer to join our team. In this role, you will be responsible for designing and maintaining end-to-end machine learning pipelines, building and operating model serving APIs, setting up continuous integration and deployment for machine learning with proper testing, versioning, and rollback.Develop...


  • Kozhikode, India People Prime Worldwide Full time

    About Client :-Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.The company is...


  • kozhikode, India beBeeDataEngineer Full time

    Technical Data Specialist We are seeking an experienced Technical Data Specialist to design, build, and maintain our data platform. This role is fully remote and may extend beyond the end of the contract. The ideal candidate will have deep expertise in SQL, modern data engineering practices, and tools, with deployment in an on-premises environment....


  • kozhikode, India beBeePipeline Full time

    Job Title: AI Pipeline ArchitectWe are seeking a seasoned AI pipeline architect to design and implement large language models (LLMs) and agentic AI solutions.Pipeline Architecture: Develop end-to-end AI pipelines with API interactions, data scraping, and microservices orchestration.Agent Development: Create LLM-driven AI agents with memory, multi-step...


  • Kozhikode, India Pipeline AI Full time

    Job Title: Managed Services InternLocation: Remote, IndiaType: Internship (6 months, full-time)Work Hours: Flexible, with strong overlap to US business hours. Our teams align theirschedules around client projects and delivery priorities.About PipelinePipeline is an AI platform that helps sales teams research, prioritize, and personalize outreach.We work with...


  • Kozhikode, India Pipeline AI Full time

    Job Title: Managed Services InternLocation: Remote, IndiaType: Internship (6 months, full-time)Work Hours: Flexible, with strong overlap to US business hours. Our teams align theirschedules around client projects and delivery priorities.About PipelinePipeline is an AI platform that helps sales teams research, prioritize, and personalize outreach.We work with...


  • kozhikode, India beBeeData Full time

    Data Specialist RoleThe Data Specialist is responsible for evaluating learners' technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner...


  • kozhikode, India beBeeDataPipeline Full time

    Job Title:Senior Data Pipeline SpecialistAbout the Role:We're seeking a highly skilled Senior Data Pipeline Specialist to build and maintain scalable data pipelines, leveraging modern cloud-native data stacks. This is an exciting opportunity for experienced engineers who can drive large-scale enterprise data initiatives forward.Key Responsibilities:Design...


  • kozhikode, India beBeeDataAnnotation Full time

    Data Annotation Specialist Role OverviewData annotation is a crucial task in the development of AI systems. It involves labeling and categorizing data to prepare it for use in machine learning models.Key Responsibilities:Annotate online content to enhance AI system performance, ensuring accuracy and quality standards are met.Required Skills and...


  • kozhikode, India beBeeQuality Full time

    We are seeking a Quality Assurance Specialist to ensure data accuracy, reliability and efficiency.The role involves validating data processing logic, workflows and analytical outputs built using Python, Spark and modern data libraries.Data Validation: Validate JupyterLab notebooks for logic accuracy, data transformation and analytical...

Data Pipeline Specialist

2 weeks ago


kozhikode, India beBeeDataEngineer Full time

Job DescriptionAzure Data EngineerWe are looking for a skilled contractor to build data pipelines for enterprise search applications using ADF and Databricks.Develop data integration feeds according to customer requirements;Review business needs and design pipelines that load data into Azure Data Lakes or Azure Data warehouses, Azure Synapse, Azure Databricks, or Cloud services;Build data pipelines between different sources including XML, flat files, SAP, and databases;Expertise in data modeling, metadata management, master data management, data governance, and data quality is essential;A strong analytical mindset is required to evaluate work and provide technical assistance;Perform code optimization and adhere to industry standards;Experience in monitoring and improving the performance of Azure data feeds is advantageous;Create design documents, functional/technical specifications, or any other required artifacts;RequirementsBachelor or Master degree;+5 years of experience in data modeling, metadata management, master data management, data governance, and data quality;Proficiency in Azure platforms, including experience in Azure Databricks, ADLS, Synapse, and its various components;In-depth knowledge and hands-on experience in Microsoft Azure data stack, i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark, and Python/PySpark programming;Strong experience with designing ETL/ELT pipelines/data flows using Azure Data Factory as a primary skill and SSIS/Informatica as additional skills;Mastery of development and design skills in leading RDBMS environments, e.g., MS SQL Server and Oracle;Complex SQL query expertise is a must;Experience of big data approach, architectural concepts, data sourcing/ingestion/curation, and storage mechanisms;Real-time/near-real-time data warehousing concepts and design approaches are highly valued;End-to-end projects focusing on analytics, data warehousing, enterprise reporting have been successfully executed;Leveraging Azure Automation, Azure PowerShell Scripting, Az Copy, DevOps/ARM Templates has been demonstrated;Data-lakes, raw/enriched/curated layer concepts, and ETL within Azure framework understanding is required;Highly skilled in end-to-end data warehousing and BI (analytics) design/development;Design, functional/technical specification documentations, or any artifacts needed will be created;English fluency is expected;