Senior Data Pipeline Specialist

21 hours ago

Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Microsoft Fabric.

We are seeking a skilled professional to fill this critical position. This individual will be responsible for developing ETL/ELT solutions using PySpark, T-SQL and Spark Notebooks within Fabric and Azure Synapse.

Key Responsibilities:
  • Design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks and SQL endpoints.
  • Develop ETL/ELT solutions using PySpark, T-SQL and Spark Notebooks within Fabric and Azure Synapse.
  • Manage and optimize data storage and compute in OneLake supporting Lakehouse and Warehouse use cases.
  • Implement and manage Azure Key Vault for secure handling of secrets, credentials and connection strings.
  • Configure and manage CI/CD pipelines for Data engineering projects using Azure Devops including automated deployment of Fabric assets.
  • Integrate data from diverse sources including SQL server, Azure Blob, REST API's and on-prem systems.
  • Collaborate closely with business teams and PowerBI developers to ensure data models support reporting and self-service needs.
  • Monitor and troubleshoot data pipeline performance, data quality and failure recovery.
  • Contribute to architecture design, governance processes and performance tuning.

We offer a dynamic work environment and the opportunity to contribute to the development of innovative data solutions.

Jade Business Services (JBS) specializes in providing comprehensive data solutions to industries such as Energy, Oil & Gas, Healthcare, and Finance.

  • Senior Data Pipeline Specialist

    19 hours ago

    Coimbatore, Tamil Nadu, India beBeeTestEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About NovintiX, a leading engineering consultancy in the Life Sciences, MedTech, and Healthcare sectorsWe specialize in delivering high-impact digital programs, engineering services, and talent solutions that accelerate innovation and efficiency.A fast-growing company with clients across the US, Ireland, and EuropeDelivering digital transformation and...

  • Data Pipeline Specialist

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 30,00,000 - ₹ 40,00,000

    Key Data Pipeline SpecialistThe role entails designing, developing, and maintaining high-capacity data pipelines that efficiently handle structured and unstructured data.ResponsibilitiesDesign and Build Complex Pipelines: You will be responsible for designing and building complex production-level data pipelines utilizing AWS services such as S3, EC2, RDS,...

  • Unlock Your Potential as a Senior Data Pipeline Specialist

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Data Pipeline Specialist PositionAt our organization, we are seeking an experienced Senior Data Pipeline Specialist with a strong background in data engineering practices. The ideal candidate will have hands-on expertise in building and automating large-scale data pipelines, managing multi-environment deployments, and working with modern...

  • Senior Data Pipeline Engineer

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    About This RoleWe're seeking an experienced Data Pipeline Specialist to join our data engineering team.As a Data Pipeline Specialist, you will design and develop scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Main Responsibilities:Design, build, and maintain ETL pipelines using IBM DataStage (CP4D)...

  • Senior Data Pipeline Developer

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,20,000

    Data EngineerWe are seeking a highly skilled Data Engineer to join our dynamic data team. As a key member of the infrastructure team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital marketing product development.You will collaborate with cross-functional teams...

  • Data Pipeline Engineer

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:We are seeking a skilled Data Pipeline Specialist to design, build, and optimize scalable data pipelines using Azure Data Factory.The ideal candidate will have hands-on experience with ADF pipelines, data integration, and transformations for smooth, secure, and efficient data flows.Design and implement Azure Data Factory pipelines for ETL and...

  • Senior Data Pipeline Specialist

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Database Engineer OpportunityWe are seeking a skilled ETL/Database Tester to join our team with 5+ years of experience in testing, monitoring, and improving data pipelines.Key Responsibilities:Design, implement, and execute comprehensive test plans for ETL processes and databases.Collaborate with cross-functional teams to identify and prioritize testing...

  • Senior Data Integration Specialist

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeDataIntegration Full time US$ 1,20,000 - US$ 1,70,000

    Job Title: Senior Data EngineerData Integration Specialist Job OverviewWe are seeking a highly skilled and experienced data integration specialist to lead the design, development, and deployment of complex ETL solutions using Informatica IDMC.The ideal candidate will have a strong background in developing, documenting, testing, and maintaining ETL...

  • Data Pipeline Testing Expert

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeTestEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    About UsWe are a leading engineering and digital transformation consultancy, serving top Life Sciences, MedTech, and Healthcare clients across the US, Ireland, and Europe.Job Summary:We are seeking an experienced Senior Test Engineer to drive the testing strategy and execution for a project leveraging Databricks, Data Factory pipelines, and Power BI.Key...

  • Data Pipeline Architect

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeETLDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: ETL DeveloperWe are seeking a skilled and motivated ETL professional to join our data engineering team.You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Main Responsibilities:Design, develop, and maintain ETL pipelines using IBM...