Current jobs related to Senior Data Pipeline Specialist - Madurai, Tamil Nadu - beBeeDataEngineer

  • Senior Data Pipeline Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    We are seeking a seasoned Data Engineer with expertise in building scalable data pipelines on the Google Cloud Platform.This is an exciting opportunity for a specialist to work on challenging projects across various industries, including Energy, Oil & Gas, Healthcare, and Finance.As a GCP Data Engineer, you will be responsible for:Designing, developing, and...

  • ETL Specialist with Data Pipeline Expertise

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    ETL Specialist with Data Pipeline ExpertiseWe are seeking a highly skilled ETL Developer to join our data engineering team. As an ETL specialist, you will work on building scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.Key Responsibilities:Design and develop ETL pipelines using IBM DataStage and AWS Glue/Lambda for data...

  • Data Pipeline Assurance Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Senior ETL Tester.Key ResponsibilitiesDesign and execute comprehensive testing methodologies for complex data pipelines, ensuring accurate and timely delivery of results.Develop advanced SQL skills to validate and reconcile large-scale data sets, with a focus on precision and efficiency.Create and maintain automated data validation frameworks using...

  • Senior Data Pipeline Developer

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataStrategist Full time ₹ 12,00,000 - ₹ 15,00,000

    Key Roles and Responsibilities:We are seeking a highly skilled Data Strategist to develop and implement data pipelines using IBM StreamSets.Main Accountabilities:Design, build and maintain complex data pipelines with IBM StreamSets to integrate new AI tools and hybrid cloud environments.Collaborate with cross-functional teams to ensure seamless data...

  • Senior Data Pipeline Test Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,16,000

    Job OverviewWe are seeking a Quality Assurance and Test Engineer to join our team. This role involves ensuring the accuracy, performance, and usability of data pipelines and semantic models across various platforms.Key ResponsibilitiesDevelop test strategies to validate transformation accuracy, reconciliation, security, lineage, and accessibility.Execute...

  • Senior Data Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data SpecialistJob Summary:We are seeking an experienced Senior Data Analyst to drive business outcomes through data-driven insights.

  • Senior Data Pipeline Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Operational Intelligence EngineerAbout Operational Intelligence PlatformWe are building an operational intelligence platform for digital infrastructure to provide actionable multi-dimensional insights to network, cloud, and application operators.The platform enables operations teams to meet their KPIs through seamless collaboration, search-driven...

  • Data Pipeline Tester

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled Test Engineer to drive the testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI.The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management.

  • Senior Data Integration Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior ETL DeveloperJob OverviewWe are seeking a highly experienced and skilled Senior ETL Developer to join our team.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical solutions.Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.Optimize Spark...

  • Senior Data Protection Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataProtection Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Senior Data Protection SpecialistOverviewWe are seeking an experienced Senior Data Protection Specialist to join our team in a data center environment. The ideal candidate will possess expertise in backup tools, tape libraries, and disaster recovery solutions.Key Responsibilities:Configure and manage backup systems for regular data backups,...

Senior Data Pipeline Specialist

3 weeks ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 18,00,000
Unlock Your Potential in Data Engineering

Transform your career with a Data Engineer role that drives business success.

As a critical member of our data engineering team, you will design, build, and manage scalable data pipelines and enterprise data solutions to support analytics, reporting, and data science initiatives. This high-impact role requires deep expertise in Azure, SQL Server, and Databricks to deliver high-quality, reliable, and performant data systems.

Key Responsibilities:

  • Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks for batch and real-time data processing.
  • Integrate data from various structured and unstructured sources including SQL Server, Azure SQL Database, Azure Data Lake Storage (ADLS), and external APIs.
  • Build and maintain data models, data marts, and data warehouses using SQL Server and Azure Synapse Analytics.
  • Write efficient and optimized SQL queries, stored procedures, views, and triggers in SQL Server.
  • Use Databricks (Spark with Python/Scala) to process large datasets for transformation and analytics.
  • Ensure data quality, integrity, security, and compliance across the pipeline using data validation, monitoring, and auditing techniques.
  • Collaborate with data analysts, data scientists, and business stakeholders to define and deliver data solutions.
  • Implement CI/CD pipelines using Azure DevOps.
  • Monitor and optimize the performance of data pipelines and queries across Azure and SQL Server environments.

Required Skills & Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
  • 5+ years of experience in data engineering or related roles.
  • Proven experience with:
  • Azure Data Services: Data Factory, ADLS, Azure SQL, Azure Synapse
  • Databricks (Azure implementation), including experience with Spark (Python or Scala).
  • Microsoft SQL Server: Writing advanced SQL, stored procedures, and performance tuning.
  • Strong understanding of data warehousing concepts, ETL/ELT best practices, and data modelling (star/snowflake schema).
  • Familiarity with data governance, RBAC, and data security practices in Azure.
  • Experience with CI/CD tools like Azure DevOps and version control with Git.
  • Excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment.