Data Engineering Expertise

1 day ago

Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Data Engineering Specialist

About the Role:

Our organization is seeking a highly skilled Data Engineering Specialist to lead the design and implementation of scalable data pipelines. As a key member of our team, you will be responsible for leveraging industry-leading tools and technologies to drive business growth and inform strategic decision-making.
  • Design and implement data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.
  • Develop ETL/ELT solutions using PySpark, T-SQL, and Spark Notebooks within Fabric and Azure Synapse.
  • Manage and optimize data storage and compute in OneLake, supporting Lakehouse and Warehouse use cases.
  • Implement and manage Azure Key Vault for secure handling of secrets, credentials, and connection strings.
  • Configure and manage CI/CD pipelines for Data engineering projects using Azure DevOps, including automated deployment of Fabric assets.
  • Integrate data from diverse sources, including SQL Server, Azure Blob, REST APIs, and on-prem systems.
  • Collaborate closely with business teams and PowerBI developers to ensure data models support reporting and self-service needs.
  • Monitor and troubleshoot data pipeline performance, data quality, and failure recovery.
  • Contribute to architecture design, governance processes, and performance tuning.

Requirements:

  • Azure Synapse: Hands-on experience and at least 4+ years of relevant experience is mandatory.
  • Microsoft Fabric: Hands-on experience and at least 1 project executed using Microsoft Fabric which is mandatory.
  • Azure Data Factory (ADF)
  • Azure Storage
  • PySpark
  • SQL
  • Azure Key Vault
  • Excellent communication skills as this would be client-facing and L2 will be client round of interview.

  • Expertise in Large-Scale Data Engineering

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineer LeadJob Description:We are seeking an experienced Senior Data Engineer to take on a leadership role in our data engineering team. The ideal candidate will have around 6+ years of experience in data engineering or cloud computing data development.Design, develop and optimize ETL/ELT data pipelines using Apache Spark (PySpark or...

  • A Software Engineering Expertise

    7 days ago

    Madurai, Tamil Nadu, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryAchieve Excellence as a Senior PHP DeveloperWe are seeking a highly skilled and accomplished software engineer to join our team at Jupiter AI Labs.The ideal candidate will possess a strong background in software engineering, algorithm design, and systems-level programming, with expertise in optimizing code for efficient execution and...

  • Cloud Data Engineer

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled Data Engineering professional to design, build and maintain scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS EMR, Glue, PySpark, Airflow and Python, working closely with data analysts, scientists and other engineering teams to support business-driven...

  • Data Engineering Specialist

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistJob OverviewWe are seeking a seasoned data engineering professional to join our organization. The ideal candidate will have extensive experience in designing, developing, and maintaining large-scale data processing systems.The successful candidate will be responsible for leading cross-functional teams to integrate data...

  • Data Engineering Specialist

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 15,00,000

    Data Engineering SpecialistWe are seeking a skilled data engineering professional to join our team. The ideal candidate will have 3–12 years of experience in building and managing data systems.About the Role:Design and develop data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python, and...

  • Leading Data Engineer

    7 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a seasoned Data Engineering professional to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems that drive business intelligence and analytics.Your primary focus will be on architecting and implementing scalable and robust data pipelines...

  • Senior Data Engineering Manager

    7 days ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:About the Role:We are seeking a highly experienced and strategic leader with deep expertise in data engineering platforms, cloud computing, and software development. The ideal candidate will oversee a team of talented engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and...

  • Cloud Data Engineering Lead

    5 days ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 17,50,000

    Job Title: Cloud Data Engineering Lead\The role involves overseeing the design, development and configuration of cloud-based data systems to drive business growth.\This position requires a technical leader with expertise in cloud data warehousing, data modeling and ETL processes. The ideal candidate will have at least 5 years of experience in designing and...

  • Senior Data Engineering Project Lead

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Scrum Master – Data Engineering Job DescriptionWe are seeking an experienced Scrum Master with a strong background in Data Engineering to lead agile teams and ensure smooth project execution.Key Responsibilities:Lead agile teams and facilitate daily stand-ups, sprint planning, and retrospectives.Collaborate with cross-functional teams to identify and...

  • Senior Data Quality Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataQuality Full time US$ 9,00,000 - US$ 12,00,000

    About Data Quality EngineeringThis is a key position for someone with hands-on experience in developing and executing tests using SQL, Tricentis, Python (PySpark), and data quality frameworks.The ideal candidate will have expertise in data pipeline development, ETL process management, and ingestion testing, with a strong background in data quality...