Lead Data Infrastructure Specialist

4 days ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Senior Data Engineer Job Overview

We are seeking an experienced Senior Data Engineer to design, develop and maintain data pipelines that extract data from various sources via APIs, process and store it in a cloud-based lakehouse platform.

Key Responsibilities:
  • Design and implement end-to-end pipelines from API extraction into the Databricks Lakehouse platform.
  • Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse and enrich data.
  • Build and maintain data flows from Databricks into Oracle EPM to support business intelligence, forecasting and planning.
  • Ensure data quality, consistency and governance across all systems.
  • Optimize pipeline performance, scalability and reliability.
  • Collaborate with cross-functional teams to meet business needs.

Required Skills & Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering or related field.
  • 5+ years of experience in data engineering, ETL/ELT and data pipeline development.
  • Hands-on experience with Databricks (PySpark, Delta Lake, MLflow).
  • Strong experience with APIs for data extraction and integration.
  • Proficiency in SQL, Python and Spark for data processing.
  • Experience with cloud platforms for hosting Databricks and related services.
  • Knowledge of data modeling, data governance and performance tuning.
  • Strong problem-solving skills and ability to work in cross-functional teams.

  • Data Infrastructure Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Title: Data Infrastructure SpecialistWe are seeking a highly motivated professional to develop and optimize scalable data processing pipelines using Azure Databricks, PySpark, and Delta Lake.Collaborate with cross-functional teams to deliver high-quality database solutions for the organization.Design and deploy efficient ETL/ELT pipelines with Azure...

  • Data Infrastructure Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a detail-driven professional to lead the design, development and maintenance of scalable data pipelines and infrastructure that support real-time and batch data processing.You will collaborate with cross-functional teams to deliver reliable, high-quality data systems that power analytics, insights and data-driven...

  • Data Infrastructure Specialist

    3 days ago

    Madurai, Tamil Nadu, India beBeeDatabaseSpecialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Infrastructure SpecialistThe ideal candidate will have 1-3 years of experience in designing, optimizing, and managing scalable database architectures.Key responsibilities include:Designing and developing scalable database architectures.Optimizing database queries, indexing, and performance tuning.Ensuring data security, compliance, backup,...

  • Big Data Infrastructure Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Big Data Infrastructure Specialist, you will be responsible for designing and optimizing large-scale data processing environments.Key Responsibilities:Designing and implementing high-performance data clustersMigrating data between different systems using efficient tools and techniquesPerforming performance tuning and optimization to ensure seamless data...

  • IT Infrastructure Lead

    1 day ago

    Madurai, Tamil Nadu, India beBeeNetwork Full time ₹ 30,00,000 - ₹ 50,00,000

    Lead IT Infrastructure ManagerWe are seeking a highly skilled Lead IT Infrastructure Manager to oversee the design, implementation, deployment and maintenance of network infrastructure. This role will ensure the continuous and secure flow of data between operational technology (OT) and information technology (IT) systems.The ideal candidate will have...

  • Data Analyst

    5 days ago

    Madurai, Tamil Nadu, India beBeeElasticsearch Full time ₹ 15,00,000 - ₹ 22,50,000

    About the Position:We are seeking a highly skilled professional to join our team as an Elasticsearch Specialist. The ideal candidate will have a passion for data analysis and a strong background in Elasticsearch cluster management, performance tuning, and scaling.Role: Elasticsearch SpecialistLocation: Remote or OnsiteExperience: 7-12 YearsJob Type: Full...

  • Data Infrastructure Specialist

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 6,00,000 - ₹ 10,00,000

    Lead Data Engineer PositionWe are seeking an experienced Lead Data Engineer with a strong background in data manipulation and infrastructure design.Job Description:Key Responsibilities: Design, implement, and maintain efficient data collection, transformation, and analysis systems using Python.Develop robust web scraping solutions to extract structured and...

  • Data Infrastructure Strategist

    5 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 17,66,000 - ₹ 21,13,000

    Job DescriptionData engineers play a pivotal role in driving clients' data modernization initiatives. As part of our team, you'll collaborate closely with experienced software, data, and devops engineers to lead and assist clients in their data journey.You will be the primary point of contact for clients, responsible for modernizing their data...

  • Data Infrastructure Specialist

    5 days ago

    Madurai, Tamil Nadu, India beBeedataengineering Full time US$ 12,00,000 - US$ 18,00,000

    Data Engineering Role",">This is a highly specialized position that focuses on the design, build and operation of scalable data infrastructure to support large-scale applications or research platforms."],

  • CMDB Technical Lead Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeServiceNow Full time US$ 90,000 - US$ 1,50,000

    **Job Title:** CMDB Technical Lead Specialist As a CMDB Technical Lead Specialist, you will be responsible for administering and executing configuration management changes in our IT infrastructure. You will ensure the integrity and robustness of our Configuration Management Database (CMDB) by identifying and resolving data inconsistencies. We are seeking a...