Senior Data Infrastructure Specialist

2 weeks ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000
Job Title">

Data Engineering Position

We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing and managing large-scale data pipelines using Spark and Python.

The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Responsibilities:

  • Design, implement and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation and quality checks for data workflows.
  • Manage multi-environment deployments ensuring reliability and consistency.
  • Write and maintain configuration files YAML JSON for workflows, pipelines and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern self-serve dashboards Snowflake Tableau Power BI.
  • Partner with cross-functional teams to understand needs and deliver data models insights and reporting they can trust.
  • Put guardrails in place with data contracts quality checks and documentation to ensure long-term reliability.

Requirements:

  • Strong skills in SQL Databricks Spark and Python R.
  • Strong knowledge of GitHub and CI/CD practices branch protection GitHub Actions workflows.
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles DABs or similar automation tools.
  • Familiarity with YAML configuration management debugging and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau Power BI dashboards and a good sense for usability.

Benefits:

This is a fantastic opportunity to work with cutting-edge technology and collaborate with a talented team of engineers.

How to Apply:

If you have the required skills and qualifications please submit your application including your resume and cover letter.

  • Senior Data Protection Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataProtection Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Protection SpecialistAbout the Role:We are seeking an experienced data protection professional to join our team as a senior data protection specialist. The role involves leading and executing data protection engagements, ensuring compliance with global data protection regulations, and embedding data protection by design into client...

  • Senior Data Infrastructure Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDatabaseEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Database Engineer Job DescriptionWe are seeking a highly skilled and motivated individual to join our team, focusing on core infrastructure that powers financial trading and analysis platforms.The ideal candidate will be responsible for designing, developing, and maintaining high-performance database systems that handle vast volumes of financial market...

  • Cloud Infrastructure Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeInfrastructure Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Cloud Infrastructure SpecialistWe are seeking a highly skilled Cloud Infrastructure Specialist to design and manage cloud infrastructure that powers high-traffic platforms.Your key responsibilities will include:Designing and maintaining scalable cloud environments.Automating deployments, scaling, and infrastructure monitoring for optimal performance.Ensuring...

  • Data Infrastructure Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeCloudEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    About the RoleThe role of Cloud Engineer involves designing, developing and implementing scalable cloud-based solutions using Azure technologies.Key ResponsibilitiesDesign and develop cloud infrastructure using Azure services such as Virtual Machines, Storage, Networking and Security.Implement and manage Azure resources including Azure Active Directory,...

  • Cloud Infrastructure Architect

    2 weeks ago

    Palakkad, Kerala, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Infrastructure SpecialistThis role involves working with customer engineering teams on a wide variety of cloud projects, including migration, containerization, and transformation initiatives.The ideal candidate will be part of a dynamic team designing, automating, and deploying cloud-based services.A highly skilled Cloud Infrastructure Specialist is...

  • Senior Server Infrastructure Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeInfrastructure Full time ₹ 8,00,000 - ₹ 15,00,000

    Server Engineer Job OpportunityWe are seeking a highly skilled Server Engineer to join our team.The ideal candidate will be responsible for managing, supporting, and optimizing server environments to ensure high availability, performance, and security.Key Responsibilities:Administer, monitor, and troubleshoot Windows Server environments...

  • Senior Data Architect

    2 weeks ago

    Palakkad, Kerala, India beBeeDataScientist Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Accelerating innovation in large-scale data processing is crucial for the future of education and research. We seek an experienced professional to contribute to our language model development efforts.About The RoleThis position plays a vital role in successful model training and evaluation, requiring collaboration with researchers to accelerate experiments,...

  • Big Data Integration Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataIntegration Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Big Data Integration SpecialistWe are seeking an experienced professional with expertise in data ingestion and pipeline development to join our team. This role requires a strong understanding of integrating various data sources into cloud-based platforms.The ideal candidate will have hands-on experience with data pipelines, automation, and...

  • Senior Network Infrastructure Planner

    2 weeks ago

    Palakkad, Kerala, India beBeeCapacity Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Network Capacity Manager RoleWe are seeking a skilled professional to fill the position of Network Capacity Manager. This individual will play a key role in ensuring that our supply chain has sufficient capacity to meet future demand.The selected candidate will be responsible for creating long-range capacity plans for various brands and technologies. They...

  • Lead Land Acquisition Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeProjectControl Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Renewable Energy Project Control SpecialistWe are seeking a highly skilled and experienced Renewable Energy Project Control Specialist to lead our land acquisition team in ensuring timely, accurate, and actionable reporting. This role is critical in supporting decision-making, performance tracking, and regulatory compliance across ongoing/planned renewable...