Senior Data Engineering Specialist

2 weeks ago

Palakkad, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Driven by innovation, we are seeking a seasoned Modern Data Solutions Architect to shape the future of data engineering. This pivotal role demands technical expertise, strategic vision, and leadership to deliver cutting-edge data solutions.

Key Responsibilities:
  • Design and lead advanced Databricks architectures, fostering scalability and performance.
  • Develop and optimize ETL/ELT pipelines using Python (PySpark), ensuring seamless data flow.
  • Implement and maintain CI/CD pipelines with Git/DevOps tools, streamlining development and deployment.
  • Create and manage scalable data lakes, warehouses, and lakehouses, leveraging industry best practices.
  • Optimize Databricks clusters, jobs, and workflows (batch and streaming) for maximum efficiency.

This is a full-time position with flexible shift timings. Our client is a leading AI-driven tech company transforming global enterprises with innovative solutions in data intelligence, automation, and responsible AI.

The ideal candidate will have 5+ years of data engineering experience, strong expertise in Databricks and Apache Spark, hands-on experience with Unity Catalog for governance, security, and lineage, and a proven track record of building and optimizing ETL pipelines. They should also have a solid understanding of CI/CD practices, Git integration, and automation for Databricks.

Requirements:
  • 5+ years of data engineering experience.
  • Strong expertise in Databricks and Apache Spark.
  • Hands-on experience with Unity Catalog for governance, security, and lineage.
  • Proven track record of building and optimizing ETL pipelines.
  • Solid understanding of CI/CD practices, Git integration, and automation for Databricks.

We seek a forward-thinking team member who can drive change with their ideas and leadership.

  • Senior Data Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistDescription:Our organization is seeking a highly skilled data engineer to lead our data engineering practice and drive initiatives to develop and continuously improve the Data/AI Practice.Key Responsibilities:Develop, implement, and optimize data pipelines for large-scale structured and unstructured datasets using...

  • Senior Big Data Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...

  • Cloud Data Engineer Position

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking a skilled data engineer to join our team and lead the development of large-scale data processing systems on Google Cloud Platform.

  • Senior Data Protection Specialist

    1 week ago

    Palakkad, Kerala, India beBeeDataProtection Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Protection SpecialistAbout the Role:We are seeking an experienced data protection professional to join our team as a senior data protection specialist. The role involves leading and executing data protection engagements, ensuring compliance with global data protection regulations, and embedding data protection by design into client...

  • Data Foundation Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataFoundation Full time ₹ 1,68,75,000 - ₹ 2,32,50,000

    Senior Data Foundation SpecialistWe are seeking an experienced Senior Data Foundation Specialist to craft and implement data strategies that drive business growth and optimize decision-making processes.Design and build comprehensive data solutions to fuel business expansion and enhance strategic decision-making.Mentor junior engineers and foster their skills...

  • Senior Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Engineering SpecialistAbout the RoleThe ideal candidate for this position will have a strong background in engineering, with experience in overseeing large-scale projects and managing teams.Sandoz is a global leader in sustainable Biosimilar and Generic medicines. We continue to go through an exciting and transformative period, presenting...

  • AWS Data Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,50,00,000

    AWS Data Engineering ExpertWe are looking for a highly skilled specialist with expertise in designing and implementing scalable IoT data solutions using AWS services. Key Responsibilities:Design, develop, and deploy data pipelines that cater to large-scale IoT data ingestion, processing, and storage architectures.Utilize Python programming skills to build,...

  • Cloud Data Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Engineering SpecialistWe are seeking a highly experienced cloud data engineering professional with 5+ years of experience in designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform.Key Responsibilities:Design and implement highly scalable, reliable, and secure data pipelines on GCP using...

  • AI Data Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 27,00,000

    AI Data SpecialistWe are seeking a highly skilled AI Data Specialist to join our team of experts in developing and implementing data-driven solutions for education and research.The ideal candidate will have a strong background in data engineering, with expertise in designing, building, and operating scalable, fault-tolerant data infrastructure to support...

  • Data Engineering and Quality Assurance Specialist

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000

    Job SummaryData Engineering and Quality Assurance SpecialistWe are seeking an experienced Data Engineering and Quality Assurance Specialist with a strong background in database engineering to join our data team.Key Responsibilities:Data Profiling: Analyze source data to understand data structures, distributions, and anomalies to ensure data quality and...