Cloud Data Engineering Leader

1 day ago

Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Job Title: Senior Data Engineer

We are seeking a highly experienced Senior Data Engineer with a strong focus on Databricks and cloud-based data engineering to lead our data engineering team.

This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and inspiring a team of data engineers.

Key Responsibilities:
  • Lead and manage a team of data engineers, providing mentorship, technical guidance, and fostering a culture of collaboration and innovation.
  • Architect, design, and oversee implementation of large-scale data pipelines, data lakes, and cloud-based data warehouses using Databricks, Apache Spark, and Snowflake.
  • Develop and optimize ETL/ELT workflows ensuring performance, reliability, and scalability of data infrastructure.
  • Collaborate with business stakeholders, data scientists, and software teams to understand requirements and translate them into scalable, efficient data solutions.
  • Implement best practices for data quality, governance, security, and compliance.
  • Drive continuous improvement of data engineering processes, standards, and tools across the organization.
  • Support presales activities by contributing to RFPs, technical proposals, and client engagements.
  • Stay abreast of emerging data technologies and trends, recommending innovative solutions to enhance analytics capabilities.
  • Manage resource planning, project prioritization, and delivery timelines ensuring alignment with business objectives.
  • Lead performance reviews, identify skill gaps, and champion professional development within the data engineering team.
  • Facilitate cross-team communication to streamline data workflows and improve overall delivery.
Required Skills and Qualifications:
  • Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related discipline.
  • Minimum 18 years of professional experience in data engineering with at least 12 years in leadership or senior technical roles.
  • Deep hands-on expertise with Databricks and Apache Spark for large-scale data processing.
  • Strong programming skills in Python, Scala, or Java.
  • Extensive experience with cloud data platforms such as AWS, Azure, or GCP, including services like S3, Redshift, BigQuery, Snowflake.
  • Solid understanding of data modeling, data warehousing, ETL/ELT design, and data lakes.
  • Experience with big data technologies like Hadoop, Kafka, and Databricks ecosystem.
  • Knowledge of CI/CD pipelines, data orchestration tools (e.g., Apache Airflow), and data governance best practices.
  • Proven experience managing high-performing teams and delivering complex data engineering projects on time.
  • Familiarity with analytics solutions and the ability to translate business needs into technical requirements.
  • Strong communication skills, capable of engaging with both technical teams and senior leadership.
  • Experience supporting presales efforts and client technical discussions is a plus.
  • Bonus: Exposure to machine learning lifecycle and model deployment on Databricks.

  • Cloud Data Engineer

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Description:We are seeking an experienced data engineer to join our team. As a senior member of the engineering group, you will be responsible for designing, developing and maintaining scalable and secure data solutions on Databricks.Key Responsibilities:Collaborate with business stakeholders, data scientists and analysts to deliver actionable insights...

  • Senior Cloud Data Architect

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderOverview: We are seeking a seasoned Cloud Data Engineering Leader to spearhead the development and implementation of data-intensive applications using cloud-native technologies.Key Responsibilities:Lead a team of Senior Engineers in designing and developing scalable data architectures on AWS and GCP.Collaborate with...

  • Leading Cloud Data Engineer

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Cloud Data Engineer PositionsTop cloud data engineering positions require highly specialized professionals with extensive knowledge of cloud computing platforms, including Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP).Key skills for these roles include expertise in data warehousing, big data processing, and data analytics,...

  • Data Engineering Leader

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 19,44,000 - ₹ 21,30,000

    Job Opportunity:We are seeking a seasoned data professional to lead our data engineering efforts.Key Responsibilities:Design and implement scalable data pipelines using cloud-based solutions.Architect data platforms with AWS, leveraging Spark, Kafka, Hive for processing.Develop robust schemas, ensure data compliance, and enforce security best...

  • Cloud Transformation Leader

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeTransformation Full time ₹ 35,00,000 - ₹ 40,00,000

    Cloud Transformation LeaderJob Description:The ideal candidate will lead strategic initiatives in cloud modernization, driving efficiency and innovation within our IT department.This pivotal role requires a strong understanding of cloud architecture principles, portfolio management, and end user deployment methodologies.You will collaborate with...

  • Expert Cloud Data Engineer

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer with Expertise in Cloud Technologies We are looking for a highly skilled Data Engineer with expertise in cloud technologies to join our team.About the Role:We are seeking an experienced Data Engineer who can design, develop and implement data solutions using Azure cloud technologies. The ideal candidate will have strong experience...

  • Cloud Data Engineering Position

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 26,25,000

    Job Title: Cloud Data EngineerJob OverviewWe are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team.Key ResponsibilitiesDesign and Develop Scalable Data Pipelines: Build, deploy, and maintain large-scale data pipelines on Google Cloud Platform (GCP).Develop and Maintain Data Warehouse Solutions: Design, implement, and optimize...

  • Senior Cloud Data Engineer(Lead)

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeCloudEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data Engineering LeadJob DescriptionWe are seeking an experienced Cloud Data Engineering Lead to join our team. As a key member of our data engineering organization, you will be responsible for designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Around 6+ years...

  • Data Engineering Leader

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeEngineering Full time ₹ 1,30,40,000 - ₹ 1,64,20,000

    Job Summary:We are seeking a seasoned Data Engineering Leader to spearhead the design and delivery of scalable, secure, and innovative data solutions.The ideal candidate will have extensive experience in Azure Data Platform, Microsoft Fabric, and Power BI, with a proven track record of leading high-performing teams and driving business outcomes.Key...

  • Cloud Data Engineer

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Cloud Data Engineering Position","We are looking for a skilled professional to develop and implement large-scale data pipelines using Azure Databricks.","","Design, deploy, and maintain scalable data processing architectures on Azure Databricks.","Collaborate with cross-functional teams to design and implement data warehousing and business intelligence...