Lead Data Engineering Expert

1 day ago

Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,40,000 - ₹ 2,01,60,000

Job Title: Senior Data Engineering Lead

We are seeking a visionary data engineering leader with strong focus on Databricks and cloud-based data engineering to design, develop, and manage scalable data infrastructure and pipelines. This role requires collaboration with business stakeholders, data scientists, and software teams to understand requirements and translate them into efficient data solutions.

Key Responsibilities:

  • Mentor and lead a team of data engineers providing technical guidance, fostering a culture of innovation, and ensuring alignment with business objectives.
  • Architect, design, and oversee implementation of large-scale data pipelines, data lakes, and cloud-based data warehouses using Databricks, Apache Spark, and Snowflake.
  • Develop and optimize ETL/ELT workflows ensuring performance, reliability, and scalability of data infrastructure.
  • Collaborate with cross-functional teams to drive continuous improvement of data engineering processes, standards, and tools.
  • Support presales activities by contributing to technical proposals and client engagements.
  • Stay abreast of emerging data technologies and trends recommending innovative solutions to enhance analytics capabilities.
  • Manage resource planning, project prioritization, and delivery timelines ensuring seamless execution.

Qualifications & Skills:

  • Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related discipline.
  • Minimum 18 years of professional experience in data engineering with at least 12 years in leadership or senior technical roles.
  • Deep hands-on expertise with Databricks and Apache Spark for large-scale data processing.
  • Strong programming skills in Python, Scala, or Java.
  • Extensive experience with cloud data platforms such as AWS, Azure, or GCP including services like S3, Redshift, BigQuery, Snowflake.
  • Solid understanding of data modeling, data warehousing, ETL/ELT design, and data lakes.
  • Experience with big data technologies like Hadoop, Kafka, and Databricks ecosystem.
  • Knowledge of CI/CD pipelines, data orchestration tools (e.g., Apache Airflow), and data governance best practices.
  • Proven experience managing high-performing teams and delivering complex data engineering projects on time.
  • Familiarity with analytics solutions and the ability to translate business needs into technical requirements.
  • Strong communication skills capable of engaging with both technical teams and senior leadership.

  • Strategic Data Engineering Lead

    3 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    We are seeking an experienced Senior Data Engineer to play a key role in our projects.Key Responsibilities:Lead team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation.Design and implement data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step...

  • Data Solution Expert

    3 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Expert Data SolutionsMcDonald's is a leading employer with global operations in over 100 countries. We seek professionals who will strengthen our data capabilities and support strategic business objectives.We are looking for an experienced Data Engineer to join our team. This individual will collaborate with data experts, analysts, and other cross-functional...

  • Lead Data Engineer

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    About Data EngineeringData engineers play a pivotal role in driving innovation and delivering cutting-edge solutions to propel business growth.Job Description:We are seeking an experienced data engineer to lead the design, implementation, and deployment of enterprise data platforms. As a key member of our team, you will be responsible for architecting...

  • Data Engineering Expert

    3 days ago

    Palakkad, Kerala, India beBeeEngineering Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Data Engineering ExpertAbout the Role:We seek an accomplished Data Engineer with a proven track record in designing and implementing data solutions utilizing Google Cloud Platform (GCP) services.The ideal candidate will possess strong knowledge of data warehousing, big data, and data analytics, along with experience in programming languages such...

  • Data Engineering Expert

    2 days ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Opportunity: Data Engineering ExpertKey Responsibilities:Data Engineering & Development: Spearhead the creation and maintenance of a robust data lake, integrating insight platforms to support informed decision-making across the organization.Data Ingestion and Warehousing: Consolidate disparate datasets to drive business insights and growth. Design ETLs...

  • Data Engineering Team Lead

    2 days ago

    Palakkad, Kerala, India beBeeDomain Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled and dynamic individual to lead our Data Engineering team. This role is based in Palakkad, India, and requires a hybrid work arrangement with a minimum of three days per week in the office.Key Responsibilities:Develop a deep understanding of global market dynamics and become a principal domain...

  • Cloud Data Engineering Expert

    1 day ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering ExpertAbout Us :Our vision to be a leader in business transformation drives our efforts to drive client success.The role of a Cloud Data Engineer involves utilizing advanced data engineering skills to design, build, deploy, scale, and maintain large-scale data processing systems on the cloud.Mandatory skills include:Expertise in data...

  • Data and AI Expert

    1 week ago

    Palakkad, Kerala, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:We're seeking an expert in data and AI to drive the development of our training content. As a Subject Matter Expert, you'll lead the definition and review of presentations, labs, and real-world scenarios on modern data and AI stack, working closely with content creators to shape advanced learning experiences.Main Responsibilities:Develop and...

  • AWS Data engineer/Architect

    2 days ago

    Palakkad, Kerala, India Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...

  • Azure Data Expert

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 17,04,000 - ₹ 21,12,000

    Expert in Azure Data and AI EngineeringWe are seeking an accomplished professional to lead the technical definition and review of presentations, labs, and real-world scenarios on Azure's modern data and AI stack. This individual will collaborate closely with content creators to shape advanced, certification-aligned learning experiences.Key...