Data Engineer Leader

8 hours ago

Palakkad, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Senior Data Engineering Specialist

 

Job Title: Senior Data Engineering Specialist

Experience Level: 5+ Years

Key Responsibilities:

  • Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.
  • Design and implement scalable data architectures following Medallion Architecture and best practices.
  • Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.
  • Develop and maintain data lake solutions in Azure Data Lake Storage (ADLS) Gen2.
  • Write and optimize SQL queries for data extraction, transformation, and analysis.
  • Implement CI/CD pipelines for data workflows using Azure DevOps.
  • Collaborate with stakeholders to understand data requirements and ensure data availability.
  • Ensure data governance, security, and compliance in Azure-based data solutions.
  • Monitor and troubleshoot data pipelines to maintain reliability and performance.
  • Stay updated with the latest Azure and big data technologies and implement best practices.
  • Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
  • Carrying out POCs to make sure that suggested design/technologies meet the requirements.

Required Skills and Qualifications:

  • Strong experience in Azure Data Engineering with Data Factory, Synapse, Fabric, Databricks.
  • Expertise in SQL, T-SQL, and Python for data processing and transformation.
  • Hands-on experience with PySpark for big data processing.
  • Experience in designing ETL/ELT pipelines and working with large datasets.
  • Proficiency with Azure Data Lake (ADLS) Gen2 for data storage and processing.
  • CI/CD and DevOps knowledge, including Azure DevOps, Git, and automated deployments.
  • Understanding of data modeling, data warehousing, and schema design principles.

Desirable Skills:

  • Experience in New Age Technologies like Low Code, No Code, DevOps.
  • Familiarity with Data Governance and Security best practices in cloud-based data solutions.
  • Experience with real-time data processing using Kafka, Event Hub, or Stream Analytics is a plus.
  • Knowledge of DataOps methodologies and best practices.
  • Experience with APIs, REST services, and integrating third-party data sources.
  • Familiarity with Power BI or other visualization tools is an added advantage.

  • Data Engineering Leader

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerAre you an expert data engineer looking to build large-scale data platforms on Google Cloud? We're seeking a talented professional with experience in designing and building robust data pipelines for ingestion, transformation, and analytics.Key Responsibilities:Design and develop efficient data pipelines using modern tools and...

  • Senior Data Engineering Leader

    5 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Engineering Manager RoleWe are seeking an experienced Engineering Manager to lead our team of data engineers in designing and delivering scalable data pipelines and analytics platforms.

  • Data Architect

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to design, build and optimize scalable data pipelines using Azure technologies.The ideal candidate will work closely with cross-functional teams to deliver robust, secure and high-performance data solutions that empower analytics and data science initiatives.Responsibilities include:Design, develop and...

  • Senior Data Leader

    4 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Director, Real World DataDescription:The Senior Director (Real World Data) is a senior leadership position within our organization. This role involves owning and managing a significant body of work, as well as providing support to the RWD team for other parts of the organization.Key responsibilities include leading a team of analysts who support the...

  • Data Systems Engineer

    3 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled professional to lead our data engineering efforts. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business needs.Work closely with our data science team to develop complex algorithms that provide unique insights into our data.Utilize agile...

  • Senior Engineering Leader

    4 days ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Overview:Seeking a seasoned leader to oversee engineering teams and drive strategic product development.Drive product delivery and project commitments through effective team leadership.Contribute to product roadmap discussions, providing expertise on design, modeling, and architecture.Lead the development of innovative products, solutions, and...

  • Data Strategy Leader

    4 days ago

    Palakkad, Kerala, India beBeeDataStrategy Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Strategy LeadWowjobs is seeking a seasoned data strategy professional to lead the development and implementation of strategic plans for delivering complex data projects.Key Responsibilities:Define and implement best practices and standards for data project execution.Monitor project health through key performance indicators (KPIs), metrics, and...

  • Senior Hospitality Engineer Leader

    3 days ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:The Corporate Chief Engineer is a strategic leader responsible for overseeing engineering operations across all resorts. This role involves developing and standardizing engineering policies, leading capital expenditure projects, and setting benchmarks for property-level engineering teams.Key responsibilities include maintaining optimal...

  • Data Engineer

    4 days ago

    Palakkad, Kerala, India Impetus Full time

    Skills: Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark; Good to have : GCP/any cloudRoles/Responsibilities:Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Science Leader

    2 days ago

    Palakkad, Kerala, India beBeeMachine Full time US$ 1,60,000 - US$ 2,40,000

    Our organization is dedicated to advancing public health and food safety through innovative technology. We are seeking a skilled professional to design, train, and deploy machine learning models for real-world applications.Key Responsibilities:Develop scalable machine learning models utilizing diverse datasets and algorithmsCollaborate with cross-functional...