Senior Data Engineering Specialist

1 week ago

Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Opportunity

We are seeking a skilled Data Engineer to play a critical role in designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.

This individual will work closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern Azure tools and best practices.

Main Responsibilities:

  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  • Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  • Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
  • Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  • Support data quality checks, logging, alerting, and observability mechanisms for production workloads.
  • Participate in sprint ceremonies and contribute to task estimation and delivery planning.

Required Skills:

  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
    • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
    • Azure Databricks – building and managing Spark jobs in PySpark.
    • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
    • Apache Kafka – consuming and processing real-time data streams.
  • Strong in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
  • Understanding of data lake architecture and modern data warehousing principles.

Nice-to-Have Skills:

  • Experience with Delta Lake, Event Hub, or Azure Stream Analytics.
  • Familiarity with infrastructure-as-code tools like Terraform or ARM templates.
  • Exposure to Data Governance, Data Quality frameworks, or metadata management.
  • Understanding of networking, security, and access control in Azure data services.

About This Role

This is an exciting opportunity to join our team as a skilled Data Engineer. If you have experience with designing and building scalable data pipelines, optimizing data workflows, and collaborating with cross-functional teams, we encourage you to apply.

  • Senior Cloud Data Engineering Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeCloudDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Cloud Data Engineering Specialist A senior cloud data engineering specialist is required to lead the design, development, and maintenance of large-scale data systems on Amazon Web Services (AWS). Job DescriptionThis role involves leading a team of data engineers to develop and implement data solutions that meet business requirements. The...

  • Senior Data Testing Engineer

    1 week ago

    Kozhikode, Kerala, India beBeeDataTesting Full time ₹ 9,00,000 - ₹ 12,15,000

    Data Testing SpecialistWe are seeking an experienced professional to fill the position of Senior Data Testing Engineer.Design, develop, and execute automated and manual test cases for data validation and transformation processes.Validate data integrity across various sources including APIs, databases.Collaborate with data engineers and developers to...

  • Senior Data Processing Specialist

    2 weeks ago

    Kozhikode, Kerala, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Summary:">As a senior data processing specialist, you will design and implement large-scale data systems using Python and PySpark.">"][

  • Senior Data Protection Specialist

    2 weeks ago

    Kozhikode, Kerala, India beBeeDataProtection Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data Protection SpecialistSummary:As a Senior Data Protection Specialist, you will be responsible for designing and implementing robust data backup and recovery solutions in our data centers. Your expertise in backup tools and tape libraries will ensure business continuity in the event of a disaster.Key Responsibilities:Backup Solutions...

  • Senior Data Engineer

    2 weeks ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer - AI/MLRole Summary:As a Senior Data Engineer with a focus on Artificial Intelligence (AI) and Machine Learning (ML), you will play a key role in driving our organization's digital transformation by designing, developing, and implementing scalable data architectures that support our business growth.Key Responsibilities:Design and...

  • Senior Data Engineer

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    As a senior data engineer, you will play a key role in designing and implementing scalable data pipelines on cloud platforms.Key Responsibilities:Design and develop extract, transform, load (ETL) processes using cloud-based services such as storage solutions, messaging systems, data processing engines, and data warehousing platforms.Become proficient in...

  • Senior IoT Data Engineering Specialist

    2 weeks ago

    Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a Senior IoT Data Engineer to help implement an application for a large retailer.Key Responsibilities:Design and develop scalable data processing systems using Python and PysparkAnalyze telemetry data from IoT systems, including refrigeration units, HVAC systems, controllers, and sensorsCollaborate with business stakeholders to understand...

  • Master Data Engineer

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking a skilled Senior Data Architect to spearhead our data warehousing and engineering efforts. In this role, you will be responsible for designing, building, and maintaining large-scale data systems that drive business growth.

  • Senior Data Integration Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About People Prime Worldwide:Our company enables enterprises to reimagine business models and accelerate innovation through digital technologies.We cater to over 700 clients with our extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes.Job Title: Senior Data Integration...

  • Senior Test Engineering Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeTestEngineer Full time ₹ 18,00,000 - ₹ 24,60,000

    As a senior test engineering specialist, you will play a pivotal role in ensuring the quality and reliability of our artificial intelligence-driven products.Key Responsibilities:Develop and execute comprehensive testing strategies focusing on both functional and non-functional testing.Design, develop, and maintain test automation frameworks to ensure high...