Data Engineering Specialist

22 hours ago

Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Data Engineering Expert

About the Role:

We are seeking a skilled data engineer to play a critical role in designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.

The ideal candidate will work closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern Azure tools and best practices.

Key Responsibilities:

  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS ensuring real-time near-real-time availability.
  • Implement data modeling strategies including star schema and snowflake schema analytics consumption layers in Synapse ADLS.
  • Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps GitHub Actions).
  • Monitor, troubleshoot, and optimize data workflows performance, cost-efficiency, and reliability.
  • Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  • Support data quality checks, logging, alerting, and observability mechanisms for production workloads.
  • Participate in sprint ceremonies, contribute to task estimation, and delivery planning.

Required Skills and Qualifications:

• 5+ years of experience in data engineering roles.

• Hands-on experience with:

○ Azure Data Factory (ADF) building pipelines triggers linked services.

○ Azure Databricks building managing Spark jobs PySpark.

○ Azure Synapse Analytics data warehousing SQL queries workspace orchestration.

○ Apache Kafka consuming processing real-time data streams.

• Strong SQL, Python, Spark data manipulation, and transformation skills.

• Exposure to CI/CD practices, Azure DevOps, Git workflows, build/release pipelines.

• Understanding of data lake architecture and modern data warehousing principles.

Nice-to-Have Skills:

• Experience with Delta Lake, Event Hub, and Azure Stream Analytics.

• Familiarity with infrastructure-as-code tools Terraform ARM templates.

• Exposure to Data Governance, Data Quality frameworks, metadata management.

• Understanding of networking security access control Azure data services.

Preferred Certifications:

• Microsoft Certified: Azure Data Engineer Associate.

• Databricks Certified Associate Developer for Apache Spark.

• Azure Fundamentals (AZ-900) optional but helpful.

  • Cloud Data Engineering Specialist

    7 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineering SpecialistWe are seeking an experienced and skilled data engineering professional to join our team.The ideal candidate will have a strong background in designing, building, and optimizing scalable data pipelines on Google Cloud Platform (GCP).Data Pipeline Responsibilities:Design and develop efficient data pipelines using GCP tools and...

  • AWS Cloud Data Engineering Professional

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 30,00,000

    Cloud Data Engineering SpecialistWe are seeking a seasoned Cloud Data Engineering Specialist to design, develop, and maintain robust data pipelines using Apache Spark and AWS services.The ideal candidate will have deep expertise in building scalable cloud-based data architectures and hands-on experience with the AWS ecosystem.

  • Data Validation Specialist

    5 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 30,00,000

    Data Validation SpecialistJob Title: Data Validation SpecialistJob SummaryThe role of the Data Validation Specialist will be to support a critical data migration initiative, testing the transition from a legacy application to a modernized platform. The specialist will be responsible for ensuring data integrity and dashboard accuracy throughout the...

  • Data Engineer- Cloud Specialist

    1 week ago

    Thrissur, Kerala, India beBeeCloudSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineer - Cloud SpecialistWe are seeking a highly skilled data professional to manage the implementation and maintenance of cloud-based systems.Responsibilities:Technical Expertise: Deep understanding of Apache Ray and its application in production environments.Infrastructure Management: Operate, monitor, and triage all aspects of our...

  • Data Engineering Specialist

    3 days ago

    Thrissur, Kerala, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will design, develop, and maintain large-scale data processing systems using cloud-based technologies such as Azure Databricks and Snowflake.About the Role:This is an exciting opportunity for individuals who enjoy working with big data,...

  • AWS Data Engineer Position

    22 hours ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 14,00,000

    Job Title: Data Processing Specialist">About the Role:The ideal candidate will have experience with AWS, Python, and PySpark.They will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks.Key Responsibilities:Develop scalable and efficient data pipelines using AWS services.Collaborate with...

  • Data Engineering Specialist

    3 days ago

    Thrissur, Kerala, India beBeeAzure Full time ₹ 20,00,000 - ₹ 30,00,000

    Azure Data Engineer Role OverviewThis is a key position in our organization's efforts to successfully migrate large-scale SQL workloads from on-premise environments to Azure. As a skilled Azure Data Engineer, you will lead the migration process, ensuring high data integrity, minimal downtime, and performance optimization. Key Responsibilities Data Pipeline...

  • Data Engineering Specialist

    2 weeks ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 17,50,000

    About this role\This is a key position in our organization that focuses on data engineering and architecture. We are looking for an experienced professional to join our team and contribute to the development of innovative solutions using big data, cloud-based technologies, and advanced analytics.\

  • Data Architect Specialist

    3 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 3,60,000 - ₹ 6,00,000

    Job Opportunity: Data Architect SpecialistAbout the Role:We are seeking an accomplished professional to join our team as a Data Architect Specialist. As a key member of the data engineering team, you will be responsible for designing and implementing scalable data solutions using cutting-edge technologies.Key Responsibilities:Develop robust data pipelines...

  • Data Operations Specialist

    1 week ago

    Thrissur, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Operations SpecialistThe Technical Business Analyst role is a key position within the organization, supporting critical operations across process improvement, data platform engineering, and automation. This role contributes to the customer's strategic vision of expanding EDP data entitlement.Main Responsibilities:Process Improvement &...