Cloud-Based Data Engineer Lead

1 day ago


Kollam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Lead Data Engineer Position

Job Summary:

This senior-level position is available for a highly skilled and experienced data engineer who can lead the development and implementation of scalable data pipelines using cloud-based technologies.

Responsibilities:

  • Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory to ensure reliable and efficient data processing.
  • Work with structured and unstructured data to build ingestion and transformation workflows across cloud platforms, ensuring scalability and reliability.
  • Collaborate with cross-functional teams, including data scientists, analysts, and application developers to support advanced analytics, reporting, and machine learning workflows.
  • Implement job orchestration, monitoring, and error handling for pipeline execution, ensuring high-quality data delivery.

Qualifications:

A Bachelor's degree in Computer Science, Engineering, or related field and 6+ years of experience in data engineering or cloud computing data development are required. Required skills include AWS Glue, ADF, Cloud Computing, Data Engineering, Python, Java, and Scalability.



  • Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job DescriptionWe are seeking a seasoned and proficient Senior Data Engineer with substantial experience in cloud technologies.As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.Key Responsibilities:Design,...

  • Cloud Data Engineer

    2 days ago


    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Data Engineer to spearhead our cloud-based data operations.Key Responsibilities:Data Pipeline DevelopmentDesign and develop scalable ETL pipelines using Azure Data Factory, Databricks, and Spark for batch data ingestion and egress.Data Transformation WorkflowsImplement data transformation workflows using PySpark and Scala Spark...


  • Kollam, Kerala, India beBeeCloudEngineer Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Cloud Data Engineer Role Overview">We are looking for a highly skilled professional to join our team as a Cloud Data Engineer. This is an excellent opportunity to utilize your expertise in cloud-based technologies, specifically Google Cloud Platform (GCP), and work on designing, developing, and maintaining large-scale data processing systems.Key...


  • Kollam, Kerala, India beBeeCloudTransformation Full time ₹ 18,00,000 - ₹ 20,00,000

    We are seeking a seasoned data engineer to lead cloud transformation initiatives, focusing on full lifecycle implementations from secure platform setup and cloud integration to high-performance data pipeline development.This role requires expertise in Snowflake, Terraform or Pulumi, CI/CD pipelines, ETL/ELT pipelines using dbt or Airflow, and integrating...


  • Kollam, Kerala, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Cloud data architects design, build and maintain infrastructure for storing, processing and retrieving data. This role involves developing scalable data pipelines using cloud services.Key Responsibilities:Designing data pipelines using Azure Data Factory and other relevant tools.Developing real-time data integrations using Kafka, MS Event Hubs and other...


  • Kollam, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Lead Data Platform Engineer - Product Development Specialist.A renowned corporation is seeking a skilled data engineer to manage the development and deployment of advanced data pipelines. The ideal candidate will possess expertise in cloud infrastructure, database management, and API design.Responsibilities include leading technical teams,...

  • GCP Data Engineer

    2 weeks ago


    Kollam, Kerala, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for GCP Data EngineerJob Location: Bangalore, Chennai , Hyderabad, PuneExperience required : 10 yrsSkills: GCP Data Engineer , Bigquery , PythonRequirements:- Proficiency in programming languages: Python, Java- Expertise in data processing frameworks: Apache Beam (Data Flow)- Active experience on GCP tools and...

  • Data engineer

    2 days ago


    Kollam, Kerala, India Centrilogic Full time

    Data EngineerPurpose:Over 15 years, we have become a premier global provider of multi-cloud management, cloud-native application development solutions, and strategic end-to-end digital transformation services.Headquartered in Canada and with regional headquarters in the U. S. and the United Kingdom, Centrilogic delivers smart, streamlined solutions to...

  • Cloud Engineer

    2 days ago


    Kollam, Kerala, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Engineer OpportunityWe are seeking an experienced Cloud Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining scalable, secure, and efficient cloud-based systems using Azure DevOps, AKS, and Terraform.About the Role:The Cloud Engineer will play a critical role in our team, focusing on the...