Senior Cloud Data Engineer

1 day ago


Kollam, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Key Engineering Role

The Data Engineer will be responsible for developing and implementing large-scale data engineering solutions using Python, SQL, and distributed data processing technologies. This role requires a strong background in database management and experience with at least one cloud platform.

Responsibilities
  • Design and build production-ready ETL pipelines to model and transform massive datasets (TBs) in cloud environments.
  • Collaborate with cross-functional teams to integrate data engineering solutions with existing systems and applications.
  • Implement data lake and data lake house patterns to optimize data storage and querying performance.
Requirements
  • Proficient in Python, including popular packages like Pandas and NumPy.
  • Strong background in SQL and database management.
  • Development experience with at least one cloud platform (Azure is highly preferred).
  • Knowledge of data structures, algorithms, and software engineering best practices.
Preferred Skills
  • Experience with Azure Databricks for scalable data processing.
  • Knowledge of DevOps practices for ETL pipeline orchestration using tools like GitHub Actions, Terraform, and Azure DevOps.
  • Certifications in Databricks, Azure, AWS, or GCP are highly preferred.
Work Environment
  • Hybrid work mode combining remote and on-site work arrangements.
  • Immediate start available.
Education
  • Bachelor's degree in Computer Science or related field.
Skills
  • Python
  • SQL
  • Distributed Data Processing
  • Apache Spark
  • Hadoop
  • Cloud Development
  • Azure
  • AWS
  • GCP
  • ETL Performance Tuning
  • Cost Optimization
  • DevOps
  • GitHub Actions
  • Terraform
  • Databricks Workflows
  • Code Version Control


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job DescriptionWe are seeking a seasoned and proficient Senior Data Engineer with substantial experience in cloud technologies.As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.Key Responsibilities:Design,...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Lead Data Engineer PositionJob Summary:This senior-level position is available for a highly skilled and experienced data engineer who can lead the development and implementation of scalable data pipelines using cloud-based technologies.Responsibilities:Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and...


  • Kollam, Kerala, India beBeeDatabricksspecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a seasoned professional to serve as a Senior Databricks Data Engineer on our data engineering team. This is an exciting opportunity for the right candidate to utilize their skills in PySpark, CI/CD pipelines, and Terraform for infrastructure as code to drive success in our organization.Design, develop, and maintain scalable and...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 60,00,000 - ₹ 80,00,000

    Senior Cloud Data EngineerWe are seeking a seasoned Senior Cloud Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and deploying large-scale data pipelines on cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and others.The ideal...

  • Cloud Data Engineer

    2 days ago


    Kollam, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining large-scale data processing systems in the cloud.Key Responsibilities:Design and implement scalable data pipelines using AWS services such as Glue, EMR, and Kinesis.Develop and maintain...


  • Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Engineer">Description:We are seeking a highly skilled Cloud Data Engineer to design and develop scalable data pipelines using Oracle Data Flow or Apache Spark (PySpark). The successful candidate will have strong expertise in designing and developing data pipelines, with a solid understanding of data patterns, Python, and SQL.The ideal...

  • Cloud Data Engineer

    5 days ago


    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Data Engineer to spearhead our cloud-based data operations.Key Responsibilities:Data Pipeline DevelopmentDesign and develop scalable ETL pipelines using Azure Data Factory, Databricks, and Spark for batch data ingestion and egress.Data Transformation WorkflowsImplement data transformation workflows using PySpark and Scala Spark...


  • Kollam, Kerala, India beBeeCloudEngineer Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Cloud Data Engineer Role Overview">We are looking for a highly skilled professional to join our team as a Cloud Data Engineer. This is an excellent opportunity to utilize your expertise in cloud-based technologies, specifically Google Cloud Platform (GCP), and work on designing, developing, and maintaining large-scale data processing systems.Key...


  • Kollam, Kerala, India beBeeData Full time US$ 1,50,000 - US$ 2,50,000

    About Our Data Engineer RoleWe are seeking a highly skilled Data Engineer to join our team and contribute to the design, implementation, and maintenance of robust data pipelines and scalable data lakes using cloud-native tools and technologies.The ideal candidate will have hands-on experience with cloud platforms (AWS, Azure, GCP) and cloud-native ETL tools...