Senior Cloud Data Developer

2 weeks ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Description

We are seeking a skilled Data Engineer to lead the development of large-scale data processing solutions. The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming.

The successful candidate will contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure.

This is a contract remote role requiring strong problem-solving skills, excellent written and verbal communication skills, and ability to work independently in a fast-paced environment.

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services.
  • Debug, troubleshoot, and optimize code for performance and scalability.
Required Skills & Qualifications

The following qualifications are required:

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services.
  • Experience working with Apache Kafka or other real-time streaming technologies.
Benefits

This is a contract role offering the opportunity to work on challenging projects and collaborate with cross-functional teams.

Others

The ideal candidate will bring exposure to CI/CD pipelines for data solutions, knowledge of data governance and security best practices, and experience with Agile/Scrum methodology.

  • Senior Cloud Data Scientist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Role:Senior Data Engineer with GCP, ETLAs a Senior Data Engineer at our company, you will play a crucial role in designing and developing large-scale data processing systems.Key Responsibilities:Design and develop efficient ETL pipelines on Google Cloud Platform (GCP) using Python or Java.Built and maintain large-scale data processing systems using GCS,...

  • Cloud Data Architecture Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Cloud Data EngineerWe are seeking a highly skilled Senior Cloud Data Engineer to lead the development of foundational components for a Lakehouse architecture on AWS. This role will drive the migration of existing data processing workflows to the new Lakehouse solution, leveraging Iceberg capabilities.Main ResponsibilitiesDesign and implement scalable...

  • Senior Cloud Data Engineering Manager

    2 weeks ago

    Palakkad, Kerala, India beBeeCloud Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Cloud Data Engineering ManagerExperience: 13+ years, Location: Major Indian CitiesAbout the Role:We are looking for a seasoned Delivery Lead/Program Manager to drive large-scale cloud data engineering and platform programs.Key Responsibilities:Lead planning, execution, and delivery of large-scale cloud data engineering and platform...

  • Lead Cloud Data Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data EngineerWe are seeking a skilled professional to design, develop, and optimize data solutions in the cloud.Main Responsibilities:Design and develop advanced data pipelines for batch data ingestion and egress.Build scalable data solutions using Azure Data Factory, Databricks, Spark, and other Azure services.Troubleshoot data jobs and...

  • Principal Cloud Data Architect

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 21,00,000 - ₹ 42,00,000

    Senior Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer/Business Intelligence Specialist with expertise in big data processing, cloud-based analytics, and advanced visualisation technologies.The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, Azure data services, Python programming, and emerging...

  • Senior Cloud Data Engineer

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Cloud Data ArchitectWe are seeking skilled Cloud Data Architects to design, build, and manage robust data pipelines that power AI solutions on AWS. The role focuses on developing efficient ETL/ELT workflows, ensuring data quality, security, and scalability to support AI/ML model training, inference, and intelligent decision-making processes in a cloud-native...

  • Senior Cloud Data Migration Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataMigration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced professional to lead our data migration efforts and oversee the development of cloud-based data solutions.The ideal candidate will have strong technical expertise, excellent leadership skills, and the ability to collaborate effectively with cross-functional teams.The following responsibilities will be key to...

  • Senior Data Pipeline Developer

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer PositionWe are seeking a skilled Data Engineer to join our team. As a key member of the data team, you will be responsible for designing and developing scalable data pipelines using Google Cloud Platform (GCP) tools.This is a remote opportunity that requires 10+ years of experience in data engineering with a focus on real-time and big query...

  • Cloud Data Architect

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Cloud Data Architect PositionWe are seeking a highly skilled Cloud Data Information Architect to join our team. The successful candidate will have a strong core skillset in implementing cloud data pipelines using AWS Databricks, Snowflake, Python, and Fivetran.The ideal candidate will have experience working on projects involving AWS Databricks and Python,...

  • Cloud Data Engineer

    2 weeks ago

    Palakkad, Kerala, India beBeeCloud Full time ₹ 12,99,150 - ₹ 20,31,757

    Cloud Data Engineering ExpertWe are seeking a highly skilled Cloud Data Engineering Expert to join our team.The ideal candidate will have extensive experience working with cloud-based data platforms, including Azure Data Factory and Databricks.They will be responsible for designing, implementing, and maintaining large-scale data pipelines, as well as...