Cloud Data Engineering Specialist

22 hours ago

Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

Job Overview

This is a contract remote position for an experienced data engineer with 3–4 years of experience in designing, developing and maintaining large-scale data processing solutions using PySpark and Python.

We seek a highly motivated individual who can bring hands-on expertise in Spark, SQL, and real-time data streaming to contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure.

Main Responsibilities

  • Design, develop and optimize data pipelines using PySpark, Spark and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills & Qualifications

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Benefits

This role offers opportunities for professional growth and development in a dynamic environment.

Others

The ideal candidate will be able to think critically and creatively to solve complex problems.

  • Cloud Data Specialist

    1 day ago

    Belgaum, Karnataka, India beBeeCloudDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Opportunity: Cloud Data SpecialistExperience the thrill of working on a scrum team as a full-stack engineer.Design and develop scalable software modules that meet customer requirements while upholding high standards of reliability, security, maintainability, and performance.Collaborate with peers in defining product technical architecture.Deliverables...

  • Data Engineering Specialist

    4 days ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistJob Summary:We are seeking an experienced data engineering specialist to join our team. The ideal candidate will have a strong background in data engineering and experience with Google Cloud Platform.The successful candidate will be responsible for developing, constructing, testing and maintaining large-scale data acquisition...

  • Data Engineering Solutions Specialist

    2 days ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineering Solutions SpecialistJob Summary:We are seeking an experienced Data Engineering Solutions Specialist to design, develop and maintain large-scale data engineering solutions using Azure Databricks.Main Responsibilities:Develop and implement ETL (Extract, Transform, Load) processes to integrate data from various sources.Design and implement data...

  • Senior Cloud Data Engineering Specialist

    4 days ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking an experienced GCP Data Engineer to lead our data engineering initiatives. This role will involve designing, developing, and maintaining scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN.Key Responsibilities:Data...

  • Data Engineering Specialist

    4 days ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 50,00,000

    **Job Overview**We are seeking a skilled Data Engineering Specialist to join our team. In this role, you will be responsible for designing and implementing data engineering solutions that support our business needs.**Required Skills and Qualifications*** Bachelor's or Master's degree in Computer Science, Information Systems, Data Science, or related field.*...

  • Cloud Data Engineer Specialist

    2 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are currently seeking a skilled data engineer to contribute to our dynamic team.Key Responsibilities:Data Pipeline Development: Design and develop scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate data from various sources, ensuring data quality and consistency.Performance Optimization: Optimize...

  • Cloud Data Engineering Expert

    20 hours ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Overview of the Role:We are seeking an experienced Cloud Data Engineering Expert to lead our data engineering efforts on Google Cloud Platform (GCP).Key Responsibilities:Design and implement scalable data pipelines using GCP services such as Dataflow, Dataproc, Bigquery, and PubSub.Develop and maintain ETL processes in Python or Java to extract, transform,...

  • Cloud Security Engineer Specialist

    2 hours ago

    Belgaum, Karnataka, India beBeeCloudSecurity Full time US$ 1,20,000 - US$ 1,50,000

    Job Position: Cloud Security Engineer SpecialistA highly skilled professional is required to implement and manage cloud security practices across multiple environments.The ideal candidate will have a deep understanding of cloud security best practices and experience with Terraform and Infrastructure as Code principles.They will collaborate closely with...

  • Salesforce Data Cloud Specialist

    21 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Salesforce Data Cloud SpecialistWe are seeking a skilled data professional with expertise in designing and implementing data solutions using Salesforce Data Cloud.The ideal candidate will have experience in data modeling, ETL, and integrations. Key responsibilities include designing, configuring, and implementing Data Cloud solutions, defining and...

  • Cloud Data Engineer

    2 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewOur organization is seeking an experienced and skilled data engineer to lead the design, development, and optimization of data pipelines and integration solutions in a cloud-based environment.Required Skills & QualificationsProficiency in SQL, Python, and Scala programming languages.Strong knowledge of Azure Cloud services, ADF, and...