Cloud Data Engineering Expert

4 days ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer - Cloud Architect

Role Overview

This is a contract remote opportunity for a seasoned Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions.

The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming to contribute to the design and implementation of scalable data pipelines in cloud environments.

Key Responsibilities
  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services.
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
Requirements
  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services.
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
Nice-to-Have Skills
  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.

  • Cloud Engineering Expert

    6 days ago

    Gulbarga, Karnataka, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Informatica Engineer**Job Description:** We are seeking a highly experienced and skilled Informatica Engineer to design and develop cloud-based ETL pipelines using Azure services and integrate data into AWS Datalake or other modern data platforms.The ideal candidate will have strong hands-on experience in Informatica and cloud-based...

  • Cloud Data Engineer

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking a seasoned data engineering expert to join our team and drive the design, development, and optimization of scalable data pipelines on cloud platforms.About the Role:This is an excellent opportunity for a talented individual to lead the implementation of data ingestion, transformation, and integration solutions using big data...

  • Cloud-Based Data Engineer

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a seasoned Data Engineer to spearhead the development of large-scale data pipelines and architectures.The ideal candidate will have 6–12 years of experience in cloud-based data processing and analytics, with a strong focus on data engineering and design.Key Skills We're Looking For:Expert knowledge of GCP services, including...

  • Cloud Data Engineering Expert

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data Engineer: Transforming InsightsWe are seeking an accomplished data engineer with expertise in processing large datasets, cloud-based analytics, and advanced visualization techniques to drive strategic decision-making.Develop and implement scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, and Azure Data Factory to streamline data...

  • Cloud Data Engineer

    7 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Are you a skilled data professional looking for a challenging role in cloud-based data engineering?We are seeking an experienced developer with expertise in AWS serverless technologies, including Athena, Python code, Glue, Lambda, DMS, RDS, Redshift, and Cloud Formation.Key Responsibilities:Data Architecture: Design, implement, and maintain the data...

  • Senior Cloud Data Specialist

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking a highly skilled Cloud Architect to lead the design, development, and optimization of large-scale data pipelines and architectures.The ideal candidate is a seasoned data expert with hands-on experience in cloud environments, particularly AWS. This individual will serve as a Cloud Development expert, mentoring and guiding other...

  • Expert Cloud Data Professional

    6 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 14,00,000

    Cloud Data SpecialistDesign, develop, and implement cloud-based data processing solutions.To succeed in this role, you should have 3-5 years of experience in designing and developing scalable data pipelines using AWS services. You should be proficient in programming languages such as Python and have hands-on experience with tools like PySpark and Databricks....

  • Cloud Data Engineer

    7 days ago

    Gulbarga, Karnataka, India beBeeCloudEngineer Full time US$ 9,00,000 - US$ 12,00,000

    Job Title: Cloud Data EngineerAs a seasoned data professional, you will be at the forefront of our cloud data solutions. You will be responsible for designing and developing scalable data pipelines using Google Cloud Platform tools.This is an opportunity to work on challenging projects in various industries including Energy, Oil & Gas, Healthcare, and...

  • Cloud Data Engineering Leader

    1 week ago

    Gulbarga, Karnataka, India beBeeCloud Full time ₹ 2,01,20,000 - ₹ 2,61,50,000

    Job DescriptionAs a seasoned Technical Delivery Lead, you will spearhead the migration of an on-premises Enterprise Data Warehouse to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake. Your expertise in managing and guiding the development of cloud-native ETLs and data pipelines will be instrumental in ensuring seamless...

  • Cloud Data Solutions Engineer

    4 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,56,25,000 - ₹ 2,51,25,000

    Job Title: Cloud Data Solutions EngineerDescription:We are seeking a skilled Cloud Data Solutions Engineer to join our team. The ideal candidate will have experience in designing, implementing, and managing large-scale data systems on Google Cloud Platform.Required Skills and Qualifications:Bachelor's degree in Computer Science, Engineering, or a related...