Senior Cloud Data Engineer

1 week ago

Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title:

Senior Cloud Data Engineer - Azure, PySpark, Python

Overview

We are seeking a highly motivated and experienced Senior Cloud Data Engineer to join our team. The ideal candidate will have hands-on expertise in designing, developing, and optimizing large-scale data processing solutions using PySpark, Spark, and Python.

Key Responsibilities

  • Design and develop scalable data pipelines in cloud environments such as Azure.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills & Qualifications

  • 4+ years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.

Benefits

Nice-to-Have Skills

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Cloud Data Engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Architect">The role of Cloud Data Architect is to lead and manage the development, deployment, and maintenance of cloud-based data systems. This includes designing and implementing scalable, secure, and reliable architectures for storing and processing large amounts of data in the cloud.">Key Responsibilities:Design and implement cloud-based data...

  • Senior Cloud Data Specialist

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Cloud Data SpecialistThis position plays a key role in designing and building scalable data architectures, leveraging cloud-based services such as Amazon Web Services (AWS) Glue, EMR/Spark, and Kafka/Kinesis streaming. We are seeking an experienced Senior Cloud Data Specialist to join our team.Key Responsibilities:Data Engineering: Develop...

  • Cloud Data Engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineer – BFSI DomainWe are seeking a skilled Cloud Data Engineer to work on our client project in the BFSI domain.Collaborate with data science teams to implement advanced analytics solutions and complex algorithms.Design, build, and maintain ETL pipelines for efficient data aggregation and transformation.Use agile development practices to...

  • Cloud Data Engineer

    6 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Specialist RoleWe are seeking an experienced Cloud Data Specialist to help design and develop efficient data pipelines, orchestrate workflows, and integrate with various APIs and CI/CD tools.ResponsibilitiesDesign and implement scalable data pipelines using Google Cloud Platform tools such as BigQuery, Dataflow, and Dataproc.Orchestrate complex...

  • Senior Data Engineer

    6 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering Role for Cloud Big Data PlatformsAbout the Position:We are seeking a highly skilled and experienced Senior Data Engineer to administer and monitor our cloud-based big data platforms.Key Responsibilities:Administer and monitor Big Data Platform components (Hadoop, Hive, HBase, BigSQL, etc.)Support technical and application team requests (data...

  • Senior Cloud Data Architect

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineer Are you a skilled data engineer with expertise in AWS technologies? Do you have a passion for designing and implementing scalable data pipelines?We are seeking an experienced Senior Data Engineer to join our team, where you will play a key role in developing and maintaining large-scale data processing systems using AWS...

  • Cloud Data Engineer Wanted

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer PositionWe are seeking an experienced Cloud Data Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems on the Microsoft Azure platform.The ideal candidate will have a strong background in data engineering, cloud computing, and big data...

  • Senior Cloud Data Engineering Specialist

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Are you a skilled Cloud Engineer with expertise in big data processing and cloud-based analytics?Key Responsibilities:Design, develop and maintain scalable pipelines using Apache Airflow and Azure Data Factory.Integrate and manage structured and unstructured data from diverse sources including Azure Cosmos DB and Azure Synapse Analytics.Implement IoT data...

  • Senior Cloud Data Architect

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time

    Cloud Data Engineer PositionWe are seeking a highly motivated and experienced Cloud Data Engineer to design, build, and maintain robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.About the Job:Create scalable data pipelines using cloud services (GCP, AWS, or...

  • Data Engineer Lead

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking an experienced data professional to fill a key role in our organization.The ideal candidate will have a strong background in data engineering, with expertise in designing and building scalable data pipelines on cloud-based platforms. They will also have hands-on experience with big data processing technologies like Apache...