Leading Cloud-Based Data Engineer

3 days ago

Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000
Job Title:

Senior Data Scientist and Engineer

Role Overview

This is a contract remote opportunity. We are seeking an accomplished Senior Data Scientist and Engineer with 3–4 years of experience in designing, developing, and optimizing large-scale data processing solutions.

·         Location: Remote.

·         Job type: Contract

Key Responsibilities

  • Design, develop, and optimize data pipelines using Spark, Hive, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in cloud services (e.g., Azure).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills & Qualifications

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Cloud Data Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    About Us:We are a data analytics firm assisting enterprises and brands in making informed decisions.Our work spans data extraction, transformation, visualization, and analysis delivered via industry leading solutions.We play at the intersection of data analytics and e-commerce, both game changers in their respective fields.The Role:Design, implement, and...

  • Chief Cloud Data Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Summary:Lead data engineering teams to develop scalable solutions for advanced analytics and reporting. Collaborate with cross-functional teams to design, build, and optimize ETL/ELT pipelines using cloud-based technologies.Main Responsibilities:Design and develop data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Work with structured...

  • Cloud-Based Data Processing Specialist

    5 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled professional to enhance our Data Engineering team with expertise in data processing, pipeline development, and cloud-based solutions.Key responsibilities include developing and maintaining Azure Functions for data processing, building ELT pipelines with ADF / Azure Data Services, working on Snowflake, Azure SQL & Data Lake for data...

  • Senior Cloud Data Engineer

    6 days ago

    Allahabad, Uttar Pradesh, India beBeeCloudDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAbout the Role:We are seeking a seasoned Cloud Data Engineer to join our team. As an expert in cloud data engineering solutions, you will be responsible for designing, developing, and implementing scalable, distributed systems on AWS.Key Responsibilities:Architect and deliver highly scalable, distributed cloud-based enterprise data...

  • Cloud Data Engineering Lead

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior AWS Data Engineer Job DescriptionWe are seeking a highly skilled Senior AWS Data Engineer to join our team.The ideal candidate will have extensive experience in designing, developing, and deploying end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Design and Develop Data...

  • Cloud Data Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Scientist Role Summary">">We are looking for a highly skilled Data Engineer to join our team.">">In this role, you will be responsible for designing and implementing scalable data processing systems using Apache Ray. You will work closely with the engineering team to ensure the smooth operation of our production environment.">">Designing and...

  • Senior Data Engineering Lead

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 3,00,00,000 - ₹ 4,00,00,000

    Job Title: Senior Data Engineering LeadAbout the RoleWe are seeking an experienced Technical Program Manager to lead large-scale data engineering and cloud platform initiatives.Key Responsibilities:Develop and execute strategic plans for data engineering and cloud programs.Manage complex data ecosystems, including data lakes, warehouses, and real-time...

  • Cloud Data Engineering Specialist

    6 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineering RoleWe are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) services and Big Data Analytics solutions.This is an exciting opportunity for professionals passionate about designing and implementing scalable data engineering solutions while working on advanced cloud-based projects.Design, build, and optimize...

  • Lead Data Engineer

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Data Engineering professional to lead our team and design, deploy, and maintain our data platforms.This role involves supervising junior engineers to ensure they carry out their duties effectively and efficiently.The ideal candidate will have expertise in cloud platforms, ETL processes, data warehousing, Python,...

  • Leading Edge Data Engineer

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock the power of data intelligence with a dynamic team that drives innovation.We're seeking skilled Data Engineers to join our mission and help build a cutting-edge operational analytics platform. This platform will provide actionable insights for network, cloud, and application operators, enhancing collaboration, search-driven experiences, and automated...