Senior Cloud Data Engineer

5 days ago

Pune, Maharashtra, India beBeeCloudDataEngineer Full time
Job Title: Senior Cloud Data Engineer

We are seeking a highly skilled and experienced Senior Cloud Data Engineer to lead our efforts in designing, building, and configuring cloud-based applications.

This is a challenging role that requires strong technical expertise, excellent communication skills, and the ability to work effectively with cross-functional teams.

  • Key Responsibilities:
  • - Design, build, and optimize data pipelines using PySpark and SQL in Databricks for large-scale data transformations and batch/streaming workloads.
  • - Implement ETL processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.
  • - Collaborate with data analysts and stakeholders to understand data needs and deliver accurate, performant, and reusable data solutions.
  • - Maintain and monitor job performance, identify bottlenecks, and apply tuning techniques to improve pipeline efficiency on the Databricks platform.
Required Skills and Qualifications:

To be successful in this role, you will need to possess the following skills and qualifications:

  • Technical Skills:
  • - Proficient in building scalable, distributed data pipelines using PySpark and Databricks with a deep understanding of DataFrame APIs and Spark optimization techniques.
  • - Experience in Python for scripting, data manipulation, and integrating third-party libraries within data engineering workflows.
  • - Expertise in SQL for data extraction, transformation, complex joins, and performance tuning across relational and distributed data stores.
  • - Experienced in working with Delta Lake, versioned data, schema evolution, and managing CDC scenarios in a cloud-based environment.
  • - Best practices in CI/CD, code versioning (Git), and DevOps for data projects.
Benefits:

This role offers a range of benefits, including:

  • Professional Growth:
  • - Opportunities to work on challenging projects and develop your technical skills.
  • - Collaboration with experienced professionals and access to training and development programs.

Working at Our Company

We offer a dynamic and supportive work environment that encourages collaboration and innovation. As a member of our team, you will have the opportunity to work on exciting projects, develop your skills, and contribute to the growth and success of our organization.

  • Cloud Data Engineering Leader

    9 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,02,50,000

    Senior Cloud Data Engineering ManagerWe are seeking a highly skilled and experienced Cloud Data Engineer to lead our team in designing, developing, and implementing large-scale data management systems. The ideal candidate will have a strong background in data engineering, experience with cloud platforms, and excellent communication skills.About the Role:This...

  • Senior Cloud Data Engineer

    3 days ago

    Pune, Maharashtra, India beBeeCloudEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    **Job Title:** Senior Cloud Data EngineerWe are seeking a highly skilled Data Engineer to design, build, and optimize large-scale data solutions using Azure Data Platform.The ideal candidate will have strong experience in developing ETL/ELT pipelines, implementing data modeling best practices, and ensuring data quality and governance across complex data...

  • Senior Cloud Engineer

    9 hours ago

    Pune, Maharashtra, India beBeeCloud Full time ₹ 60,00,000 - ₹ 80,00,000

    Job OverviewAs a senior cloud engineer, you will play a key role in designing and deploying scalable and efficient cloud infrastructure on the Google Cloud Platform. You will work closely with cross-functional teams to deliver high-quality solutions that meet the needs of our business.Key Responsibilities:Design and implement cloud architecture using GCP...

  • Cloud Data Architect

    2 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to fill this key role. The ideal candidate will have a strong background in designing and maintaining cloud-based data architectures, including data lakes, lakehouses, and warehouses.The successful candidate will be responsible for building scalable real-time and batch processing...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Right Move Staffing Solutions Private Limited Full time

    Job Summary :We are looking for a highly skilled and experienced Senior Data Engineer to join our data team.The ideal candidate will have over 4 years of experience in building and maintaining robust data pipelines and infrastructure.This role requires expertise in cloud data services, big data processing frameworks, and a strong understanding of data...

  • Senior Data Engineer

    5 days ago

    Pune, Maharashtra, India SPIRO Full time

    Position: Senior Data EngineerLocation: PuneExperience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Senior Cloud Data Engineer

    16 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Cloud Data Architect to join our team. As a Cloud Data Architect, you will be responsible for designing and implementing scalable, secure, and high-performance cloud-based data solutions.">About the Role:The ideal candidate will have a deep understanding of cloud-based data architectures, including data lakes, pipelines, and...

  • Senior Cloud Engineer

    2 days ago

    Pune, Maharashtra, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Cloud Engineer RoleWe are seeking a seasoned Senior Cloud Engineer to spearhead the digital transformation of 800,000 clients across three brands. As a critical member of our tribe, you will play a pivotal role in establishing the BizBanking platform.Our tribe focuses on the specialized needs of small and medium enterprise clients in Germany, an area...

  • Senior Software Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Cloud Data Engineer

    7 hours ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a highly skilled Data Engineer to lead the design, development and maintenance of large-scale data processing systems.The ideal candidate will have a strong proficiency in GCP, Python, PLSQL, and ETL, with excellent problem-solving skills and attention to detail.Key Responsibilities:Design and develop scalable data processing...