Senior Data Engineer Position

3 days ago


Hyderabad Secunderabad Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Data Engineer (PySpark)

We are seeking a skilled data engineer with experience in PySpark and data processing. The ideal candidate will possess strong knowledge of data pipelines, HDFS, Hive, Spark, PySpark, and Python. You will be instrumental in designing, developing, and optimizing data processing solutions for large datasets.

Key Responsibilities:
  • Design and Develop Data Pipelines: Create efficient and scalable data processing solutions using PySpark and Python.
  • Data Lake & Warehousing: Work with large datasets stored in HDFS and Hive, applying concepts of Partitions and Bucketing for optimized data storage and retrieval.
  • SQL & Data Processing: Utilize SQL and PySpark for efficient data manipulation, transformation, and processing.
  • Azure Databricks Development: Develop and deploy solutions on Databricks with Azure, including PySpark notebook development.
  • ETL & Data Pipelines: Build and optimize data pipelines, demonstrating a good understanding of Hadoop and Spark architectures.
Required Skills and Experience:
  • 8+ years of total IT experience, with 5+ years of relevant work experience as a data engineer/developer.
  • Strong PySpark knowledge and hands-on development experience.
  • Proficient in SQL, HDFS, Hive, Spark, PySpark, and Python.
  • Good understanding of Hadoop and Spark architectures.
  • Experience with SCD Type 1 and Type 2 implementation.
Mandatory Skills:
  • PySpark Developer
  • Azure Stack

  • Senior Data Engineer

    9 hours ago


    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    About the RoleThis is a senior data engineering position focused on utilizing business acumen to work with stakeholders and other data engineers to define, design, and implement data solutions that support the organization s data initiatives. The ideal candidate will have experience in designing and building pipelines using cloud technology for extracting,...


  • Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Job Title: Senior Data EngineerKey Responsibilities:We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and implementation of large-scale data pipelines using Python, Pyspark, and SQL. The ideal candidate will have strong technical expertise in data engineering concepts, with the ability to handle multiple...


  • Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team.Detailed Job Description:Author transformations, optimizations, and manipulations of datasets to meet the needs of the use case and its outcomes.Monitor and curate the most important datasets in one or multiple projects, adhering to the central Program Team's...


  • Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Job Description:This is a senior data engineering role responsible for the detailed design, development, and delivery of pipeline solutions to address business needs. The ideal candidate will have a strong background in data engineering with experience in big data platforms and be able to lead cross-functional teams.The key responsibilities of this role...

  • Data Engineer

    3 days ago


    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. This role involves designing, implementing and maintaining large-scale data processing systems.Job Description:Develop and maintain high-quality, scalable data pipelines using Informatica, SQL and Unix.Design and implement efficient data warehousing solutions for complex...


  • Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Big Data Engineer PositionWe are seeking a skilled big data engineer to join our organization in India. The ideal candidate will have a strong background in data engineering with extensive experience in building and maintaining large-scale data pipelines and infrastructure to support our business decisions.Key ResponsibilitiesDesign, develop, and maintain...


  • Hyderabad / Secunderabad, Telangana, India beBeeDataScientist Full time

    Job TitleA Data and Analytics Career Opportunity Awaits DescriptionWe are seeking an experienced professional to join our team as a Senior Associate in the field of Data and Analytics. In this role, you will have the opportunity to help organizations uncover enterprise insights and drive business results using smarter data analytics.This position requires...


  • Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    Data Engineering Manager RoleWe are seeking a seasoned Data Engineering Manager to lead our end-to-end data strategy and execution for regulatory product submissions, lifecycle management, and compliance reporting.This role will be embedded in a cross-functional Regulatory Integrated Product Team (IPT) and serve as the data and technology lead, driving...

  • Big Data Engineer

    2 days ago


    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer - Big DataWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, excellent programming skills, and the ability to work independently as well as mentor junior developers.Key Responsibilities:Design and develop large-scale data processing pipelines...


  • Hyderabad / Secunderabad, Telangana, India beBeeSustainability Full time

    Environmental Sustainability SpecialistThe role involves driving execution and delivery of environmental sustainability targets across climate, waste, and water.This position requires collaboration with cross-functional stakeholders to develop and implement strategies for sustainable growth and reporting.Key Responsibilities:Develop and maintain processes...