Senior Data Engineering Professional

1 week ago


Hyderabad Secunderabad Telangana Pune Chennai, India beBeeDataEngineer Full time
Job Title:

AWS Data Engineer

">

    With expertise in AWS, SQL, PySpark, Glue, and SCD.

">

Required Skills:">
  • 7-10 years of experience with Python, PySpark, SQL, and AWS services including S3, EMR, EC2, Glue, Redshift, Lambda, and Snowflake.
  • Proficiency in data lifecycle management, DPU optimization in Glue, database connections from Glue jobs, Lambda functions, 100 files in Athena, Spark entry points, DataFrame dynamic frames, Spark join strategies, broadcast and accumulator variables, DAG and lineage analysis, starting Snowflake schemas, SCD type 2 implementation, orchestration using Airflow, and various Airflow operators.
  • Advanced knowledge of semi-anti joins, window functions, decorators (deep and shallow), hashing algorithms, and data skewness mitigation techniques.
">

What We Offer:">

As a senior engineer in our team, you will have the opportunity to work on complex projects, collaborate with cross-functional teams, and grow professionally.



  • Pune, Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineering SpecialistWe are seeking a seasoned Senior Data Engineering Specialist to join our team."],


  • Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a seasoned professional to lead our data engineering initiatives. As a key member of our team, you will be responsible for designing, developing, and implementing data pipelines, ETL/ELT processes, and data integration solutions.You will contribute to data pipeline projects from inception to deployment, manage scope, timelines,...


  • Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Job Title: Senior Data EngineerKey Responsibilities:We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and implementation of large-scale data pipelines using Python, Pyspark, and SQL. The ideal candidate will have strong technical expertise in data engineering concepts, with the ability to handle multiple...


  • Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    About the RoleThis is a senior data engineering position focused on utilizing business acumen to work with stakeholders and other data engineers to define, design, and implement data solutions that support the organization s data initiatives. The ideal candidate will have experience in designing and building pipelines using cloud technology for extracting,...


  • Hyderabad / Secunderabad, Telangana, India beBeeDataInfrastructure Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data Infrastructure EngineerWe are seeking a highly skilled and experienced Senior Data Infrastructure Engineer to join our team. As a key member of our data engineering organization, you will play a critical role in designing, building, and maintaining scalable data pipelines that support our analytics and reporting needs.


  • Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a highly skilled professional to join our team as a Senior Data Engineer. As a key member of our data engineering team, you will be responsible for designing and deploying Azure Databricks in a cloud environment using Azure Cloud services.The ideal candidate will have extensive hands-on experience implementing data migration and...

  • Data Engineer

    6 days ago


    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. This role involves designing, implementing and maintaining large-scale data processing systems.Job Description:Develop and maintain high-quality, scalable data pipelines using Informatica, SQL and Unix.Design and implement efficient data warehousing solutions for complex...


  • Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Job Description:This is a senior data engineering role responsible for the detailed design, development, and delivery of pipeline solutions to address business needs. The ideal candidate will have a strong background in data engineering with experience in big data platforms and be able to lead cross-functional teams.The key responsibilities of this role...


  • Hyderabad / Secunderabad, Telangana, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Discover a new opportunity in our Research division to work as a Senior Software Engineer and contribute to the development of cutting-edge software, data, and analytics applications.Job DescriptionThis role involves working closely with global cross-functional teams to design, develop, and implement data pipelines, ETL/ELT processes, and data integration...


  • Hyderabad / Secunderabad, Telangana, Pune, Noida, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job DescriptionAs a seasoned professional in data engineering, you will play a crucial role in designing, developing, and maintaining large-scale data systems on Amazon Web Services (AWS). Your expertise in leveraging AWS services such as Glue, Lambda, S3, Athena, and ETL tools like Informatica will be instrumental in transforming raw data into actionable...