Leading Big Data Architectures

4 days ago

Hyderabad Secunderabad Telangana, India beBeeDataEngineering Full time

Senior Data Engineer Position Overview

  • We are seeking a seasoned data engineer to lead the development of our big data infrastructure. The ideal candidate will have extensive experience with Databricks, DLT, and PySpark.
Job Description

The Senior Data Engineer will be responsible for designing, implementing, and maintaining large-scale data pipelines using Databricks and DLT technologies.

Key Responsibilities:
  • Design and implement scalable data architectures using Databricks and DLT
  • Develop and maintain complex data pipelines using PySpark and other relevant technologies
  • Collaborate with cross-functional teams to identify and prioritize project requirements
  • Analyze system performance and optimize data processing workflows
  • Implement data security measures to protect sensitive information
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 10+ years of overall experience and 8+ years of relevant experience in Databricks, DLT, PySpark, and Data Modeling concepts
  • Proficiency in programming languages such as Python, PySpark, Scala, and SQL
  • Strong understanding of distributed computing principles and experience with big data technologies like Apache Spark
  • Experience with cloud platforms like AWS, Azure, or GCP and their associated data services
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
Preferred Qualifications:
  • Experience with containerization technologies like Docker and Kubernetes
  • Knowledge of DevOps practices for automated deployment and monitoring of data pipelines

This is a unique opportunity to join a dynamic team and contribute to the development of innovative data solutions. If you have the required skills and experience, please submit your application.

  • Big Data

    4 days ago

    Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeData Full time ₹ 12,00,000 - ₹ 30,00,000

    Lead Data Engineer - Big Data & HadoopWe are seeking a highly skilled Lead Data Engineer to join our team and lead the design, implementation, and maintenance of large-scale data processing systems.Key Responsibilities:• Design and implement robust, scalable, and secure data pipelines using Azure Databricks, Hadoop, and Spark.• Collaborate with...

  • Big Data Engineer

    22 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to design and develop scalable data processing solutions using Apache Spark and related technologies.About the Role:This role involves working on large-scale data processing, real-time analytics, and building efficient data pipelines for various business use cases.Critical Skills:Create...

  • Big Data Developer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    **Job Title:** Big Data DeveloperWe are seeking a skilled and experienced Big Data Developer to join our team.As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Spark and Java. You will work with our team of experts to create efficient and scalable solutions that meet the...

  • Big Data Engineer

    22 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer - Big DataWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, excellent programming skills, and the ability to work independently as well as mentor junior developers.Key Responsibilities:Design and develop large-scale data processing pipelines...

  • Senior Big Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Big Data Engineer PositionWe are seeking a skilled big data engineer to join our organization in India. The ideal candidate will have a strong background in data engineering with extensive experience in building and maintaining large-scale data pipelines and infrastructure to support our business decisions.Key ResponsibilitiesDesign, develop, and maintain...

  • Big Data Developer

    18 hours ago

    Pune, Hyderabad / Secunderabad, Telangana, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Description:We are seeking an experienced Big Data Professional to join our team. The ideal candidate will have a strong background in developing and implementing data pipelines using cloud native technologies.Key Responsibilities:Collaborate with business stakeholders and architects to design and develop data pipelinesDevelop and maintain large-scale...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India RandomTrees Full time

    Job Title: Big Data Engineer Experience: 5–9 Years Location: Hyderabad-Hybrid Employment Type: Full-Time Job Summary: We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL,...

  • Big Data Architect

    2 days ago

    Hyderabad, Telangana, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Big Data ArchitectWe are seeking a highly skilled professional to lead the design and implementation of our big data infrastructure.Responsibilities:Develop and maintain high-performance big data applications using Python, PySpark, and Spark Dataframes.Design and implement scalable data architectures to process huge volumes of data.Collaborate...

  • Big Data Specialist

    1 day ago

    Gurgaon / Gurugram, Hyderabad / Secunderabad, Telangana, India beBeeDataSpecialist Full time

    Job Description\Our organization is looking for an experienced professional to fill a critical role in our delivery team. As part of this team, you will be responsible for interacting with clients to ensure high-quality assurance and issue resolution.The ideal candidate will have a deep understanding of technology domain requirements, as well as experience...

  • Big Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThis role involves working on large-scale big data platforms to design, implement, and optimize ETL pipelines for storing and processing contract information from upstream sources. The successful candidate will have experience in Spark ETL, big data storage, and querying techniques.Key Skills and Qualifications6+ years of experience in Spark ETL...