Distributed Data Systems Specialist

9 hours ago


Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Data Engineering Professional

We are seeking a highly skilled data engineering professional to join our team. The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka.

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems using Scala, Spark (PySpark), and Python.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).


  • Kurnool, Andhra Pradesh, India beBeeAutomation Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job DescriptionThe primary objective of this role is to guarantee high-quality releases of our on-premises management platform, YugabyteDB Anywhere. As an SDET (Software Development Engineer in Test), you will be responsible for designing and implementing robust automation frameworks, validating complex workflows across hybrid and on-prem environments, and...


  • Kurnool, Andhra Pradesh, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,20,000

    Job Title: Data Engineering SpecialistWe require a skilled specialist with expertise in big data processing, cloud computing and data integration to work on data ingestion processes.This role involves the design, development, testing and deployment of data pipelines, automation tools and infrastructure management solutions for scalable and efficient data...


  • Kurnool, Andhra Pradesh, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Assurance SpecialistAbout the Role:We are seeking a highly skilled Data Assurance Specialist to join our team. In this role, you will be responsible for developing and executing tests using various tools, including SQL, Tricentis, Python (PySpark), and data quality frameworks.Key Responsibilities:Developing and Executing Tests: You will...


  • Kurnool, Andhra Pradesh, India beBeeStorage Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title:Cloud Storage Solutions ExpertJob Description:You will play a key role in designing, implementing, and maintaining cloud-based infrastructure and services. Your focus will be on developing, deploying, and maintaining highly available, scalable storage and container orchestration systems.This involves working with customer engineering teams on a...


  • Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Advanced Data Architecture SpecialistOur organization is seeking a highly skilled professional to design, develop, and optimize large-scale data pipelines and distributed data processing systems.Develop advanced data architecture solutions using Scala, Spark, Python, NiFi, and Apache Kafka.Work extensively with big data technologies such as...


  • Kurnool, Andhra Pradesh, India beBeeSoftware Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: High-Performance Software SpecialistWe are seeking a highly skilled and experienced software engineer to design and build high-performance systems using cutting-edge technologies.The ideal candidate will have extensive knowledge of scalable system architecture, cloud computing, and distributed systems.Key Responsibilities:System Design and...


  • Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Our Data Engineer RoleWe are seeking a skilled professional to lead the design and operation of our AI-powered applications' data backbone. You will work closely with software engineers, ML specialists, and clinical partners to build scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...


  • Kurnool, Andhra Pradesh, India beBeeReliability Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Senior System Reliability SpecialistWe are seeking a seasoned expert in system reliability engineering to design, implement and maintain scalable systems that meet the demands of our business.This role involves working closely with stakeholders to ensure seamless system operation, troubleshooting issues and implementing solutions to prevent future...


  • Kurnool, Andhra Pradesh, India beBeeDataInfrastructure Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    Software Engineer - Data Infrastructure Specialist Job Description:We are seeking a skilled Software Engineer with expertise in data infrastructure to support Large Language Model (LLM) research. This is a critical role that requires the design, build, and operation of scalable, fault-tolerant data infrastructure to enable distributed computing and data...


  • Kurnool, Andhra Pradesh, India beBeeBackendEngineer Full time ₹ 80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are a global technology company that revolutionizes financial access for millions of underserved banking customers across Africa and India.We leverage smartphones, machine learning, and other technologies to improve access and value for those overlooked by banks.Role DescriptionAs a Backend Engineer at our organization, you will design and...