Advanced Data Pipeline Specialist

7 hours ago


Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer - Big Data

We are seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to fill this position.

  • Main Responsibilities:
  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.


  • Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Advanced Data Architecture SpecialistOur organization is seeking a highly skilled professional to design, develop, and optimize large-scale data pipelines and distributed data processing systems.Develop advanced data architecture solutions using Scala, Spark, Python, NiFi, and Apache Kafka.Work extensively with big data technologies such as...


  • Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 80,00,000

    Junior Data Engineer PositionWe are seeking a highly motivated and skilled Junior Data Engineer to join our team. As a Junior Data Engineer, you will be responsible for building data pipelines and automation scripts, supporting the implementation of analytical algorithms under guidance, and contributing to documentation and testing processes.Key...


  • Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job TitleOur team is looking for a Freelance Azure Data Factory Specialist to help us with data integration and ETL processes. The ideal candidate will have hands-on experience in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and destinations.The role requires designing,...


  • Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opportunity:We are seeking a skilled Data Engineer to join our organization. The ideal candidate will have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key Responsibilities:Design, implement, and manage CI/CD pipelines using GitHub...


  • Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Business Intelligence DeveloperThis role focuses on leveraging data pipelines to drive business growth.You will play a pivotal part in creating scalable, secure, and efficient data architectures using industry-leading tools.The ideal candidate has experience in designing and implementing data models, ETL processes, and database management systems.A...


  • Kurnool, Andhra Pradesh, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Lead Data Platform Engineer\At our company, we are seeking a highly skilled and experienced Lead Data Platform Engineer to join our team.\As a key member of our engineering team, you will be responsible for designing, building, and operating production-grade data pipelines. You will also lead the delivery of these projects, ensuring they are...


  • Kurnool, Andhra Pradesh, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,20,000

    Job Title: Data Engineering SpecialistWe require a skilled specialist with expertise in big data processing, cloud computing and data integration to work on data ingestion processes.This role involves the design, development, testing and deployment of data pipelines, automation tools and infrastructure management solutions for scalable and efficient data...


  • Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Ingestion SpecialistWe are seeking a seasoned Cloud Data Ingestion Specialist to design and develop cutting-edge data ingestion pipelines for integrating multiple sources into Databricks.Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain Continuous Integration/Continuous...


  • Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Data Engineer Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have hands-on experience in designing, building, and optimizing scalable data pipelines using Snowflake, AWS Lambda, Glue, DBT, and SQL.


  • Kurnool, Andhra Pradesh, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Assurance SpecialistAbout the Role:We are seeking a highly skilled Data Assurance Specialist to join our team. In this role, you will be responsible for developing and executing tests using various tools, including SQL, Tricentis, Python (PySpark), and data quality frameworks.Key Responsibilities:Developing and Executing Tests: You will...