Highly Skilled Big Data Engineering Professional

1 week ago

Ellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

Job Overview

We are seeking a highly skilled Big Data Engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.

">

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Engineering Expert

    6 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Big Data Engineer to lead our data engineering teams and manage cross-team collaboration.The ideal candidate will have a strong background in big data engineering, with experience in designing and developing large-scale data processing pipelines using Apache Spark and Scala/Python.Responsibilities include...

  • Highly Skilled Quality Assurance Automation Engineer

    2 days ago

    Ellore, Andhra Pradesh, India beBeeAutomation Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled Quality Assurance Automation Engineer to deliver key features of our Enterprise Platform, which helps customers measure and eliminate cyber risks.The successful candidate will design, implement, document, and maintain testing frameworks for core product capabilities using micro-services and Big Data-based...

  • Data Engineering Professional

    4 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalAbout the Role:We are seeking a skilled data engineer to build scalable and reliable data pipelines using modern cloud and big data platforms.

  • Big Data Specialist

    1 week ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are on the lookout for a highly skilled and experienced Big Data Specialist to spearhead our data pipeline development. This individual will play a pivotal role in designing, building, and maintaining robust data pipelines using cloud-based technologies.Design and develop scalable data pipelines using cloud services (GCP, AWS, or...

  • Big Data Pipeline Specialist

    1 week ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,50,000

    Job SummaryWe are seeking an experienced Data Engineering Specialist to join our team.The ideal candidate will have a strong background in designing and developing scalable data pipelines using big data technologies.Main Responsibilities:Developing ETL processes using PySpark and Hive to extract, transform, and load data into Big Data platforms.Designing and...

  • Principal Big Data Engineer

    2 hours ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job OverviewAs a Data Engineer, you will be responsible for designing and implementing scalable data processing pipelines using cloud-based technologies. Your expertise in software development methodologies and ability to collaborate with cross-functional teams will play a key role in the success of our organization.Key Responsibilities:Develop data...

  • Big Data Architect

    6 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data EngineerWe are seeking a skilled Big Data Engineer to design, execute, and manage large-scale distributed data systems.Experience in big data technologies (Apache Hadoop)Relational databases (MS SQL Server/Oracle/MySQL/PostgreSQL)Proficiency in at least one of the following programming languages - Java, Python or ScalaSQL...

  • Big Data Leader

    2 hours ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned Big Data professional to spearhead the design and implementation of scalable big data analytics platforms.This senior role requires a deep understanding of key technologies like Spark, Druid, Drill, ClickHouse, and experience with big data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.A strong background in...

  • Leading Big Data Initiatives

    4 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,10,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled data engineer to lead our big data initiatives.Designs and develops scalable data pipelines using Apache Spark, Hive, and PySpark technologies.Collaborates with analytics teams to improve data models that feed business intelligence tools, driving data-driven decision making.Develops efficient ETL...

  • Highly Skilled Data Engineer

    4 days ago

    Ellore, Andhra Pradesh, India beBeeExpertise Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    **Senior Data Engineer-Data Modeler Role Overview**As a key member of our data management team, you will be responsible for designing and developing highly scalable data capture and transformation processes.You will work closely with cross-functional teams to analyze and understand datasets, guiding the team in creating source-to-target mapping and data...