Senior Large-Scale Data Processing Specialist

6 days ago

Dombivli, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

Job Role: Data Scientist

We are seeking a highly skilled expert in large-scale data processing to join our team.

The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Spark (PySpark), Python, Scala, Apache Kafka, and NiFi for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

About This Position

This is an exciting opportunity for a skilled professional to take their career to the next level. The ideal candidate will be able to demonstrate a strong portfolio of work and contribute to the growth of our company.

What We Offer

We offer a competitive salary and benefits package, as well as opportunities for professional development and growth.

How to Apply

To apply for this position, please submit your resume and cover letter.

  • Data Engineer

    1 week ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,60,00,000 - ₹ 2,40,00,000

    Job DescriptionThe primary function of this role is to design and develop large-scale data processing systems on the Google Cloud Platform.

  • Large Scale Data Center Network Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeDataCenter Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Center Network EngineerWe are seeking an experienced network engineer to join our team and contribute to the design, implementation, and management of large-scale data center environments.Key Responsibilities:Lead and Support Deployments in Cisco ACI environments, including single site, multi-site, and multi-pod configurations.Deploy and Support Cisco...

  • Senior Data Integration Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior ETL DeveloperWe are seeking a highly skilled and experienced data integration specialist to drive the success of our team.Key Responsibilities:Design, develop, test, deploy, and maintain large-scale data integration solutions using cutting-edge technologies.Collaborate with cross-functional teams to identify business requirements and...

  • Senior Data Specialist

    7 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Description:As a Senior Data Specialist, you will lead the implementation of cutting-edge data solutions to drive business growth and innovation. You will be responsible for developing and maintaining large-scale data systems, working closely with cross-functional teams to design and deploy predictive models, and ensuring seamless integration with...

  • Career Opportunity: Data Processing Systems Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerAbout the Role:We are seeking highly skilled professionals to design and develop large-scale data processing systems using advanced technologies.

  • Data Validation Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeDataValidation Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Validation SpecialistJob Description:A data validation specialist is required to execute automated testing and validation of large-scale data pipelines. This position involves thorough analysis, technical skillset in QA automation, software development lifecycle understanding, agile settings familiarity, and strong SQL skills.Key...

  • Senior Data Architect

    1 week ago

    Dombivli, Maharashtra, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectJob SummaryWe are seeking an experienced and highly skilled Senior Data Architect to join our team. The ideal candidate will have a strong background in data analysis, engineering, and solution design.Key ResponsibilitiesThe Senior Data Architect will be responsible for:Designing and implementing large-scale data architectures...

  • Data Pipeline Specialist

    5 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerJob Description:We are seeking an experienced and skilled Data Engineer to join our team and contribute to the design, development, and maintenance of large-scale data pipelines using cloud-based technologies.The ideal candidate will have a strong understanding of Python, data processing, and cloud infrastructure. They will...

  • Senior Backend Data Science Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineer PositionWe are seeking a seasoned Big Data Engineer to join our data engineering team.The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka, with a proven track record in building, scaling, and optimizing big data pipelines.Design, develop, and optimize large-scale data pipelines and distributed data...

  • Senior Data Processing Systems Developer

    2 weeks ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:A skilled Data Engineer is needed to design, build and maintain large-scale data processing systems.Key Responsibilities:Design, develop and operate Apache Ray-based data processing systems ensuring high availability and scalability.Collaborate with cross-functional teams to design and implement efficient data pipelines automating deployment and...