Advanced Big Data Solutions Expert

2 days ago


Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: Data Engineer - Scala Specialist

We are seeking a highly skilled data engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Specialist

    23 hours ago


    Lucknow, Uttar Pradesh, India beBeeDataProcessing Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleAs a Data Processing Specialist, you will be responsible for building and managing big data clusters to ensure efficient data processing and storage. Your role will involve migrating data, performing performance tuning, and providing pre- and post-platform support for application migration. Proficiency in Linux commands is mandatory.In this...


  • Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to lead the design, development, and implementation of scalable data processing solutions using big data technologies.The ideal candidate will have 6-12 years of experience in big data engineering and a proven track record of delivering high-quality solutions on time. They...


  • Lucknow, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering LeaderJob Description:Our organization is seeking a seasoned Cloud Data Engineering Leader to lead the development of large-scale distributed data systems using Microsoft Azure and Databricks.Lead and grow a team of data engineers working on complex data solutions.Architect and oversee the development of end-to-end data solutions using...


  • Lucknow, Uttar Pradesh, India beBeeSpotfire Full time ₹ 12,00,000 - ₹ 28,00,000

    Job Title: Technical Lead for Advanced Analytics SolutionsWe seek a seasoned Technical Lead with deep expertise in TIBCO Spotfire to drive advanced analytics solutions for enterprise clients.The ideal candidate will possess strong technical acumen, leadership capabilities, and excellent communication skills to collaborate across global teams and deliver...


  • Lucknow, Uttar Pradesh, India beBeeDataStrategist Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Data Strategist PositionWe seek a skilled data strategist to lead our organization's efforts in leveraging AI and machine learning technologies. This position will focus on driving business growth through data-driven decision making.As a key member of our team, you will be responsible for developing and implementing advanced data models and algorithms to...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Solutions SpecialistDescriptionWe are seeking a highly skilled and experienced data solutions specialist to join our implementation team. As a key member of our team, you will play a crucial role in designing, developing, and maintaining data pipelines to ensure efficient extraction, transformation, and loading of data from various...


  • Lucknow, Uttar Pradesh, India beBeeDataExtraction Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Extraction SpecialistWe are seeking a highly skilled and experienced data extraction specialist to drive our data scraping efforts. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills.The ideal candidate will have a minimum of 4 years of hands-on experience in IT...

  • Data Science Expert

    3 days ago


    Lucknow, Uttar Pradesh, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000

    About the Role:We are seeking an experienced Data Science Expert to design, develop and deploy advanced data models that power business-critical solutions.Key Responsibilities:Design and develop predictive models (regression, classification, clustering) using machine learning libraries.Build and optimize data pipelines, feature engineering and training...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerAre you a data engineering expert looking to leverage your skills in designing, developing and optimizing scalable data pipelines? Do you have experience with Dataiku for data preparation, visualization and building end-to-end data pipelines and applications?As a Senior Data Engineer, you will lead data engineering initiatives focusing on...


  • Lucknow, Uttar Pradesh, India beBeeSolutions Full time ₹ 35,00,000 - ₹ 50,00,000

    Job DescriptionWe are seeking a highly skilled Data Solutions Architect to design, develop, and maintain data pipelines and ETL processes on Databricks.About the RoleLead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and...