Big Data Solutions Specialist

23 hours ago


Kollam, Kerala, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000
Job Overview

Our organization is seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team.

The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines and hands-on experience in distributed data systems and cloud-based solutions.

  • Key Responsibilities:
  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).

  • Big Data Specialist

    16 hours ago


    Kollam, Kerala, India beBeeData Full time ₹ 16,00,000 - ₹ 20,10,000

    Job Summary:We are seeking an accomplished Big Data Specialist to spearhead our data platform implementation team. As a key member of this team, you will play a vital role in designing and developing robust ETL processes using Databricks PySpark to efficiently extract, transform, and load data from diverse sources into the data lake and data warehouse. Key...


  • Kollam, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data OpportunityWe are seeking a highly skilled Big Data Specialist to drive scalable data solutions using advanced technologies.Must-Have Skills:Proficiency in PySpark and HiveExperience with big data platforms and data ingestion from disparate sourcesGood-to-Have Skills:Knowledge of Spark and HBaseAgile Scrum experienceData Quality (DQ) tool...


  • Kollam, Kerala, India beBeeCloudDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Solutions ArchitectAbout the Role:We are seeking a self-driven technical expert to design and develop scalable data architectures using cloud-based technologies.Collaborate with cross-functional teams to craft innovative data solutions that drive business growth.Develop robust data pipelines using Azure Databricks, PySpark, and Delta...


  • Kollam, Kerala, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineering ManagerAs a seasoned leader, you will oversee the design and delivery of scalable data pipelines and analytics platforms in the cloud. Your expertise in Big Data platforms, Microsoft Azure, and Databricks will ensure high performance, reliability, and security in a cloud-native environment.Lead and grow a team of data engineers working...


  • Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our mission-critical banking project. This is an excellent opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures.Key Responsibilities:Designing and implementing ETL pipelines for large-scale data ingestion and transformation.Building...


  • Kollam, Kerala, India beBeeDataEngineering Full time US$ 75,000 - US$ 1,25,000

    Freelance Data EngineerWe are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks.Perform data...


  • Kollam, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Overview**We are seeking an experienced Data Analytics Specialist to join our consulting team. As a key member, you will play a vital role in helping clients transform their corporate finance function through advanced analytics.**Responsibilities**Design and develop end-to-end data and analytics solution architecture on Google Cloud Platform...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer Job DescriptionAs a Big Data Engineer, you will be responsible for designing and implementing scalable batch processing systems that process terabytes of data. Your expertise in big data technologies such as Spark and Hadoop will enable us to optimize our existing systems, identify and resolve performance bottlenecks, and implement...

  • AI Solution sales

    16 hours ago


    Kollam, Kerala, India krtrimaIQ Cognitive Solutions Full time

    Business Development Manager – AI, Data Science & Data Engineering SalesLocation: Bangalore (Hybrid) | Company: KrtrimaIQ Cognitive SolutionsAbout KrtrimaIQ Cognitive SolutionsKrtrimaIQ Cognitive Solutions is a fast-growing AI/ML and Data Solutions company helping enterprises leverage Artificial Intelligence, Machine Learning, Data Engineering,...