Big Data Processing Expert

10 hours ago

Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

About us : We are a technology firm that provides data transformation, cloud computing and enterprise application integration services.

Our industry-specific solutions address complex business challenges by combining domain expertise with deep technical capabilities. With a global workforce of over 80,000 professionals and presence in more than 50 countries.

We are seeking a highly skilled Data Engineer/BI Specialist with expertise in big data processing, cloud-based analytics, and advanced visualisation technologies.

Key Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, Azure Data Factory, and Databricks.
  • Integrate and manage structured and unstructured data from diverse sources, including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.
  • Implement IoT data ingestion, processing, and analytics solutions using Azure IoT services.
  • Develop and deploy Python scripts for automation, data transformation, and analytics workflows.
  • Create dashboards, visualizations, and reports to support data-driven decision-making (e.g., Power BI, immersive AR/VR/MR analytics).
  • Collaborate with cross-functional teams to gather requirements, optimize pipelines, and ensure high data quality.
  • Ensure solutions follow security, compliance, and data governance best practices.

Mandatory Skills:

  • Apache Airflow
  • Apache Spark
  • Python
  • Azure Cosmos DB
  • Azure Data Factory
  • Azure IoT
  • Azure Synapse Analytics
  • Azure Data Lake
  • Data bricks
  • AR/VR/MR

Required Experience & Qualifications:

  • 5+ years of experience in data engineering, cloud analytics, or BI development.
  • Strong SQL skills and experience with data modeling.
  • Proficiency in distributed data processing frameworks.
  • Experience working in Microsoft Azure cloud environments.
  • Strong problem-solving skills and ability to work with large-scale datasets.

Preferred Skills:

  • Experience with AI/ML integrations into analytics pipelines.
  • Familiarity with real-time data streaming solutions (Kafka, Event Hubs).
  • Exposure to immersive analytics using AR/VR/MR.

  • Big Data Expert

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineer RoleWe are seeking a highly skilled data professional to join our team.About the Position:The ideal candidate will have experience with big data, scalable architectures, and cloud services.A minimum of 2+ years of experience in the field is required.Key Responsibilities:Design, implement, and deploy large-scale data processing...

  • Big Data Solutions Architect

    5 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines that handle terabytes of structured and unstructured data.The ideal candidate has 1–2 years of experience in big data engineering and is excited to solve tough...

  • Big Data Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 32,00,000

    Job Title: Big Data SpecialistAre you looking for a challenging role that involves working with large datasets? Do you have experience with data analytics and visualization tools?We are seeking a skilled Big Data Specialist to join our team. The ideal candidate will have a strong background in data analysis, machine learning, and programming languages such...

  • Engineering Leader

    7 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleSigma Engineer at ScaleAbout the Role:In this pivotal position, you will spearhead the development of a high-performance big data platform.Key responsibilities include designing and implementing distributed components using Big Data technologies.You will also provide technical leadership and manage day-to-day tasks.This opportunity calls for an...

  • Big Data Specialist

    6 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data EngineerOur organization seeks an experienced data engineer to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. The ideal candidate will have a strong understanding of big data frameworks, data warehousing, and data modeling.Job Summary:The data engineer will be responsible for designing,...

  • Big Data Engineer

    11 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 27,00,000

    Big Data Engineers are responsible for designing, developing and maintaining large-scale data pipelines using cloud-based platforms.Job Role:Develop data engineering solutions to drive business insightsCollaborate with cross-functional teams to deliver high-quality data solutionsIntegrate machine learning models into production-ready codeKey...

  • Senior Big Data Expert

    1 day ago

    Kozhikode, Kerala, India beBeeBigDataExpert Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job OpportunityOverview:We are seeking a highly skilled Data Scientist to join our team. As a key member of our organization, you will be responsible for analyzing technical requirements and understanding specifications.Key Responsibilities:Analyze complex data sets and identify trends and patterns.Develop and implement data models using Spark and Scala.Work...

  • Advanced Big Data Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionOur organization seeks a seasoned Data Engineer to take on key responsibilities, leveraging technical expertise and data engineering principles.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain batch and streaming data pipelines using PySpark.Big Data Processing: Proficient in using Spark SQL, DataFrame, and RDD...

  • Big Data Solutions Architect

    3 days ago

    Kozhikode, Kerala, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Cloud and Big Data ArchitectWe are seeking highly skilled professionals with a strong focus on Azure Cloud, big data management, and data quality skills to join our team.This is a full-time hybrid role offering flexibility for remote work. We strive to create a diverse and inclusive environment where everyone can grow professionally.Key...

  • Senior Big Data Solutions Architect

    1 day ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data EngineerWe are seeking a highly skilled professional to design, develop and maintain large-scale data processing pipelines using GCP services such as Cloud Dataflow, Cloud Composer/Airflow, and Pub/Sub.The ideal candidate will have expertise in GCP data services and Snowflake data warehousing. They will be responsible for implementing data models,...