Big Data Specialist

1 day ago


Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Cloud Data Engineer

Our organization seeks an experienced data engineer to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. The ideal candidate will have a strong understanding of big data frameworks, data warehousing, and data modeling.

Job Summary:

The data engineer will be responsible for designing, developing, and maintaining data pipelines and workflows using AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and Databricks. This includes building and optimizing ETL/ELT processes for large-scale structured and unstructured datasets.

Key Responsibilities:

Design, develop, and maintain data pipelines and workflows using AWS and Databricks.Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.Leverage Databricks for data engineering, advanced analytics, and machine learning workloads.Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions.Implement data governance, quality checks, and monitoring frameworks.Ensure high availability, scalability, and cost-effectiveness of data solutions.

Required Skills:

The successful candidate will possess the following skills:

  • 7+ years of experience in data engineering.
  • Strong hands-on experience with AWS cloud services (S3, Redshift, Glue, EMR, Athena, Lambda, Kinesis).
  • Expertise in Databricks (PySpark, Delta Lake, ML pipelines).
  • Proficiency in Python and SQL for data transformation and querying.
  • Strong understanding of data warehousing, data modeling, and big data frameworks.
  • Experience with workflow orchestration tools (Airflow, Step Functions).

Preferred Qualifications:

The following qualifications are desirable:

  • Familiarity with MLOps/ML integration within Databricks.
  • Experience with real-time/streaming data (Kafka, Spark Streaming).
  • Knowledge of infrastructure as code (Terraform/CloudFormation).
  • Exposure to data security, compliance, and governance practices.

  • Big Data Specialist

    2 days ago


    Kozhikode, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 32,00,000

    Job Title: Big Data SpecialistAre you looking for a challenging role that involves working with large datasets? Do you have experience with data analytics and visualization tools?We are seeking a skilled Big Data Specialist to join our team. The ideal candidate will have a strong background in data analysis, machine learning, and programming languages such...


  • Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a seasoned Data Engineer to join our team. The ideal candidate will have extensive experience in designing, developing, and deploying large-scale data systems.This role involves working with various big data technologies such as AWS, Python, and PySpark. The successful candidate will be responsible for building robust data...


  • Kozhikode, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines that handle terabytes of structured and unstructured data.The ideal candidate has 1–2 years of experience in big data engineering and is excited to solve tough...


  • Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionOur organization seeks a seasoned Data Engineer to take on key responsibilities, leveraging technical expertise and data engineering principles.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain batch and streaming data pipelines using PySpark.Big Data Processing: Proficient in using Spark SQL, DataFrame, and RDD...

  • Big Data Architect

    4 days ago


    Kozhikode, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Unlock Data Potential as a Databricks Engineer">Design, Develop, and Evolve Data PipelinesDrive Scalable, Secure, and High-Performance Data SolutionsCollaborate with Business Stakeholders to Deliver Actionable InsightsOptimize Data Workflows for Performance, Efficiency, and ReliabilityIntegrate Multiple Data Sources into Delta Lake and Cloud Data...

  • Engineering Leader

    2 days ago


    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleSigma Engineer at ScaleAbout the Role:In this pivotal position, you will spearhead the development of a high-performance big data platform.Key responsibilities include designing and implementing distributed components using Big Data technologies.You will also provide technical leadership and manage day-to-day tasks.This opportunity calls for an...


  • Kozhikode, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 22,00,000

    Job Title:Data ArchitectAbout the Role:We are seeking an experienced data architect to design, develop and implement scalable data systems that support real-time and batch data processing.You will collaborate with cross-functional teams to deliver reliable, high-quality data architectures that power analytics, insights and data-driven decision-making.Key...


  • Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistOur organization is seeking a skilled professional to design, develop, and maintain robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Develop and...


  • Kozhikode, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking a seasoned Data Engineer to design and implement high-performance data pipelines, optimize database performance, and collaborate with cross-functional teams to drive business outcomes.Role OverviewThis is an exciting opportunity to join our team as a Big Data Engineer, where you will be responsible for architecting and maintaining...


  • Kozhikode, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About UsWe are seeking a Data Specialist to design, develop and maintain data systems for large-scale data processing.Key Responsibilities:The ideal candidate will have hands-on experience with Big Data technologies (Hadoop, Spark, Hive) to process structured and unstructured data.They will work on efficient ETL processes to integrate data from multiple...