Big Data Architect

9 hours ago


Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

Role Overview

The Data Engineer II will design, execute, and manage large-scale distributed data systems to drive business insights and growth.


Key Responsibilities:

  • Design and execute complex distributed data systems.
  • Monitor and optimize existing projects for performance.
  • Research and integrate new big data tools and frameworks as required.
  • Implement scalable solutions based on business and data requirements.
  • Develop reusable components and data tools to facilitate integration with the company's data platform.

Requirements:

  • 2-4 years of experience in big data technologies (Apache Hadoop) and relational databases (MS SQL Server/Oracle/MySQL/Postgres).
  • Proficiency in at least one of the following programming languages - Java, Python or Scala.
  • Expertise in SQL (T-SQL/PL-SQL/SPARK-SQL/HIVE-QL).
  • Proficiency in Apache Spark with knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL/PySpark/Scala APIs, and deep understanding of performance optimizations.
  • Good understanding of distributed storage (HDFS/S3).
  • Strong analytical/quantitative skills and comfortable working with very large sets of data.
  • Experience with integration of data across multiple data sources.
  • Good understanding of distributed computing principles.

Nice to Have Skills:

  • Experience with Message Queues (e.g., Apache Kafka).
  • Experience with MPP Systems (e.g., Redshift/Snowflake).
  • Experience with NoSQL Storage (e.g., MongoDB).

  • Big Data Visionary

    15 hours ago


    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Big Data professional to lead our data engineering efforts. As a Senior Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that drive business growth.Team Leadership: Proven experience in leading high-performing data engineering teams across multiple...


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data EngineerWe are seeking a skilled professional to design, build, and maintain robust data pipelines for processing channel activity data. The ideal candidate will have experience in digital channel activities, data engineering, and cloud technologies.Key Responsibilities:Design and develop scalable data architectures using AWS cloud infrastructure and...


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description">Technical ArchitectWe are seeking a seasoned technical architect to lead our team in building a scalable and extensible big data platform. The ideal candidate will have a strong track record of delivering complex engineering projects and experience working with large, complex data sets.This position reports to an Engineering Manager and...

  • Big Data Specialist

    5 days ago


    Palakkad, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    We are seeking a Big Data professional to join our team.Key Responsibilities:Analyzing large datasets using PySpark and Hive.Desirable Skills:Proficiency in Spark and HBase for efficient data processing.Data Quality tools expertise for data accuracy and reliability.Awareness of Agile methodologies for effective collaboration.Familiarity with data ingestion...

  • Big Data Engineer

    15 hours ago


    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a skilled professional in Big Data engineering, you will be responsible for developing and implementing scalable data processing solutions using cutting-edge technologies.With 2+ years of experience in the field, you will have a solid understanding of Big Data concepts, Scala programming language, AWS cloud platform, and either Python or...


  • Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking an experienced Big Data Administrator to join our team.The ideal candidate will have a strong background in Hadoop administration, with expertise in designing, building, and maintaining large-scale Hadoop clusters.Key Responsibilities:Design and implement scalable Hadoop architectures to support big data analytics and...


  • Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are seeking a highly skilled Big Data Specialist to drive our business forward.This role involves designing and developing scalable big data architectures using PySpark, Hive, Spark, HBase, and other related tools.The ideal candidate will have experience with data ingestion from disparate sources onto big data platforms and exposure to...


  • Palakkad, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with hands-on expertise in Python and Pyspark. This role requires someone who can implement a large-scale data engineering application for a prominent retailer.Key Responsibilities:Design, develop, and deploy scalable data processing pipelines using Pyspark.Collaborate with...


  • Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...

  • Big Data Specialist

    20 hours ago


    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking a skilled Data Engineer to join our growing team.Main Responsibilities:Design and develop end-to-end data pipelines for financial datasets.Integrate third-party APIs and data feeds into internal systems.Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).Ensure data...