Big Data Solutions Lead

1 day ago


Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

Job Title: Data Engineer

About the Role

We are seeking a highly skilled professional to lead the design and implementation of big data solutions.

The ideal candidate will have 5-12 years of experience in Big Data & Data related technology, with expertise in distributed computing principles and Apache Spark.

Responsibilities:

  • Designing and implementing big data solutions using Apache Spark
  • Leading a team efficiently using Agile methodology
  • Hands-on experience with Apache Spark, Python, and NoSQL databases
  • Experience with integration of data from multiple sources, including RDBMS, ERP, and files
  • Good understanding of SQL queries, joins, stored procedures, and relational schemas

Requirements:

  • 5-12 years of experience in Big Data & Data related technology
  • Expert-level understanding of distributed computing principles
  • Expert-level knowledge and experience in Apache Spark
  • Hands-on programming experience with Python, Hadoop v2, Map Reduce, HDFS, Sqoop, and NoSQL databases
  • Experience with building stream-processing systems using Apache Storm or Spark-Streaming
  • Experience with messaging systems, such as Kafka or RabbitMQ
  • Good understanding of Big Data querying tools, such as Hive, Impala, and SQL

About Us

Our company is a dynamic and innovative organization that values collaboration, creativity, and continuous learning. We offer a range of benefits, including professional development opportunities, flexible working arrangements, and a supportive team environment.

This is an excellent opportunity for a skilled professional to take on new challenges, work with cutting-edge technologies, and contribute to the growth and success of our organization.



  • Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are seeking a highly skilled Big Data Specialist to drive our business forward.This role involves designing and developing scalable big data architectures using PySpark, Hive, Spark, HBase, and other related tools.The ideal candidate will have experience with data ingestion from disparate sources onto big data platforms and exposure to...


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Position OverviewOur organization is seeking a seasoned Data Engineer to spearhead the development of scalable data solutions.The ideal candidate will possess a deep understanding of big data technologies, including HDFS, Hive, and Spark architecture. Proficiency in working with Python and PySpark programming languages is also essential.Key...


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description">Technical ArchitectWe are seeking a seasoned technical architect to lead our team in building a scalable and extensible big data platform. The ideal candidate will have a strong track record of delivering complex engineering projects and experience working with large, complex data sets.This position reports to an Engineering Manager and...

  • Big Data Engineer

    3 days ago


    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a skilled professional in Big Data engineering, you will be responsible for developing and implementing scalable data processing solutions using cutting-edge technologies.With 2+ years of experience in the field, you will have a solid understanding of Big Data concepts, Scala programming language, AWS cloud platform, and either Python or...


  • Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking an experienced Big Data Administrator to join our team.The ideal candidate will have a strong background in Hadoop administration, with expertise in designing, building, and maintaining large-scale Hadoop clusters.Key Responsibilities:Design and implement scalable Hadoop architectures to support big data analytics and...

  • Big Data Visionary

    3 days ago


    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Big Data professional to lead our data engineering efforts. As a Senior Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that drive business growth.Team Leadership: Proven experience in leading high-performing data engineering teams across multiple...


  • Palakkad, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with hands-on expertise in Python and Pyspark. This role requires someone who can implement a large-scale data engineering application for a prominent retailer.Key Responsibilities:Design, develop, and deploy scalable data processing pipelines using Pyspark.Collaborate with...


  • Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineer - Big Data SolutionsOur team is seeking a seasoned data engineer to design and implement scalable big data solutions on Google Cloud Platform.Design, develop, and optimize data pipelines using GCP services such as BigQuery, Dataflow, and Apache Airflow.Utilize the Big Data Hadoop ecosystem to manage and process vast datasets...

  • Big Data Specialist

    7 days ago


    Palakkad, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    We are seeking a Big Data professional to join our team.Key Responsibilities:Analyzing large datasets using PySpark and Hive.Desirable Skills:Proficiency in Spark and HBase for efficient data processing.Data Quality tools expertise for data accuracy and reliability.Awareness of Agile methodologies for effective collaboration.Familiarity with data ingestion...

  • Big Data Architect

    3 days ago


    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Role OverviewThe Data Engineer II will design, execute, and manage large-scale distributed data systems to drive business insights and growth.Key Responsibilities:Design and execute complex distributed data systems.Monitor and optimize existing projects for performance.Research and integrate new big data tools and frameworks as required.Implement scalable...