Big Data Engineer

3 days ago

Palakkad, Kerala, India beBeeDatabaseengineering Full time ₹ 12,00,000 - ₹ 20,00,000

Job Title: Data Architect

We are seeking a highly skilled data architect to join our team. As a data architect, you will be responsible for designing and implementing data pipelines that support business growth.

Key Responsibilities:

  • Create optimal data pipeline architecture
  • Develop events/streaming based architecture/design
  • Identify, design, and implement internal process improvements
  • Build infrastructure for optimal extraction, transformation, and loading of data
  • Create data tools for analytics and data scientist team members
  • Work with data scientists to strive for greater functionality in our data systems

Requirements:

  • Proficiency in either Scala or Python
  • Expertise in Apache Spark
  • Experience with performance tuning and optimization
  • Hands-on experience with dbt (Data Build Tool) for data transformations and data modeling
  • Ability to handle large datasets efficiently
  • Optimize Spark jobs

Preferred Qualifications:

  • 2+ years of experience in a Data Engineer role
  • Experience with big data tools: HDFS/S3, Spark/Flink,Hive,Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS /GCP cloud services
  • Experience with stream-processing systems: Spark-Streaming/Flink etc.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Strong analytic skills related to working with structured/unstructured datasets.

What We Offer:

  • A dynamic work environment
  • Cross-functional team collaboration
  • Opportunities for professional growth and development
  • Competitive salary and benefits package

How to Apply:

  • Have a few weekend side projects up on GitHub
  • Have contributed to an open-source project
  • Have worked at a product company
  • Have a working knowledge of a backend programming language
  • Programming Language → Candidate should be really good in either Scala OR Python.

Big Data Framework → Strong hands-on expertise in Apache Spark.

Performance Tuning & Optimization → Able to handle large datasets efficiently.

DBT → Must have hands-on experience with dbt (Data Build Tool) for data transformations and data modeling.

Keyword: DatabaseEngineering

],

  • Big Data Engineer

    6 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a skilled professional in Big Data engineering, you will be responsible for developing and implementing scalable data processing solutions using cutting-edge technologies.With 2+ years of experience in the field, you will have a solid understanding of Big Data concepts, Scala programming language, AWS cloud platform, and either Python or...

  • Big Data Engineering Specialist

    2 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opening for a Skilled Big Data DeveloperWe are seeking a skilled professional to join our team as a Big Data developer. The ideal candidate will have hands-on experience with Big Data development and engineering, as well as strong analytical skills.This role is ideal for a developer who thrives in a technical environment and has experience working on...

  • Big Data Engineer at Google Cloud

    3 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineer - Big Data SolutionsOur team is seeking a seasoned data engineer to design and implement scalable big data solutions on Google Cloud Platform.Design, develop, and optimize data pipelines using GCP services such as BigQuery, Dataflow, and Apache Airflow.Utilize the Big Data Hadoop ecosystem to manage and process vast datasets...

  • Big Data Visionary

    6 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Big Data professional to lead our data engineering efforts. As a Senior Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that drive business growth.Team Leadership: Proven experience in leading high-performing data engineering teams across multiple...

  • Principal Big Data Engineer

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer- Apache DruidThis role is a great opportunity to utilize your technical skills and experience in big data technologies. We are seeking a skilled engineer to join our team.Apache Druid Experience:We are looking for someone with strong hands-on experience working with Apache Druid in production environments.Required Skills and...

  • Principal Big Data Architect

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data EngineerWe are seeking a skilled professional to design, build, and maintain robust data pipelines for processing channel activity data. The ideal candidate will have experience in digital channel activities, data engineering, and cloud technologies.Key Responsibilities:Design and develop scalable data architectures using AWS cloud infrastructure and...

  • Big Data Solutions Lead

    4 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data EngineerAbout the RoleWe are seeking a highly skilled professional to lead the design and implementation of big data solutions.The ideal candidate will have 5-12 years of experience in Big Data & Data related technology, with expertise in distributed computing principles and Apache Spark.Responsibilities:Designing and implementing big data...

  • Big Data Specialist

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    We are seeking a Big Data professional to join our team.Key Responsibilities:Analyzing large datasets using PySpark and Hive.Desirable Skills:Proficiency in Spark and HBase for efficient data processing.Data Quality tools expertise for data accuracy and reliability.Awareness of Agile methodologies for effective collaboration.Familiarity with data ingestion...

  • Big Data Architect

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Role OverviewThe Data Engineer II will design, execute, and manage large-scale distributed data systems to drive business insights and growth.Key Responsibilities:Design and execute complex distributed data systems.Monitor and optimize existing projects for performance.Research and integrate new big data tools and frameworks as required.Implement scalable...

  • Big Data Administrator

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking an experienced Big Data Administrator to join our team.The ideal candidate will have a strong background in Hadoop administration, with expertise in designing, building, and maintaining large-scale Hadoop clusters.Key Responsibilities:Design and implement scalable Hadoop architectures to support big data analytics and...