Leading Big Data Solutions Architect

14 hours ago

Gandhinagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000
Big Data Engineer - Scala Job Description

We are seeking a highly skilled Big Data Engineer (Scala) with expertise in distributed data systems and cloud-based solutions to join our data engineering team.

The ideal candidate will have hands-on experience in building, scaling, and optimizing big data pipelines using Scala, Spark, Python, NiFi, and Apache Kafka.

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).

This role requires strong software engineering concepts, data modeling, and optimization techniques. If you are passionate about big data and scalability, we encourage you to apply.

  • Chief Data Solutions Architect

    7 days ago

    Gandhinagar, Gujarat, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Chief Data Solutions Architect**Job Description:We are seeking a highly skilled and experienced Chief Data Solutions Architect to lead our organization's data initiatives. This is an exciting opportunity for a talented individual who can design and implement end-to-end data pipelines and data integration solutions.**Key...

  • Senior Data Solutions Architect

    2 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Senior Data Solutions ArchitectWe are looking for a highly skilled and experienced data solutions architect to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable and reliable data systems that meet the evolving needs of our business.As a senior data solutions architect, you will...

  • Cloud Data Solutions Architect

    1 day ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 30,00,000 - ₹ 40,00,000

    Job TitleA highly skilled AWS Data Engineer is required to design and implement scalable cloud-based data solutions.About the RoleWe are seeking an experienced professional with a strong background in cloud data engineering, able to work on complex projects and collaborate with cross-functional teams.The ideal candidate will have 5-7 years of experience in...

  • Big Data Cluster Architect

    5 days ago

    Gandhinagar, Gujarat, India beBeeCloudera Full time ₹ 8,00,000 - ₹ 10,00,000

    Job Summary:We are seeking a seasoned Big Data Professional to join our team. In this role, you will be responsible for designing and maintaining large-scale data processing clusters using Cloudera technology.About the Role:Design and manage complex big data architecturesMigrate data between different platformsOptimize data processing workflows for improved...

  • Big Data Architect

    2 hours ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerAt the heart of our organization is a need for skilled data engineers who can design and develop scalable, high-performance data processing systems. We are seeking an exceptional individual with a strong background in software development and a passion for working with complex algorithms and data structures.The ideal candidate will...

  • Chief Data Solutions Architect

    42 minutes ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Leading Data Engineering InitiativesWe are seeking a highly skilled and experienced data engineer to spearhead our company's data engineering initiatives. As a group head of data engineering, you will be responsible for designing, building, and maintaining large-scale data systems that meet business stakeholder needs.The ideal candidate will have a strong...

  • Big Data Consultant

    2 days ago

    Gandhinagar, Gujarat, India beBeeBigData Full time ₹ 18,00,000 - ₹ 21,00,000

    Key Role: Big Data ConsultantJob Description:Drive Business Value with Expertise in Big Data and Cloud ComputingWe are seeking a seasoned expert to lead our big data initiatives, leveraging expertise in designing and developing high-performance data pipelines using Oracle Data Flow or Apache Spark.Responsibilities:Design, develop, and deploy scalable data...

  • Lead Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team. This role will involve designing, implementing and maintaining large-scale data engineering systems.Key Responsibilities:Design and develop data pipelines using Python and PySparkMaintain and optimize existing data engineering systemsCollaborate with cross-functional...

  • Data Solutions Architect

    5 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 21,12,000 - ₹ 25,12,000

    Big Data Solutions EngineerAbout the RoleIn this challenging and exciting role, you will be responsible for designing and developing complex data transformation processes using Snowflake.You will utilize SQL scripting to implement sophisticated queries and data transformations, ensuring seamless integration with other systems.Collaborate with...

  • Data Architect

    7 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    We are seeking a skilled Data Architect to lead the design and development of our data infrastructure.This is a full-time role that involves creating scalable data architectures, developing real-time data processing pipelines using technologies like Kafka, Flink, and Spark. The ideal candidate will have experience with data modeling, ETL processes, and...