Senior Big Data Architect

1 week ago

Pushkar, Rajasthan, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000
Big Data Engineer Job Overview

The role of Big Data Engineer involves designing, developing, and optimizing large-scale data pipelines and distributed data processing systems. This position requires strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.

Key Responsibilities:

  • Data Pipeline Development: Design and develop large-scale data pipelines using Scala, Spark, and Python for efficient data processing and transformation.
  • Streaming Solutions: Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Data Analysis: Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Cloud Architecture: Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Code Quality: Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Monitoring Systems: Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • CI/CD Workflow: Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
Required Skills and Qualifications

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Architect

    2 weeks ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 17,29,400 - ₹ 21,43,700

    Job Title: Big Data ArchitectAt our organization, you will play a key role in designing and managing large-scale data systems.The team is responsible for building and managing platforms that handle high-scale services and host millions of unique topics. To achieve this, we utilize cutting-edge Machine Learning and AI technologies on a large Hadoop...

  • Big Data Solutions Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 15,40,400 - ₹ 25,42,200

    Cloud Data ArchitectWe are seeking a seasoned professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions.Design, develop, and optimize data pipelines using GCP BigQuery, Dataflow, and Apache Airflow to support large-scale data analytics.Utilize the Big Data Hadoop...

  • Big Data Engineering Lead

    2 weeks ago

    Pushkar, Rajasthan, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    We are seeking an experienced Big Data Engineering Lead to join our team.About the RoleLead a team of data engineers across multiple geographies and time zones.Collaborate with cross-functional teams, including architects, product managers, and operations.Design and implement scalable big data solutions using Apache Spark and Python.Develop data pipelines...

  • Senior Big Data Developer

    2 weeks ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Big Data Engineer to join our team. As a Cloud Engineer, you will be responsible for designing and implementing scalable big data architectures, developing and deploying data pipelines for structured and unstructured data, and collaborating with cross-functional teams to deliver high-quality solutions.Required...

  • Data Solutions Architect

    2 weeks ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Solutions ArchitectRelevant Skills:Maintain architecture principles, guidelines and standardsBig Data, ETL, ELT systems and Data Flow computeKey Responsibilities:Design and implement data solutions in cloud environmentsDevelop software code in one or more languages such as Java and PythonImplement technology projects within a professional...

  • Chief Data Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Data EngineerAs a key member of our data team, you will play a vital role in designing and optimizing complex data pipelines, infrastructure, and tools to deliver insights across multiple products and projects.With a focus on scalability, security, and efficiency, you will collaborate closely with developers, architects, analysts, and data scientists to...

  • Senior Data Systems Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataSystems Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Systems ArchitectDescription:The role of Senior Data Systems Architect is to design, implement, and maintain scalable data systems for mission-critical Tier 1 applications. As a key member of the team, you will be responsible for leading the end-to-end delivery of advanced data systems, focusing on revenue management and other...

  • Chief Data Strategist

    1 week ago

    Pushkar, Rajasthan, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data ArchitectOur ideal candidate will be responsible for overseeing the design and implementation of large-scale data systems.Job Description:The Senior Data Architect plays a critical role in driving business growth through strategic data management. This includes selecting and integrating relevant Big Data tools and frameworks, developing and...

  • Advanced Cloud Data Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 36,28,800 - ₹ 40,32,000

    Job Opportunity: Senior Data EngineerWe are seeking an experienced data engineer to lead the design and implementation of complex data pipelines, ensuring efficient data processing and scalability. As a key member of our team, you will be responsible for architecting cloud-based solutions, enforcing data governance and compliance, and collaborating with...

  • Big Data Engineer

    7 days ago

    Pushkar, Rajasthan, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Role OverviewWe are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data...