Big Data Architect

14 hours ago


Mangalore, Karnataka, India beBeeDataarchitect Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Big Data Architect

We are seeking a skilled data architect to design and develop large-scale big data pipelines using Scala, Spark, and Python.

The ideal candidate will have experience in designing distributed data systems and cloud-based solutions with expertise in Apache Kafka, NiFi, and Jupyter Notebooks.

Key Responsibilities:

  • Design, implement, and optimize big data pipelines using Spark, Scala, and Python.
  • Develop streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python programming.
  • Hands-on experience with Apache Kafka for real-time data processing.
  • Knowledge of NiFi / Airflow for workflow automation.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization techniques.
  • Good understanding of Cloud Architecture principles.

Preferred Skills:

  • Familiarity with messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive UIs for data analytics visualization.
  • Familiarity with monitoring/alerting solutions like Splunk or equivalent.
  • Hands-on experience with CI/CD tools like Git and Jenkins.


  • Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Big Data Engineering Leadership OpportunityWe are seeking an experienced and strategic leader with deep expertise in Big Data platforms and cloud-native environments to lead a team of data engineers.Job Summary:About the Role:This role involves leading a team of data engineers working on large-scale distributed data systems, architecting and overseeing the...


  • Mangalore, Karnataka, India beBeeCluster Full time ₹ 18,00,000 - ₹ 25,20,000

    As a Big Data Cluster Architect, you will be responsible for designing and implementing high-performance computing systems to support large-scale data processing and analysis.Key Responsibilities:Develop and maintain complex data pipelinesMigrate data between systems while ensuring minimal downtimePerform regular performance tuning and optimization...


  • Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are looking for a skilled data engineer to design, develop, and maintain large-scale data systems. The ideal candidate will have hands-on experience with big data tools, data pipelines, and cloud services.ResponsibilitiesCreate and maintain optimal data pipeline architectureCreate and maintain events/streaming based...


  • Mangalore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer Job DescriptionWe are seeking a highly skilled data engineer to join our team.Key Responsibilities:Design and develop robust big data pipelines using Python, SQL, PySpark, and bash scripts.Develop and maintain cloud-based data warehousing solutions using Redshift, Snowflake, Databricks SQL, or equivalent platforms.Collaborate with...


  • Mangalore, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleWe are seeking a visionary leader to spearhead the development of our big data platform. This individual will be responsible for creating a highly-scalable and extensible infrastructure that collects, stores, models, and analyzes massive data sets from multiple channels.About the RoleBuild and lead a high-performing team of engineers and data...

  • Big Data Specialist

    3 days ago


    Mangalore, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 20,10,000

    Job Title:Azure Data EngineerDescription:We are seeking an expert Data Engineer with proficient knowledge in Spark and SQL to join our dynamic team.The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our Data platform. You will work closely with data architects and other stakeholders to ensure data...

  • Big Data Leader Wanted

    18 hours ago


    Mangalore, Karnataka, India beBeeDataLeader Full time ₹ 20,40,560 - ₹ 32,10,936

    Big Data Leader WantedRole Overview:As a highly skilled Big Data Engineer, you will be responsible for leading the development and implementation of large-scale data processing systems. Your expertise in design and architecture of Big Data solutions using Spark will be crucial in delivering roadmap features of our Enterprise TruRisk Platform.Working closely...


  • Mangalore, Karnataka, India beBeeBigData Full time ₹ 15,00,000 - ₹ 22,00,000

    Job DescriptionWe are seeking a skilled Data Solutions Architect to join our team. As a Senior Consultant, you will utilize your technical expertise in designing and implementing solutions involving data models, database planning, and security.Your experience with big data technologies, including Power BI, Databricks, and Spark, is crucial for this role.Main...


  • Mangalore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Architect OpportunityWe are seeking a skilled Senior Data Architect to design and implement innovative solutions involving data models, databases, and big data technologies.Key Responsibilities:Designing robust data models for efficient database performancePlanning databases to meet business requirementsEnsuring data security through...


  • Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Big Data DeveloperSeeking a skilled data professional to drive strategic growth through innovative big data solutions.Key Responsibilities:Proven expertise in developing and implementing big data applications using Java, Scala, and Apache Spark Frameworks.Proficient in Unix File system and HDFS commands, with experience working with query...