Senior Data Architect

2 weeks ago

Davangere, Karnataka, India beBeeBigDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking a highly skilled Big Data Specialist to join our team. The ideal candidate will have a proven track record in designing, developing and optimizing large-scale data pipelines and distributed data processing systems.

The Big Data Engineer will be responsible for working extensively with Scala, Spark (PySpark), and Python for data processing and transformation, developing and integrating streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow, and writing efficient queries and performing data analysis using Jupyter Notebooks and SQL.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.
Required Skills and Qualifications

Must-Haves:

  • Strong expertise in Scala.
  • Minimum 3+ years of hands-on experience with Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Nice-to-Haves:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.
Benefits

As a Big Data Engineer at our company, you will have the opportunity to work on challenging projects, collaborate with experienced professionals, and contribute to the growth of our data-driven organization.

  • Senior Data Architect

    1 week ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Principal Data ArchitectAbout the Role:We are seeking a highly skilled Principal Data Architect to join our team. As a key member of our organization, you will play a vital role in designing and developing enterprise-grade data systems.Your primary responsibilities will include contributing to codebases, architecting data platforms, and collaborating with...

  • Data Architect Opportunity

    1 week ago

    Davangere, Karnataka, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data ArchitectWe are seeking a highly skilled data architect to lead the development of large-scale data pipelines.Key Responsibilities:Design, develop and maintain scalable data architectures for structured and unstructured data.Collaborate with cross-functional teams to identify business requirements and develop solutions.Work with cloud-based data...

  • Senior Cloud Architect

    1 week ago

    Davangere, Karnataka, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Cloud ArchitectWe are seeking an experienced Senior Cloud Architect to join our team.Strong experience in CI/CD tools e.g. Jenkins, Gitlab, Github Actions is required.Proficiency with Containerization (e.g. Docker) and Orchestration (e.g. Kubernetes, ECS, EKS) is essential.Strong hands-on experience with cloud platforms (AWS, Azure or GCP)...

  • Senior Data Architect

    1 week ago

    Davangere, Karnataka, India beBeeData Full time US$ 1,80,000 - US$ 2,00,000

    About the RoleThis high-profile position involves driving technical innovations in data platforms and pipelines, including risk evaluation.You will be responsible for delivering critical features of our Enterprise TruRisk Platform.This cutting-edge platform enables customers to measure, communicate, and eliminate cyber risks.Design, develop, and support a...

  • Senior Data Architect

    1 week ago

    Davangere, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity:We are seeking a Senior Data Scientist to spearhead the development and deployment of advanced AI/ML models.This role involves designing and implementing predictive analytics models, machine learning algorithms, and data visualization tools.The successful candidate will ensure accuracy, explainability, and compliance with regulatory...

  • Visionary Data Architect

    7 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 25,00,000 - ₹ 32,00,000

    Strategic Data Architect RoleIn this pivotal position, you will be responsible for developing a comprehensive data strategy that shapes the architecture of our data warehouse solutions.As a key member of our team, you will mentor senior engineers and collaborate on large-scale data initiatives to drive business growth and innovation.Key responsibilities...

  • Senior Master Planner

    1 week ago

    Davangere, Karnataka, India beBee Architect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Master Planner">Job Summary: We are seeking a highly skilled and experienced Senior Master Planner to join our team. The successful candidate will be responsible for leading the planning and design of industrial projects, including advance manufacturing of chemicals, fine chemicals, and specialty chemicals.">Key Responsibilities:">">Lead...

  • Senior Cloud Data Architect

    1 week ago

    Davangere, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Position Overview:We seek an accomplished Data Platform Strategist to spearhead the development and execution of a cloud-native data platform.Key Responsibilities:Develop and communicate a compelling vision for the platform to drive business growth and operational efficiency.Collaborate with cross-functional teams (engineering, product, business, and...

  • Senior Enterprise Data Architect

    2 weeks ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewThis role is for a seasoned Data Engineering professional with a focus on designing, developing and deploying scalable enterprise data analytics solutions.The ideal candidate will have extensive experience in data engineering using Snowflake, as well as expertise in cloud platforms and containerization technologies.Data Pipeline Design &...

  • Senior Big Data Engineer

    1 week ago

    Davangere, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data Engineer">We are seeking a highly skilled and experienced Senior Big Data Engineer with expertise in designing, architecting, and implementing scalable data engineering solutions using AWS Cloud Services.">Key Responsibilities:">Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex...