Big Data System Architect

4 days ago

pushkar, India beBeeDataPlatformEngineer Full time

Job Title: Data Platform SpecialistThis role is ideal for engineers who excel at designing scalable systems, reducing operational toil through automation, and collaborating closely with development teams to deliver seamless, high-availability data platforms.The Data SRE team is responsible for managing large-scale data services across both bare-metal and cloud environments.Key Responsibilities:Operate and support production data platforms at scale across internal and public cloud environments.Perform capacity planning, performance testing, disaster recovery planning, and manage distributed systems.Participate in a 24x7 on-call rotation to ensure service availability.Work closely with partner engineering teams in a unified SRE model.Implement and enforce consistent incident management processes.Define and maintain user-journey–based SLOs with strong observability metrics.Architect, deploy, tune, and troubleshoot Big Data ecosystem tools: Apache Spark, Flink, Airflow, Hive, Hadoop/HDFS, Trino, Druid, etc.Manage storage and coordination systems such as Cassandra, Zookeeper, Redis, and cloud/block/blob storage technologies.Reduce operational toil through automation and tooling improvements.Author and release code using Go, Python, Java, or Scala.Leverage configuration management, IaC, and CI/CD pipelines.Work with Kubernetes-based environments at scale (EKS/GKE preferred).Manage Linux systems, containers, virtualization, and networking components.Diagnose complex issues using strong scientific and analytical troubleshooting.Must-Have Skills:Strong hands-on experience with Kubernetes.Experience with Amazon EKS and/or Google Kubernetes Engine (GKE).Proficiency in Python programming.Experience supporting Linux systems in production environments.Expertise in Big Data technologies: Spark, Flink, Airflow, Hive, Hadoop/HDFS, Trino, Druid, etc.High-availability systems architecture knowledge.Hands-on experience with Terraform or other Infrastructure-as-Code tools.Nice-to-Have Skills:Java programming experience.Experience with Pulumi (Infrastructure-as-Code).

  • Cloud Data Systems Architect

    1 week ago

    pushkar, India beBeeData Full time

    Cloud Data Systems ArchitectAs a Cloud Data Systems Architect, you will design, build, and maintain large-scale data processing systems on Google Cloud Platform. Experience with GCP services such as Dataflow, BigQuery, and Storage Classes is necessary.The ideal candidate has 5+ years of experience in data engineering and proficiency in Python, particularly...

  • Senior Big Data Quality Assurance Specialist

    4 days ago

    pushkar, India beBeeData Full time

    Job OverviewWe are seeking a seasoned professional to lead our big data testing initiatives. As a Lead Big Data Tester, you will be responsible for ensuring the quality and reliability of our large-scale data processing systems.

  • Big Data Engineering Specialist

    1 week ago

    pushkar, India beBeeDataEngineering Full time

    Big Data Engineering SpecialistData engineering is a critical component of any organization's data strategy. As a Big Data Engineering Specialist, you will be responsible for designing, developing and maintaining large-scale data pipelines that drive business value.The ideal candidate will have hands-on experience with technologies such as Palantir Foundry,...

  • Strategic Artificial Intelligence Architect

    2 weeks ago

    pushkar, India beBeeGenerative Full time

    Job OverviewWe are seeking an experienced Artificial Intelligence Architect Lead to lead the design and development of scalable, AI-driven systems leveraging Generative AI technologies and Large Language Models (LLM) to solve complex business challenges.Key Responsibilities:Design and develop scalable, AI-driven systems focusing on Generative AI technologies...

  • AI Data Architect

    2 weeks ago

    pushkar, India beBeeData Full time

    We are seeking a highly skilled Data and AI Architect to lead the technical response for Requests for Proposals (RFPs) and Requests for Information (RFIs). The successful candidate will be responsible for driving Proof of Concepts (POCs), demonstrating the capabilities of Microsoft Fabric, AI, and Data Governance in unifying client data estates. This role...

  • AI Systems Architect

    1 week ago

    pushkar, India beBeeArtificial Full time

    Job Title: AI Systems ArchitectWe are seeking a visionary Generative AI Systems Architect to drive the development of cutting-edge Generative AI and LLM solutions.This role requires a deep understanding of complex AI systems, including Generative AI and multimodal learning.Develop advanced generative and large language models (LLMs) using Python, PyTorch,...

  • Systems Architect

    2 weeks ago

    pushkar, India beBeebackend Full time

    Backend Systems ArchitectAbout the RoleWe are seeking a skilled Backend Systems Architect to design, build, and optimize scalable backend systems.You will work with modern technologies, drive cloud migration initiatives, and ensure the robustness of our backend infrastructure.Your focus will be on developing microservices and RESTful APIs for...

  • Building AI Infrastructure Systems Architect

    2 weeks ago

    pushkar, India beBeeSystem Full time

    System Architect for AI InfrastructureWe are seeking a skilled system architect to build the infrastructure that fuses financial data with unstructured signals.Job DescriptionThe successful candidate will own the design and maintenance of the canonical data models that normalize conflicting metrics across disparate sources.You will map data from ad...

  • Senior Data Architect

    2 days ago

    pushkar, India beBeeData Full time

    Key Skills for Data Architect SuccessEpsilon Technologies Group is seeking a skilled and experienced data architect to design, build, and deploy data-centered solutions.Create efficient end-to-end data delivery solutions from acquisition through analysis, visualization, and decision support.Develop scalable ETL/ELT processes using tools such as Matillion,...

  • Chief Data Architect

    2 weeks ago

    pushkar, India beBeeData Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer with strong expertise in Azure cloud, Big Data technologies, and distributed data processing frameworks to lead the design, build, and optimization of large-scale data pipelines that support both batch and real-time analytics. Key Responsibilities:Design and build scalable,...