Optimizing Large-Scale HPC Platforms

1 day ago

Chennai, Tamil Nadu, India beBeeHighperformance Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Senior Linux Engineer - Quantitative Research

We are seeking an experienced Linux engineer to lead the design, engineering, and automation of large-scale High-Performance Computing (HPC) platforms for quantitative finance and advanced research.

  • Develop and manage scalable HPC environments with a focus on performance optimization.
  • Research and experiment with new centralized multi-tenant clustered platforms leveraging distributed file systems and cloud infrastructure.
  • Troubleshoot complex issues across storage, OS, networking layers, and provide expert-level support for HPC clusters.
  • Create tools to enhance performance, monitoring, and automation of HPC clusters, driving efficiency through automation of provisioning and housekeeping.
Requirements
  • 5+ years of experience in designing, deploying, and managing large-scale Linux infrastructure, preferably in financial services or HPC environments.
  • Deep understanding of distributed file systems (Lustre, GPFS), various filesystems (ZFS, XFS, ext4), and expertise in Linux configuration, troubleshooting, and performance tuning.
  • Familiarity with x86/AMD platforms optimized for transaction speed and distributed parallel processing, as well as knowledge of 10GE/25GE, InfiniBand, RoCE, RDMA.
  • Infrastructure automation skills: Terraform, Ansible, Puppet, Chef, with proficiency in scripting languages Python and Shell.
  • Protocol knowledge: NFS (v4.1), CIFS, SMB, ACLs, hybrid and cloud-native HPC deployment experience (AWS preferred).
  • Experience with AWS storage services (S3, Storage Gateway, EBS) and AI/ML HPC offerings on cloud platforms (AWS/GCP).
  • Hardware familiarity: HPE, Dell, Supermicro systems, with commitment to highest standards of engineering and operational excellence.

  • HPC DevOps Engineer

    3 days ago

    Chennai, Tamil Nadu, India Umanist NA Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Domain:Information Technology (IT),821Industry:Product-Based Technology Exp is mandateAbout The RoleWe are seeking an experienced HPC DevOps Engineer with strong expertise in high-performance computing (HPC) systems, Linux, and cluster management. This role involves end-to-end ownership of HPC design, implementation, and support, with a focus on scalability,...

  • HPC Software Manager

    6 days ago

    Chennai, Tamil Nadu, India KLA Full time US$ 1,50,000 - US$ 2,00,000 per year

    Company OverviewKLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem. Virtually every electronic device in the world is produced using our technologies. No laptop, smartphone, wearable device, voice-controlled gadget, flexible screen, VR device or smart car would have made it into your hands without us. KLA invents...

  • HPC Cloud Engineer

    4 days ago

    Chennai, Tamil Nadu, India Enormous Enterprise LLC Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    CompanyEnormous Enterprise LLCLocation:Chennai, Tamil Nadu, IndiaPostedSeptember 08, 2025ApplyDescriptionExperience: 4-8 YearsResponsibilitiesOptimize performance and scalability of HPC applications running in containerized environments.Stay up to date with the latest advancements in HPC, cloud technologies.Collaborate with other DevOps engineers and...

  • Lead HPC Systems Developer

    1 week ago

    Chennai, Tamil Nadu, India beBeeHpc Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    HPC Software ManagerWe are seeking a seasoned High-Performance Computing expert to manage and maintain our complex systems, ensuring optimal performance, scalability, and reliability.Key Responsibilities:Design, Implement, and Maintain HPC Software Solutions to meet business requirements.Collaborate with cross-functional teams to identify and prioritize...

  • Senior Data Engineer – Large-Scale Solutions Specialist

    1 day ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job TitleSenior Data Engineer – Large-Scale Solutions SpecialistWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and optimizing large-scale data processing solutions using PySpark and Python.

  • Expert in Large Scale Cluster Management

    4 days ago

    Chennai, Tamil Nadu, India beBeeKubernetes Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking an experienced Kubernetes Expert who will be responsible for designing, implementing, and managing large-scale Kubernetes clusters with a strong focus on performance, security, and reliability.Key Responsibilities :- Design, deploy, and manage highly available Kubernetes clusters across multi-cloud and on-prem environments.- Implement security...

  • Expert Large Scale Data Processing Professional

    4 days ago

    Chennai, Tamil Nadu, India beBeeSoftwareEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Big Data EngineerThe role of a Software Engineer (Data) is crucial in the development of large-scale data processing systems for LLM research. We are seeking an experienced professional with deep expertise in designing, building, and operating scalable data infrastructure to support distributed computing and data orchestration.Key...

  • Senior Large Scale Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Developer JobWe are seeking a highly skilled Big Data Developer to join our dynamic team. The ideal candidate will have expertise in designing and implementing large-scale data processing systems using modern data technologies.The role involves designing, developing, and maintaining scalable Big Data solutions using Hadoop ecosystem, Spark, and...

  • Large Scale Data Processing Specialist

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    GCP Data Engineer PositionWe are seeking a highly skilled data engineer to join our organization.This individual will be responsible for designing, developing, and maintaining large-scale data processing systems on Google Cloud Platform.Expertise in Snowflake data warehousing is required, including SQL, Snowpipe, Streams, and data sharing.Collaboration with...

  • Senior Cloud Engineer for Large Scale Architecture

    1 week ago

    Chennai, Tamil Nadu, India beBeeSoftwareEngineering Full time US$ 2,00,000 - US$ 2,50,000

    Job OpportunityWe are seeking a seasoned Engineering Manager of Software Development to spearhead our team in modernizing our platform on Cloud.As a hands-on leader, you will be responsible for collaborating with Product, Enterprise Solution Architects, Scrum Masters, and the leadership team to translate requirements into a scalable software architecture...