Hpc Engineer

Key Responsibilities:

Architecture & Design

• Design and implement HPC clusters on Azure using compute-optimized VMs, Azure CycleCloud, or custom orchestrations.
• Architect MPI-based workloads (e.g., OpenMPI, Intel MPI) for distributed computation, ensuring optimal inter-node communication and performance.
• Configure Azure Gateway, VNet, and subnet/netmask settings for low-latency and secure cluster networking.
• Integrate HPC resources with Kubernetes, CI/CD pipelines, and storage backends (e.g., Blob, Lustre, or NFS).

Performance Optimization

• Profile, benchmark, and tune MPI applications and compute nodes for maximum performance.
• Optimize network topologies, NUMA configurations, and job schedulers (SLURM, PBS, or Azure Batch).
• Automate resource scaling and cost optimization through Infrastructure-as-Code (IaC) tools such as Terraform or ARM templates.

Developer Enablement

• Collaborate with application developers and data scientists to containerize or parallelize workloads.
• Provide best practices for distributed computing, debugging, and performance analysis in MPI environments.
• Develop and maintain internal documentation, training materials, and onboarding guides for HPC usage.

Security & Governance

• Ensure compliance with enterprise security standards for HPC environments.
• Collaborate with network and security teams to implement proper access control, encryption, and segmentation.
• Support audit readiness and security hardening for compute nodes and associated data paths