Data Infrastructure Engineer

4 days ago

Bareilly, Uttar Pradesh, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Title: Data Infrastructure Engineer

We are seeking a skilled professional to design, build, and support AI infrastructure that meets business requirements.

  • Analyze current AI infrastructure needs and future growth opportunities.
  • Design, deploy, and support AI infrastructure with CPU, GPU, middleware, and orchestration tools.
  • Configure and manage PFS (Parallel File System) and NFS (Network File System).
  • Install and configure libraries and compilers.

Responsibilities include:

  • NVIDIA GPU management and Cuda toolkit support.
  • Cloud infrastructure management on AWS and GCP.
  • Cloud bursting techniques.
  • Kubernetes installation and configuration.

Required Skills:

  • Operating Systems: Linux (RHEL, CentOS, SuSE)
  • Languages: C, C++, bash, Python
  • Schedulers and Resource Management: PBS, SLURM, Grid Engine, LSF
  • Cluster Management: xCAT, Bright Cluster Manager, War wolf
  • Monitoring: Grafana, Nagios, Zabbix, Ganglia
  • Compilers and Libraries: GNU, Intel, OpenMPI, Cuda, MPI
  • Networking: InfiniBand/ROCE/UFM/Ethernet/DPU

Broad Responsibilities Include:

  • Parallel file system management (GPFS, Lustre, Weka, BeeGFS, VAST)
  • Benchmarking tools (IOR, Limpack)
  • NVIDIA stack management (Nvidia AI Enterprise, RunAi)
  • Configuration and troubleshooting of PFS like Lustre/GPFS/WEKA
  • Job scheduler installation, configuration, and troubleshooting
  • Root cause analysis of cluster issues
  • Performance benchmarking of cluster
  • Basic knowledge of parallel programming (OpenMPI, MPI)
  • Knowledge in GPU orchestration/MIG instance creation
  • Scripting and automation (bash, Perl, Python)
  • Advanced Linux OS debugging skills

  • Data Infrastructure Engineer

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Infrastructure SpecialistOur organization is seeking a highly skilled Data Infrastructure Specialist to support the development and deployment of AI and ML initiatives. The successful candidate will be responsible for automating infrastructure provisioning, deploying machine learning models, and optimizing data processing pipelines.About the RoleThe...

  • Senior Data Infrastructure Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:Design, develop and maintain large-scale data systems using cloud-based services.About the Role:The ideal candidate will have expertise in developing scalable data infrastructure and collaborating with cross-functional teams.Key Responsibilities:Develop and optimize data pipelines using Beam, Airflow, and Terraform.Implement data security...

  • Data Engineering

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeSnowflake Full time ₹ 15,00,000 - ₹ 20,00,000

    Snowflake Developer & Infrastructure Integration ExpertWe're seeking a seasoned Snowflake developer and infrastructure expert to lead full lifecycle implementations, from secure platform setup and cloud integration to high-performance data pipeline development.

  • Data Infrastructure Specialist

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data ArchitectAbout the Role:We are seeking an experienced data architect to join our team. In this role, you will be responsible for designing and developing scalable data pipelines and infrastructure that support real-time and batch data processing.You will collaborate with cross-functional teams, including data scientists, analysts, and...

  • Data Infrastructure Architect

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Platform Engineering Lead Main Responsibilities:Develop and maintain a robust semantic layer, including dbt pipelines.Own schema design, documentation, and data contracts for the analytics and application layer.Define and enforce data platform best practices, versioning, and governance for all data models.Implement data testing,...

  • Chief Data Infrastructure Specialist

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Role OverviewData Infrastructure Architect plays a pivotal role in designing, developing and maintaining data architecture for organizations.Key Responsibilities:Data Pipeline Engineering: Designing and implementing data pipelines using Azure Data Factory, Apache Kafka and other relevant tools to ensure efficient and scalable data flow between systems,...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeAzure Full time ₹ 15,00,000 - ₹ 20,10,000

    About UsWe are seeking an experienced cloud infrastructure engineer with expertise in Azure Kubernetes Service (AKS) and Terraform to join our Cloud Engineering team. The successful candidate will be responsible for designing, implementing, and maintaining scalable, secure, and efficient cloud-based systems using AKS and Terraform.About the Role:The cloud...

  • AWS Cloud Infrastructure Data Architect

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: AWS Data Engineering ProfessionalWe are seeking a skilled AWS Data Engineer to design, develop, and deploy end-to-end data pipelines on our cloud infrastructure. The ideal candidate will have experience with AWS services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Responsibilities:Data Pipeline Design and Development: Design,...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeCloudInfrastructure Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Cloud Infrastructure EngineerWe are seeking a highly skilled professional to join our team as a Cloud Infrastructure Engineer. The successful candidate will design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions.The ideal candidate will have a strong understanding of...

  • Senior Data Infrastructure Specialist

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    We are seeking a skilled Data Architect to lead the design and development of our data lakehouse solution using Apache Iceberg and Apache Spark.This is an excellent opportunity for someone with experience in designing high-performance data architectures, integrating financial datasets, and creating secure and scalable infrastructure using AWS services.The...