Large Scale Data Infrastructure Specialist

1 day ago

Aligarh, Uttar Pradesh, India beBeeDataProcessing Full time ₹ 12,50,000 - ₹ 17,50,000
Software Data Processing Specialist

At Incept Labs, we believe in leveraging human and AI collaboration to drive innovation in education and research. By combining the power of knowledge processing with imagination and lived experience, we unlock new ways to discover, adapt, and grow.

We are a small team of scientists, engineers, and builders passionate about creating next-generation AI solutions to enhance education and research. As a Software Engineer with deep expertise in large-scale data processing for LLM development, you will play a critical role in accelerating experiments, developing new datasets, improving infrastructure efficiency, and enabling key insights across our data assets.

This is an opportunity to join a high-impact, compact team responsible for both architecture and scaling of Incept's data and model development infrastructure, working with complex, multi-modal data.

  • Key Responsibilities:
  • Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research
  • Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards
Required Skills and Qualifications
  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms
  • Fluent in distributed computing frameworks
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing
  • Extensive experience with performance optimization and memory management in high-volume data systems
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling
Benefits and Opportunities

This role offers a fully remote, India-based work environment with compensation and benefits varying based on background, skills, and experience levels.

As a member of our team, you will have the opportunity to contribute to cutting-edge AI research and development, collaborate with experts in the field, and develop your skills in a dynamic and supportive environment.

  • Senior Large Scale Data Specialist

    2 days ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job OverviewA Data Engineer plays a pivotal role in designing, building, and maintaining large-scale data systems. This technical professional requires strong expertise in data warehousing, big data, and data analytics to drive business outcomes.Key ResponsibilitiesMaintain architecture principles, guidelines, and standards for data engineering...

  • Data Infrastructure Specialist

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeDataInfrastructure Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Data Infrastructure SpecialistWe are seeking a skilled data infrastructure specialist to design, build, and optimize our data pipelines and ETL workflows.This role involves building scalable data architectures, working with streaming data, and collaborating with cross-functional teams to deliver high-quality solutions.The successful candidate will...

  • Cloud Infrastructure Expert

    1 day ago

    Aligarh, Uttar Pradesh, India beBeeSpecialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Infrastructure Specialist:We are seeking a seasoned IT professional with expertise in the Elastic Stack, to design and manage large-scale observability infrastructure. As a specialist, you will be responsible for ensuring high availability, performance, and operational excellence.Key Responsibilities:Design and optimize cloud infrastructure on...

  • AI/ML Infrastructure Professional

    5 days ago

    Aligarh, Uttar Pradesh, India beBeeInfrastructure Full time ₹ 35,00,000 - ₹ 40,00,000

    Job Title: AI/ML Infrastructure SpecialistWe are seeking a highly skilled AI/ML Infrastructure Specialist to join our team. As an experienced professional in the field of artificial intelligence and machine learning, you will be responsible for designing, building, and maintaining large-scale AI/ML infrastructure.This is a critical role that requires a...

  • AI Infrastructure Specialist

    6 days ago

    Aligarh, Uttar Pradesh, India beBeeDevops Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an experienced SRE & DevOps Engineer to support large-scale AI/ML infrastructure, enabling researchers and data scientists to innovate at global scale.The ideal candidate will be responsible for scaling AI platform services for global teams, ensuring secure, high availability of mission-critical systems, and delivering automation...

  • Data Infrastructure Architect

    1 day ago

    Aligarh, Uttar Pradesh, India beBeeExpert Full time ₹ 15,00,000 - ₹ 20,20,000

    About this role:We're seeking a skilled professional who is passionate about working with Elasticsearch and Splunk clusters. If you have experience in cluster management, performance tuning, and scaling, we'd like to talk to you.This position involves gaining a deep understanding of services and applications powering next-gen security products.You'll be...

  • Unlock Data Insights

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,70,000

    Achieve Excellence as a Data Engineering Specialist.Job DescriptionWe seek an experienced Data Engineering Specialist to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data systems that fuel real-time insights for our operations worldwide.The successful candidate will have a strong...

  • Data Governance Specialist

    7 days ago

    Aligarh, Uttar Pradesh, India beBeeGovernance Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a Data Governance Specialist to join our organization. As a key member of our team, you will be responsible for executing an integrated data stewardship strategy that aligns with business priorities.The ideal candidate will have experience in large-scale data management and business transformation, as well as a strong understanding...

  • Data Engineering Specialist

    1 day ago

    Aligarh, Uttar Pradesh, India beBeeData Full time US$ 80,000 - US$ 1,20,000

    **Job Title:** Data Engineering Specialist The role of a data engineering specialist is to design and develop large-scale data processing systems using technologies like Hadoop, Spark, and other related tools. Key Responsibilities:Designing and developing scalable data processing systems.Collaborating with cross-functional teams to identify business needs...

  • Cloud Infrastructure Engineer

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeCloudInfrastructure Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Infrastructure SpecialistWe are seeking an experienced professional to join our team as a Cloud Infrastructure Specialist.The ideal candidate will have a strong background in designing, automating, and operating production-grade cloud infrastructure using a range of AWS services.Key Responsibilities:Design, deploy, and manage infrastructure...