Data Infrastructure Engineer

4 days ago

Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

Our organization is seeking a skilled professional to fill a key position in our data engineering team. This role will focus on designing, building, and operating scalable data infrastructure to support distributed computing and data orchestration for large language model research.

The ideal candidate will have extensive experience in data infrastructure, distributed computing frameworks, and cloud infrastructure. They should also be familiar with databases, storage systems, and how architecture choices impact performance at scale.

This is a fully remote opportunity based in India, and we are committed to providing competitive compensation and benefits packages. We value proactive individuals who prioritize documentation, automation, testing, and empowering their teammates with good tooling.

Key Responsibilities

  • Data Infrastructure Design and Operation: Design, build, and operate scalable data infrastructure to support distributed computing and data orchestration for LLM research.
  • High-Throughput Systems Development: Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development.
  • Synthetic Datasets Development: Develop synthetic datasets using state-of-the-art solutions.
  • Collaboration and Communication: Collaborate with research teams to deliver critical data assets for model development and evaluation.
  • Monitoring and Alerting: Implement and maintain monitoring and alerting to support platform reliability and performance.
  • Quality Control and Compliance: Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards.

Required Qualifications

  • Experience: 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Distributed Computing Frameworks: Fluent in distributed computing frameworks.
  • Cloud Infrastructure: Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Specialized Hardware: Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Database Management: Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Microservices Architectures: Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Performance Optimization: Extensive experience with performance optimization and memory management in high-volume data systems.

We offer a competitive compensation package and opportunities for growth and development in a dynamic and innovative environment.

We are an equal opportunities employer and welcome applications from diverse candidates.

  • Senior Azure Stack Engineer

    4 days ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 336844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN). Job Title: Senior Azure...

  • Data Infrastructure Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    At the heart of our food and beverage industry revolution lies a vital role for a Data Engineer.This is an extraordinary opportunity to design and optimize distributed data pipelines, infrastructure, and tools that empower insights across our business.As part of our innovative team, you will collaborate closely with developers, architects, analysts, and data...

  • Transforming Data Infrastructure Professional

    7 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,23,456 - US$ 1,83,432

    Transforming Data Infrastructure: A Key RoleWe're seeking an experienced Data Engineer to join our team and help clients achieve their data modernization goals. With a strong focus on cloud-first strategies, this role is ideal for those passionate about harnessing the power of data.The successful candidate will be responsible for guiding clients through...

  • Data Infrastructure Specialist

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock Your Data Engineering PotentialOrigins AI is a cutting-edge technology company that excels in solving real-world problems through clean code, thoughtful design, and fast iterations. Our team is lean, product-driven, and committed to delivering value through scalable data platforms and applications.Key Responsibilities:We seek an experienced Data...

  • Chief Data Infrastructure Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time US$ 1,80,000 - US$ 2,40,000

    Job Title: Senior Data Engineering LeadOverview:We seek a visionary leader with strong data engineering expertise to lead our team. This senior role requires experience in designing, developing, and managing scalable data infrastructure and pipelines.The ideal candidate will work closely with cross-functional teams including data scientists, analysts, and...

  • Data Infrastructure Specialist

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Key ResponsibilitiesWe are seeking a skilled Data Engineer to lead the design, development and maintenance of our data infrastructure. The ideal candidate will have hands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.Primary Responsibilities:Design and develop ETL/ELT data pipelines to ingest data from various sources into our data...

  • Data Engineer

    3 days ago

    Kanpur, Uttar Pradesh, India iXceed Solutions Full time

    Role - Data EngineerLocation - Chennai (Hybrid)Type - PermanentJob Description:Key Responsibilities:Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).Develop and maintain data processing workflows using PySpark and Python.Collaborate with data scientists, analysts, and business...

  • Data Platform Engineer

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned data professional with deep expertise in cloud development. This role is crucial for the strategic evolution of our data products and platforms.Key ResponsibilitiesData Engineering & Architecture:Design, build, and maintain scalable data pipelines and products. Develop and optimize ELT/ETL processes using various tools and...

  • Backend Developer for Advanced Data Infrastructure

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeBackend Full time ₹ 18,00,000 - ₹ 27,00,000

    Backend Engineer for DeFi Blockchain Projects About the Role:We are seeking a skilled Backend Engineer with experience in Go or Rust to contribute to our high-performance blockchain data infrastructure. You will play a key role in designing and developing event decoders, data extractors, and pricing models that power real-time analytics in the DeFi...

  • Senior Data Center Infrastructure Specialist

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeNetworkEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Network EngineerWe are seeking a seasoned Network Engineer to join our team. As a key member of our network infrastructure team, you will be responsible for designing, implementing, and managing large-scale data center networks.Key Responsibilities:Master all phases of the PDIM lifecycle: Planning, Designing, Implementing, and Migrating.Lead and support...