Data Engineer

5 days ago

Tirupati, India Incept Labs Full time

Position: Software Engineer (Data)

Location: Remote, India


At Incept Labs, we believe the future of education and research lies in humans and AI working

together side by side. AI brings the ability to process knowledge at scale, while people

contribute imagination, values, and lived experience. When combined, they create a partnership

where each strengthens the other, opening new ways to discover, adapt, and grow.


We are a small team of scientists, engineers, and builders who are passionate about building

domain-specific, next-generation AI solutions to enhance education and research.


About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for

LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.


You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s

data and model development infrastructure, and work with highly complex, multi-modal data.


Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support

distributed computing and data orchestration for LLM Research

  • Develop and maintain high-throughput systems for data ingestion, processing, and

transformation to support LLM model development

  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards


Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.


This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

  • Data Engineer

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for ensuring the integrity and accuracy of our data pipelines.Your role will involve:Designing and implementing data transformation processesDeveloping automated tests for data quality and performanceCollaborating with cross-functional teams to...

  • Data engineer

    3 weeks ago

    Tirupati, Andhra Pradesh, India Firstsource Full time

    Key Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Data Engineering Lead

    2 weeks ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to lead our data engineering teams. As a Senior Data Engineer, you will be responsible for designing, deploying, and maintaining our organization's data platforms.Main Responsibilities:Review and analyze existing data collection systems, identifying opportunities for...

  • Data Engineer Lead

    2 weeks ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer LeadWe are seeking a highly skilled Data Engineer Lead to join our team.About the Role:The successful candidate will be responsible for leading the development of data engineering solutions, working closely with cross-functional teams to design and implement scalable data architectures.Key Responsibilities:Lead the development of...

  • Azure Data Engineer

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering OpportunitiesWe are seeking a skilled data engineer to join our team and contribute to the development of innovative data solutions. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines, as well as working with cross-functional teams to deliver high-quality data products.

  • Senior Data Engineer

    2 weeks ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job Title: Senior Data EngineerWe are seeking a skilled data engineer to lead our team in designing and implementing data models, ETL processes, and Snowflake solutions.

  • Lead Data Engineer

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time US$ 1,00,000 - US$ 1,75,000

    Job Title: Data Engineering LeadData engineering solutions drive business value by transforming data into actionable insights. We are seeking an experienced leader to spearhead this effort.This role is responsible for leading the design, development, and implementation of scalable, efficient, and effective data engineering solutions.Required Skills:Proven...

  • Data Engineering Expert

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ExpertLocation: 100 % RemoteJob Type: Full-TimeShift Timings: 3 pm - 11 pm ISTAbout the Role:We're seeking an experienced data engineering professional to help build and optimize scalable, high-performance data solutions on Databricks. The ideal candidate has hands-on experience in production environments and a deep understanding...

  • Data Engineering Strategist

    2 weeks ago

    Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,20,000

    Job DescriptionWe are seeking a highly skilled Data Engineering Strategist to lead our data migration efforts within the Azure ecosystem.The ideal candidate will have hands-on experience in modern data engineering tools and platforms, with a strong focus on SQL workload migration to Azure.Lead large-scale SQL workload migration from on-premise environments...

  • Cloud Data Engineer

    2 weeks ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 23,00,000

    Cloud Data Engineering SpecialistWe are seeking a skilled Cloud Data Engineering Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining robust data pipelines for processing channel activity data from multiple sources.Design and develop scalable data architectures using AWS...