Senior Data Engineer

3 weeks ago

Bangalore, India Incept Labs Full time

Software Engineer (Data)

Remote, India

About us

Incept Labs is an AI research lab based in San Francisco, California. Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutions to enhance education and research. Backed by marquee investors and scientific collaborators, we believe in a future where humans and AI work together side by side. Together, AI processes knowledge at scale while humans contribute imagination, values, and lived experience, creating new ways to discover, adapt, and grow.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s data and model development infrastructure, and work with highly complex, multi-modal data. 

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research
  • Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development 
  • Develop synthetic datasets using state-of-the-art solutions 
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster. 
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing. 
  • Extensive experience with performance optimization and memory management in high-volume data systems. 
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.

This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

  • Senior Data Engineer

    7 days ago

    bangalore, India HireAlpha Full time

    Senior Data Engineer (Informatica Platform Engineer / Administrator) – Bangalore We’re looking for a Senior Data Engineer with strong expertise in Informatica platform administration to join our Group IT Data Engineering team.This role is ideal for professionals who enjoy building and maintaining enterprise-grade data platforms that power large-scale...

  • Senior Data Scientist

    2 weeks ago

    Bangalore, Karnataka, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team In this role you will be responsible for driving data science initiatives developing predictive models and providing insights that guide key business decisions The ideal candidate has a strong background in statistical analysis machine...

  • Senior data engineer

    4 weeks ago

    Bangalore, India CoreTek Labs Full time

    ???? We’re Hiring for Top MNC –Senior Data Engineer! ???????? Location: PAN India ???? Experience: 4 - 9 Years Notice Period: immediate to October joiners ???? What we’re looking for: Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Must to have skills Python, Pandas, SQL, Snowflake,...

  • Senior Data Engineer

    2 days ago

    bangalore, India 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior Data Engineer

    1 week ago

    bangalore, India PASO Co Full time

    Job descriptionWe’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-TimeAbout the RoleOne of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...

  • Senior data engineer

    4 weeks ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based...

  • Senior data engineer

    2 weeks ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and...

  • Senior Data Engineer

    1 week ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based...

  • Senior Data Engineer

    7 days ago

    bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...

  • Senior Data Engineer

    7 days ago

    bangalore, India Sonata Software Full time

    The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data...