Data Engineer

3 weeks ago

Coimbatore, Tamil Nadu, India Incept Labs Full time

Position: Software Engineer (Data)

Location: Remote, India

At Incept Labs, we believe the future of education and research lies in humans and AI working

together side by side. AI brings the ability to process knowledge at scale, while people

contribute imagination, values, and lived experience. When combined, they create a partnership

where each strengthens the other, opening new ways to discover, adapt, and grow.

We are a small team of scientists, engineers, and builders who are passionate about building

domain-specific, next-generation AI solutions to enhance education and research.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for

LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You'll join a high-impact, compact team responsible for both architecture and scaling of Incept's

data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support

distributed computing and data orchestration for LLM Research

  • Develop and maintain high-throughput systems for data ingestion, processing, and

transformation to support LLM model development

  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.

This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

  • Data Engineer

    6 days ago

    Coimbatore, Tamil Nadu, India DataWeave Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionDataWeave is a digital commerce analytics SaaS platform that helps consumer brands and retailers optimize revenue and margins across online channels. Our solutions include Digital Shelf Analytics and Brand Protection for consumer brands, as well as Pricing Intelligence and Assortment Analytics for omnichannel retailers. We enable...

  • Data Engineer

    4 weeks ago

    Coimbatore, Tamil Nadu, India Mold Masters Full time

    Job DescriptionAs a Data Engineer in our Business Reporting Centre, you will manage the data workflow from various ERP systems to our data warehouse. Your role includes overseeing ETL processes, maintaining data quality and integrity, and developing a secure data warehouse infrastructure.Key Responsibilities:- Design and implement ETL processes for data...

  • Data Engineer

    17 hours ago

    Coimbatore, Tamil Nadu, India Reveille Technologies,Inc Full time ₹ 14,00,000 - ₹ 14,40,000 per year

    We're Hiring | Data Engineer – FTELocation:CoimbatoreExperience:3–5 YearsCTC:Up to ₹14 LPAImmediate Joiners OnlyJoin our growing team as aData Engineerand work on exciting data-driven solutions using cutting-edge cloud and big data technologies.Key Skills:Data Engineering fundamentalsAWS Cloud ServicesPython / PySparkDatabricks Apply now : ./

  • Data Engineer

    16 hours ago

    Coimbatore, Tamil Nadu, India Augusta HiTech Software Full time US$ 1,50,000 - US$ 2,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: SQL, PythonWorking Shift: 2PM to 11PM ISTCity: CoimbatoreCountry: IndiaJob Title: Senior Data EngineerLocation: [Insert Location or "Remote"]Job Type: [Full-time / Contract]Experience Level: 8+ YearsOverviewWe are seeking a highly experienced Data Engineer with a strong background in SQL and Python. The...

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India ShellKode Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Role OverviewWe are seeking a skilled Data Engineer with 3+ years of hands-on experience in building and managing data pipelines, data models, and cloud-based analytics solutions onGoogle Cloud Platform (GCP). The ideal candidate will have strong expertise in GCP-native services such asBigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer, along with...

  • Data Engineer

    13 hours ago

    Coimbatore, Tamil Nadu, India Prognova Partners Pvt Ltd Full time ₹ 47,000 - ₹ 18,18,638 per year

    Job Title: Data EngineerLocation: CoimbatoreExperience: 3 – 5 yearsResponsibilities:Design, build, and maintain robust ETL/ELT pipelines to process large-scale property data.Collaborate with UK-based data analysts and developers to ensure smooth, clean data flow into dashboards and reports.Develop and manage data lakes and data warehouses using Azure...

  • GCP Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtreeKey Skill : GCP Data EngineerLocation: Coimbatore/Nagpur/Indore/BhubaneswarMandatory Skills :GCP Data Engineer.Job Title GCP Data EngineerExperience Required 3 to 12 yearsMust Have Skills GCP services,BigQuery Dataflow,Dataproc Cloud Composer.GCP Professional Data Engineering certification is a plusJob DescriptionWe are seeking an...

  • GCP Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtreeKey Skill : GCP Data EngineerLocation: Coimbatore/Nagpur/Indore/BhubaneswarMandatory Skills :GCP Data Engineer.Job Title GCP Data EngineerExperience Required 3 to 12 yearsMust Have Skills GCP services,BigQuery Dataflow,Dataproc Cloud Composer.GCP Professional Data Engineering certification is a plusJob DescriptionWe are seeking an...

  • AWS Data Engineer

    2 weeks ago

    Coimbatore, Tamil Nadu, India Reveille Technologies Full time

    Job Summary :We are seeking a highly skilled AWS Data Engineer with 3-5 years of experience to enable data-driven operations and decision-making in an agile, product-centric environment. The ideal candidate will have extensive hands-on experience with Python and big data platforms on AWS, including Redshift, Glue, and Lambda. You will be responsible for...

  • Gcp data engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtreeKey Skill : GCP Data EngineerLocation: Coimbatore/Nagpur/Indore/BhubaneswarMandatory Skills : GCP Data Engineer.Job Title GCP Data EngineerExperience Required 3 to 12 yearsMust Have Skills GCP services, Big Query Dataflow, Dataproc Cloud Composer.GCP Professional Data Engineering certification is a plusJob DescriptionWe are seeking...