Data Engineer

11 hours ago

Coimbatore, Tamil Nadu, India Incept Labs Full time

Position: Software Engineer (Data)

Location: Remote, India

At Incept Labs, we believe the future of education and research lies in humans and AI working

together side by side. AI brings the ability to process knowledge at scale, while people

contribute imagination, values, and lived experience. When combined, they create a partnership

where each strengthens the other, opening new ways to discover, adapt, and grow.

We are a small team of scientists, engineers, and builders who are passionate about building

domain-specific, next-generation AI solutions to enhance education and research.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for

LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You'll join a high-impact, compact team responsible for both architecture and scaling of Incept's

data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support

distributed computing and data orchestration for LLM Research

  • Develop and maintain high-throughput systems for data ingestion, processing, and

transformation to support LLM model development

  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.

This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

  • Data Engineer

    1 week ago

    Coimbatore, Tamil Nadu, India Mold Masters Full time

    Job DescriptionAs a Data Engineer in our Business Reporting Centre, you will manage the data workflow from various ERP systems to our data warehouse. Your role includes overseeing ETL processes, maintaining data quality and integrity, and developing a secure data warehouse infrastructure.Key Responsibilities:- Design and implement ETL processes for data...

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India Reveille Technologies,Inc Full time ₹ 1,40,000 - ₹ 14,00,000 per year

    We're Hiring | Data Engineer – FTELocation:CoimbatoreExperience:3–5 YearsCTC:Up to ₹14 LPAImmediate Joiners OnlyJoin our growing team as aData Engineerand work on exciting data-driven solutions using cutting-edge cloud and big data technologies.Key Skills:Data Engineering fundamentalsAWS Cloud ServicesPython / PySparkDatabricks Apply now : ./

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India Augusta HiTech Software Full time US$ 1,50,000 - US$ 2,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: SQL, PythonWorking Shift: 2PM to 11PM ISTCity: CoimbatoreCountry: IndiaJob Title: Senior Data EngineerLocation: [Insert Location or "Remote"]Job Type: [Full-time / Contract]Experience Level: 8+ YearsOverviewWe are seeking a highly experienced Data Engineer with a strong background in SQL and Python. The...

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India ShellKode Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role OverviewWe are seeking a skilled Data Engineer with 3+ years of hands-on experience in building and managing data pipelines, data models, and cloud-based analytics solutions onGoogle Cloud Platform (GCP). The ideal candidate will have strong expertise in GCP-native services such asBigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer, along with...

  • Data Engineering Expert

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering ExpertiseWe seek a skilled Data Engineer to design, develop and maintain scalable data pipelines using Google Cloud Platform services. The ideal candidate will have hands-on experience with various GCP data stack components and a strong understanding of cloud-based data engineering principles.Key Responsibilities:Design, develop and maintain...

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India Prognova Partners Pvt Ltd Full time ₹ 47,000 - ₹ 18,18,638 per year

    Job Title: Data EngineerLocation: CoimbatoreExperience: 3 – 5 yearsResponsibilities:Design, build, and maintain robust ETL/ELT pipelines to process large-scale property data.Collaborate with UK-based data analysts and developers to ensure smooth, clean data flow into dashboards and reports.Develop and manage data lakes and data warehouses using Azure...

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India Nexaminds Full time US$ 1,25,000 - US$ 1,75,000 per year

    Unlock Your Future with NexamindsAt Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration,...

  • GCP Data Engineer

    1 week ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtree Key Skill : GCP Data Engineer Location: Coimbatore/Nagpur/Indore/Bhubaneswar Mandatory Skills :GCP Data Engineer. Job Title GCP Data Engineer Experience Required 3 to 12 years Must Have Skills GCP services,BigQuery Dataflow,Dataproc Cloud Composer. GCP Professional Data Engineering certification is a plus Job Description We...

  • Data Engineering Professional

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time US$ 1,80,000 - US$ 2,20,000

    Job Title: Data Engineering ProfessionalExperience: 5+ years of experience in data engineering and cloud services is required.A skilled data engineer is needed to design, build, and optimize scalable data pipelines and cloud solutions for the oil and gas industry. The ideal candidate will have strong experience in cloud services, data engineering, and...

  • Data Engineer

    4 weeks ago

    Coimbatore, Tamil Nadu, India hirezy Full time

    Key Responsibilities :- Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.- Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.- Implement and manage Infrastructure as Code (IaC) using Terraform to...