
Data Engineer
1 week ago
Roles and Responsibilities
- Build and maintain scalable, fault-tolerant
data pipelines
to support GenAI and analytics workloads across OCR, documents, and case data. - Manage ingestion and transformation of semi-structured legal documents (PDF, Word, Excel) into structured formats.
- Enable
RAG workflows
by processing data into chunked, vectorized formats with metadata. - Handle large-scale ingestion from multiple sources into
cloud-native data lakes
(S3, GCS),
data warehouses
(BigQuery, Snowflake), and PostgreSQL. - Automate pipelines using orchestration tools like
Airflow/Prefect
, including retry logic, alerting, and metadata tracking. - Collaborate with ML Engineers to ensure data availability, traceability, and performance for inference and training pipelines.
- Implement data validation and testing frameworks using
Great Expectations
or
dbt
. - Integrate OCR pipelines and post-processing outputs for embedding and document search.
- Design infrastructure for
streaming vs batch
data needs and optimize for cost, latency, and reliability.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or equivalent.
- 3+ years of experience in building distributed data pipelines and managing multi-source ingestion.
- Proficiency with
Python
,
SQL
, and data tools like Pandas, PySpark. - Experience working with data orchestration tools (Airflow, Prefect), and file formats like Parquet, Avro, JSON.
- Hands-on experience with cloud storage/data warehouse systems (S3, GCS, BigQuery, Redshift).
- Understanding of GenAI and vector database ingestion pipelines is a strong plus.
- Bonus: Experience with OCR tools (Tesseract, Google Document AI), PDF parsing libraries (PyMuPDF), and API-based document processors.
-
Digital Engineering Engineer
6 days ago
Gurgaon, Haryana, India NTT DATA Full timeReq ID 295081NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Engineer to join our team in Gurgaon Hary xc4 x81na IN-HR India IN Job Duties Must have ...
-
Data Engineer
2 weeks ago
Gurgaon, Haryana, India AuxoAI Full time ₹ 15,00,000 - ₹ 28,00,000 per yearRole SummaryAuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 7-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize...
-
Data Engineer
6 days ago
Gurgaon, Haryana, India Strategic Talent Partner Full time ₹ 15,00,000 - ₹ 28,00,000 per yearRole: Data Engineer for financial datasets in a quant research & trading environment.Key Responsibilities:Build Python-driven data ingestion pipelines from market & internal sources.Ensure data quality with automated validation & anomaly detection.Manage data vendors, optimize costs, & expand data pipeline.Collaborate with quants & engineers for seamless...
-
Data Engineer
1 day ago
Gurgaon, Haryana, India NatWest Group Full time US$ 1,50,000 - US$ 2,00,000 per yearJoin us as a Data Engineering LeadThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank through developing innovative data driven solutions, inspiring to be commercially successful through insight, and keeping our customers' and the...
-
Data Engineer
6 days ago
Gurgaon, Haryana, India ExcelGens, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per yearWe're Hiring:Data Engineer (Microsoft Fabric Specialist)Are you an experienced Data Engineer (2-3 years) with strong hands-on expertise in Microsoft Fabric?JoinExcelGens, Inc.in Gurgaon and play a key role in building scalable, modern, and intelligent data solutions.What you'll do: Design & develop data pipelines using Microsoft Fabric (Data Factory, Data...
-
Data Engineer
3 days ago
Gurgaon, Haryana, India Skillventory Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole & responsibilitiesRole PurposeThe Data Engineer will be responsible for developing and maintaining ADA (Analytical Data Architecture) solutions that support the Personal Bank Reporting teams. This role requires a strong technical foundation in data engineering, with a focus on building scalable, efficient data pipelines and enabling high-quality...
-
Data Engineer
2 weeks ago
Gurgaon, Haryana, India BigStep Technologies Pvt Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per yearKey Responsibilities: Build, scale, and maintain robust data solutions to support business objectives. Design, implement, and optimize high-performance data pipelines (extraction,loading, transformation, and orchestration) with scalability, reliability, and speed. Lead end-to-end software development projects involving large language models(LLMs),...
-
Data Engineer
2 weeks ago
Gurgaon, Haryana, India Strategic Talent Partner Full timeAbout the Role : We are seeking a proactive and detail-oriented Data Engineer to build and maintain robust data processes for our financial datasets. You will play a pivotal role in designing data ingestion pipelines, ensuring data quality, and enabling seamless access for our quantitative research and trading Responsibilities : Python Driven Data Pipelines...
-
Data Engineer
2 weeks ago
Gurgaon, Haryana, India Honasa Consumer Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per yearKey ResponsibilitiesDevelop & Maintain Data Pipelines – Design, build, and optimize scalable ETL/ELT workflows to collect, transform, and store structured and unstructured dataDatabase & Query Optimization – Optimize SQL queries, ensure efficient data storage, and improve query performance for better system efficiencyData Quality & Validation –...
-
Data Engineer
2 weeks ago
Gurgaon, Haryana, India McCain Foods Full time ₹ 4,00,000 - ₹ 8,00,000 per yearPosition Title:Data EngineerPosition Type:Regular - Full-TimePosition Location:GurgaonRequisition ID:37277Position SummaryData engineers are mainly responsible for designing, building, managing, and operationalizing data pipelines to support key data and analytics use cases. They play a crucial role in constructing and maintaining a modern, scalable data...