Data Engineer

1 week ago

Delhi NCR, India Unloadbox Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Description :

About the Role :

We are seeking a GenAI Data Engineer to design, build, and optimize data pipelines for unstructured and semi-structured content, integrating advanced AI/ML capabilities. This role combines modern ETL expertise with Vector Database & GenAI integration to support intelligent document processing and semantic search applications.

Key Responsibilities :

- Develop and maintain data ingestion pipelines using Azure Data Factory (ADF) and Databricks for structured and unstructured data.

- Create notebooks to process PDF and Word documents, including extracting text, tables, charts, graphs, and images.

- Apply NLP / Embedding Models (e.g., OpenAI, Hugging Face, sentence-transformers) to convert extracted content into embeddings.

- Store embeddings and metadata into Vector Databases (e.g., FAISS, Pinecone, Milvus, Weaviate, ChromaDB).

- Design and implement semantic search and retrieval workflows to enable prompt-based query capabilities.

- Optimize ETL pipelines for scalability, reliability, and performance.

- Collaborate with data scientists and solution architects to integrate GenAI capabilities into enterprise applications.

- Follow best practices for code quality, modularity, and documentation.

Required Skills & Experience :

- Proven experience in Azure Data Factory (ADF) and Databricks for building ETL/ELT workflows.

- Strong programming experience in Python (pandas, PySpark, PyPDF, python-docx, OCR libraries, etc.).

- Hands-on experience with Vector Databases and semantic search implementation.

- Understanding of embedding models, LLM-based retrieval, and prompt engineering.

- Familiarity with handling multi-modal data (text, tables, images, charts).

- Strong knowledge of data modeling, indexing, and query optimization.

- Experience with cloud platforms (Azure preferred).

- Strong problem-solving, debugging, and communication skills.

Nice to Have :

- Experience with knowledge graphs or RAG (Retrieval-Augmented Generation) pipelines.

- Exposure to MLOps practices and LLM fine-tuning.

- Familiarity with enterprise-scale document management systems

  • Senior Data Engineer

    5 days ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Title: Senior Data Engineer (IDMC-CDI)Primary Skills: IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 8-15 yearsShift Timing: Open to work in EST shift (5PM to 2AM IST)About UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various...

  • Data Engineer

    3 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    3 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    3 weeks ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Data Engineer

    7 days ago

    Delhi, NCR, India SAM Manpower & Career Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Seeking an experienced Data Engineer with expertise in AWS, SQL, Data Warehousing, PySpark, Airflow, & streaming (Kafka/Flink). Must have strong skills in data pipelines, modern frameworks, file formats (Parquet/Delta/Iceberg), &cloud data solutions.

  • Senior/Lead Data Engineer

    3 weeks ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Data Engineering Manager

    1 week ago

    Delhi NCR, India UPLERS SOLUTIONS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Engineering Manager - Azure & PythonExperience : Years Exp.Salary : CompetitivePreferred Notice Period : 30 DaysShift : 10:00 AM to 7:00 PM ISTOpportunity Type : Noida (Remote for 6 months, Later Hybrid) Placement Type : Permanent (Note: This is a requirement for one of Uplers' Clients)Must have skills required : Engineering management, Data...

  • Senior Data Engineer

    2 weeks ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Data Engineer

    2 weeks ago

    Delhi, NCR, India Strawberry Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Requirements5+ years of experience in data engineering or a related backend/data-heavy roleStrong SQL skills and deep understanding of query performance tuningProficient in Groovy or Python for scripting and automationHands-on experience with PostgreSQL, MySQL, and MongoDB at scaleExperience working with or building for a data warehouse (e.g., Redshift,...