Lumiq - ETL Data Engineer - Python/Numpy

2 weeks ago

Noida, Uttar Pradesh, India LUMIQ Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Purpose
We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience.

Key Responsibilities

  • Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems.
  • Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic into Elasticsearch and MongoDB.
  • Ensure end-to-end data integrity, quality, and freshness remain unaffected after the source switch.
  • Write efficient and optimized SQL queries to extract data from the new source.
  • Conduct performance testing to confirm no degradation of pipeline throughput or latency in production.
  • Work closely with DevOps and platform teams to containerize, orchestrate, and deploy the updated ETLs using Docker and Kubernetes.
  • Monitor post-deployment performance and handle any production issues proactively.
  • Document design, code, data mappings, and operational runbooks.

Required Skills And Qualifications

  • Strong experience building and maintaining large-scale distributed data systems.
  • Expert-level proficiency in Python, especially data analysis/manipulation libraries like pandas, NumPy, and Polars.
  • Advanced SQL development skills with proven experience in performance optimization.
  • Working knowledge of Docker and Kubernetes.
  • Familiarity with Elasticsearch and MongoDB as data stores.
  • Experience working in production environments with mission-critical systems.

)

  • ETL Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Lumiq Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Who we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers globally....

  • Python Backend Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Lumiq Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Who we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their datachallenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers...

  • Lumiq - Senior Python Developer - FastAPI

    1 week ago

    Noida, Uttar Pradesh, India LUMIQ Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : Senior Backend Description :Role & ResponsibilitiesPython Proficiency :Deep understanding of Python 3.7+ features, including type annotations and asynchronous programming.Experience with scripting, automation, and building scalable backend systemsFastAPI ExpertiseBuilding high-performance, asynchronous REST APIs using FastAPI.Familiarity with...

  • Lumiq - Developer

    1 week ago

    Noida, Uttar Pradesh, India LUMIQ Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role : Senior Frontend EngineerFrontend Frameworks & LanguagesReactJS (v18+ or v19) : Deep understanding of component lifecycle, hooks (useState, useEffect, useMemo, useCallback), and advanced patterns like HOCs and render props.TypeScript : Strong typing practices and interface design.HTML5, CSS3, SASS : Semantic markup, responsive design, and styling...

  • Senior Frontend Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Lumiq Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Who we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their datachallenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers...

  • Software Engineer/Senior Software Engineer- ETL

    5 hours ago

    Noida, Uttar Pradesh, India BOLD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    BOLD is seeking an ETL Specialist who will help build the architecture and maintain a robust, scalable, and sustainable business intelligence platform. Assisted by the Data Team, this role will work with highly scalable systems, complex data models, and a large amount of transactional data.ABOUT THIS TEAMBOLD Business Intelligence(BI) team is a centralized...

  • SENIOR DATA ENGINEER with PYTHON

    2 weeks ago

    Noida, Uttar Pradesh, India Soft Elevation Full time ₹ 30,00,000 - ₹ 40,00,000 per year

    Company OverviewSoft Elevation has fronted our client's goals by transforming their ideas into functional products. From IoT and Blockchain, to IoT and Big Data, to Custom Web Development, to Bespoke Mobile App Development, to UI/UX design there is no technology we have left in the raw. Our team of specialist Tech experts can remold from scratch a raw idea...

  • Python Developer

    1 week ago

    Noida, Uttar Pradesh, India VARAISYS PVT. LTD. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title:Python DeveloperLocation:Noida (Work From Office)Experience:3+ YearsAbout the RoleWe're looking for a skilledPython Developerto build scalable applications usingDjango,Flask,NumPy, andPandas. If you're curious aboutAI, ML, or GenAI, that's a huge plus — we love devs who go beyond the basics.Key ResponsibilitiesDevelop, test, and maintain...

  • Data Analyst with ETL Expert

    2 weeks ago

    Noida, Uttar Pradesh, India Eice Technology Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    ResponsibilitiesDesign, Develop, and Maintain ETL Pipelines: Create, optimize, and manage Extract, Transform, Load (ETL) processes using Python scripts and Pentaho Data Integration (Kettle) to move and transform data from various sources into target systems (e.g., data warehouses, data lakes). Data Quality Assurance: Implement rigorous data validation,...

  • Lumiq - Sales Lead

    3 hours ago

    Noida, Uttar Pradesh, India Nexthire Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role : Sales Lead(SEA Market)Experience : 7+ YearsLocation : NoidaJob Description:We are seeking a highly driven and versatile Sales Lead to spearhead our SEA Salesefforts from our Noida HQ. This individual contributor (IC) role will be accountable fornet new business development opportunities, working in close collaboration with ourHead of Business...