Senior Data Engineer

1 day ago

Noida, Uttar Pradesh, India LUMIQ Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Purpose :
We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience.

Key Responsibilities :

  • Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems.
  • Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic into Elasticsearch and MongoDB.
  • Ensure end-to-end data integrity, quality, and freshness remain unaffected after the source switch.
  • Write efficient and optimized SQL queries to extract data from the new source.
  • Conduct performance testing to confirm no degradation of pipeline throughput or latency in production.
  • Work closely with DevOps and platform teams to containerize, orchestrate, and deploy the updated ETLs using Docker and Kubernetes.
  • Monitor post-deployment performance and handle any production issues proactively.
  • Document design, code, data mappings, and operational runbooks.

Required Skills and Qualifications :

  • Strong experience building and maintaining large-scale distributed data systems.
  • Expert-level proficiency in Python, especially data analysis/manipulation libraries like pandas, NumPy, and Polars.
  • Advanced SQL development skills with proven experience in performance optimization.
  • Working knowledge of Docker and Kubernetes.
  • Familiarity with Elasticsearch and MongoDB as data stores.
  • Experience working in production environments with mission-critical systems.

  • Senior Data Strategy Consultant

    2 days ago

    Noida, Uttar Pradesh, India NTT DATA, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Summary:Are you passionate about leveraging data to drive strategic decisions and innovation in a dynamic industry? As a Senior Data Strategy Consultant, you will play a pivotal role in our journey to become a data-driven organization. You will design and implement comprehensive data strategies that align with our business objectives, ensuring our data...

  • Senior Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India Reveille Technologies,Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Hiring: Senior Data Engineer - FTE Location: Anywhere in India (Except Hyderabad) Experience: 9–12 Years Noitce period : immediate joinerMandatory Skills: Azure Databricks, PySpark, SQLGood to Have: Azure Data Factory DM or share your

  • Senior Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Vserv Careers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Profile - Senior Data EngineerExp- 4+ YearsLocation - NoidaWork Mode - HybridSkills - Data Engineering , Team Lead , Snowflake , AWS/Azure , Databricks , DBT , Data Warehousingfor applying you can share your CV on Key ResponsibilitiesDevelop and execute data strategy, focusing on public healthcare datasets such as Medicare, Medicaid, and other federal and...

  • Senior Data Engineer

    3 days ago

    Noida, Uttar Pradesh, India Eice Technology Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: Senior Data Engineer, Microsoft Fabric + SSIS SpecialistLocation: Noida, Sector 62 (Onsite, Full-Time, Long-Term Project)Experience Required: 7 + YearsAvailability: Immediate Joiners OnlyRole Overview:We are looking for a highly skilled Senior Data Engineer 7+ years of experience as a Microsoft Fabric Specialist to lead the design, development,...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data Engineer – Azure & DatabricksLocation:Noida (WFO)Skills Required: Digital : Microsoft AzureExperience Range Required: 8 to 10 Years(Rel 7+ yrs)Job Description:Must-HaveLead Back-end development maintenance of Data Quality ProductDesign and develop Data Pipeline using ADF, Databricks and integrate with other Azure ServicesExperience...

  • Senior Data Engineer

    5 days ago

    Noida, Uttar Pradesh, India 3Pillar Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial...

  • ISenior Data Strategy Consultant

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data Strategy Consultant Summary: Are you passionate about leveraging data to drive strategic decisions and innovation in a dynamic industry? As a Senior Data Strategy Consultant, you will play a pivotal role in our journey to become a data-driven organization. You will design and implement comprehensive data strategies that align with...

  • Senior Manufacturing Consultant

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Manufacturing Consultant - High-Tech Industry Summary: Are you a strategic leader with a proven track record of optimizing manufacturing processes in the high-tech sector? As a Senior Manufacturing Consultant, you will lead our manufacturing operations, ensuring the highest levels of efficiency, quality, and innovation. You will work...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Ebizon Full time

    We are looking for Data Architect/ Senior Data Engineer to join our team.Responsibilities: Design and drive end to end data and analytics solution architecture from concepttodelivery Design, develop, and support conceptual/logical/physical data models for analyticssolutions. Ensures that industry-accepted data architecture principles,standards,...

  • Senior Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India RateGain Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About RateGainRateGain Travel Technologies Limited is a global provider of AI-powered SaaS solutions for travel and hospitality that works with 3,200+ customers and 700+ partners in 100+ countries helping them accelerate revenue generation through acquisition, retention, and wallet share expansion. RateGain today is one of the world's largest processors of...