Senior Data Engineer

1 day ago

Remote, India SimplyTech Consulting Full time ₹ 24,00,000 per year

Overview

The Data Engineer is responsible for designing, building, and maintaining the technical infrastructure that supports the Master Data Management solution on the Azure estate at Thames. This role focuses on implementing scalable data pipelines, integration frameworks, data processing and ensuring robust data flows between source systems, the Enterprise Data Platform and the MDM platform.

Primary Responsibilities

Azure Infrastructure Design & Implementation Designs and deploys infrastructure using Azure services including but not limited to Azure Data Factory, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics, and Azure Purview. Ensures solutions are scalable, secure, and optimised for performance.

Data Pipeline Development Builds and maintains automated ETL/ELT pipelines to extract data from various source systems, transform it according to business rules or processing logic, and load it into the MDM platform via the Enterprise Data Platform. Implements real-time and batch data integration processes using Azure Data Factory and Azure Stream Analytics.

MDM Platform Integration Integrates the MDM solution with inbound and outbound systems, ensuring bidirectional data flows where required. Develops APIs and integration patterns to collect and distribute mastered records across the enterprise data platform.

Data Modelling & Architecture Designs logical and physical data models for master data entities where required working closely with the MDM architect. Implements data schemas in Azure SQL or other Azure database services, ensuring optimal structure for MDM operations including matching, merging, and hierarchies.

Data Quality Automation Implements automated data quality checks, validation rules, and data cleansing routines within pipelines. Develops exception handling and error logging mechanisms to maintain data integrity.

Performance Optimization Monitors and tunes data pipeline performance, database queries, and Azure resource utilization. Implements indexing strategies, partitioning, and caching to ensure efficient data processing.

Documentation & Collaboration Creates technical documentation for data architectures, pipeline designs, and operational procedures to align with program deliverables. Collaborates with Data Analysts, MDM architect, and business stakeholders to deliver integrated solutions.

Key Skills

Strong expertise in Azure data services, proficiency in SQL and programming languages (primarily Python), experience with data integration patterns and MDM concepts, knowledge of data modelling and dimensional design, understanding of DevOps practices, and ability to troubleshoot complex data issues in cloud environments, specifically in the MDM arena.

Job Types: Permanent, Contractual / Temporary

Pay: Up to ₹2,400,000.00 per year

Work Location: Remote

  • Senior Data Engineer

    3 days ago

    Remote, India AABM Cloud Data Solutions Full time ₹ 20,00,000 per year

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.Job Type: Full-timePay: From ₹2,000,000.00 per yearApplication Question(s):How many years of Python Experience do you have?How many...

  • AWS/Snowflake Support Engineer

    2 weeks ago

    Remote, India Data Engineer Academy LLP Full time ₹ 10,000 - ₹ 1,50,000 per year

    We're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • Operation Analyst

    3 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...

  • sme sql

    1 week ago

    Remote, India Data Engineer Academy LLP Full time ₹ 76,800 - ₹ 96,000 per year

    We're Hiring: SQL Subject Matter Expert (SME) – Mock Interviews & Mentoring (Part-Time)Remote (India) | Work From Home | Flexible Timings | Pay: $600 – $800 / 80 hoursAbout the OpportunityData Engineer Academy is looking for an experienced SQL Subject Matter Expert (SME) to conduct mock interviews and provide mentorship to aspiring data professionals....

  • Subject Matter Expert Specialist

    2 weeks ago

    Remote, India Data Engineer Academy LLP Full time ₹ 7,20,000 - ₹ 12,00,000 per year

    We're Hiring: Subject Matter Expert (SME) – Snowflake & Databricks on AWS CloudRemote | Part Time | Flexible Timings | Pay: ₹600 – ₹1000/HourAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 10 years of experience in cloud data...

  • Senior Data Engineer

    2 weeks ago

    Remote, India Ipeople Infosysteams LLC Full time ₹ 20,00,000 - ₹ 35,00,000 per year

    Senior Data EngineerXometry (NASDAQ: XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives manufacturers the critical resources they need to grow their business while also making it easy for buyers at Fortune 1000 companies to tap into...

  • Senior Data Engineer

    2 weeks ago

    Remote, India Milestone Technologies Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Senior Data Engineer

    2 weeks ago

    Remote, India 3Pillar Global Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.As a Senior Data Engineer, you will hold a crucial...

  • Senior Data Engineer

    4 days ago

    Remote, India Fusemachines Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About FusemachinesFusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from...

  • Senior Data Engineer

    1 week ago

    Remote, India Rojgar group Full time ₹ 15,00,000 - ₹ 21,00,000 per year

    Senior Data EngineerAbout the RoleWe are seeking an experienced **Senior Data Engineer** with expertise in cloud data engineering to join our team. This is an exceptional opportunity for a seasoned professional to work on complex data solutions, leveraging Azure cloud services and Snowflake data platform in a fully remote environment.Position...