Senior Data Engineer
6 days ago
Overview
The Data Engineer is responsible for designing, building, and maintaining the technical infrastructure that supports the Master Data Management solution on the Azure estate at Thames. This role focuses on implementing scalable data pipelines, integration frameworks, data processing and ensuring robust data flows between source systems, the Enterprise Data Platform and the MDM platform.
Primary Responsibilities
Azure Infrastructure Design & Implementation Designs and deploys infrastructure using Azure services including but not limited to Azure Data Factory, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics, and Azure Purview. Ensures solutions are scalable, secure, and optimised for performance.
Data Pipeline Development Builds and maintains automated ETL/ELT pipelines to extract data from various source systems, transform it according to business rules or processing logic, and load it into the MDM platform via the Enterprise Data Platform. Implements real-time and batch data integration processes using Azure Data Factory and Azure Stream Analytics.
MDM Platform Integration Integrates the MDM solution with inbound and outbound systems, ensuring bidirectional data flows where required. Develops APIs and integration patterns to collect and distribute mastered records across the enterprise data platform.
Data Modelling & Architecture Designs logical and physical data models for master data entities where required working closely with the MDM architect. Implements data schemas in Azure SQL or other Azure database services, ensuring optimal structure for MDM operations including matching, merging, and hierarchies.
Data Quality Automation Implements automated data quality checks, validation rules, and data cleansing routines within pipelines. Develops exception handling and error logging mechanisms to maintain data integrity.
Performance Optimization Monitors and tunes data pipeline performance, database queries, and Azure resource utilization. Implements indexing strategies, partitioning, and caching to ensure efficient data processing.
Documentation & Collaboration Creates technical documentation for data architectures, pipeline designs, and operational procedures to align with program deliverables. Collaborates with Data Analysts, MDM architect, and business stakeholders to deliver integrated solutions.
Key Skills
Strong expertise in Azure data services, proficiency in SQL and programming languages (primarily Python), experience with data integration patterns and MDM concepts, knowledge of data modelling and dimensional design, understanding of DevOps practices, and ability to troubleshoot complex data issues in cloud environments, specifically in the MDM arena.
Job Types: Permanent, Contractual / Temporary
Pay: Up to ₹2,400,000.00 per year
Work Location: Remote
-
Senior Data Engineer
1 week ago
Remote, India AABM Cloud Data Solutions Full time ₹ 20,00,000 per yearSenior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.Job Type: Full-timePay: From ₹2,000,000.00 per yearApplication Question(s):How many years of Python Experience do you have?How many...
-
Operation Analyst
1 week ago
Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per yearJob Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...
-
Senior Data Engineer
6 days ago
Remote, India delphic Full time ₹ 14,00,000 per yearWe're Hiring: Senior Data Engineer (Remote)Join our growing data team as a Senior Data Engineer and help shape the future of data infrastructure and analytics. We're looking for someone with strong Databricks expertise and a passion for building robust, scalable data solutions.Location: RemoteExperience: 8+ yearsEmployment Type: Full-timeWhat You'll Do:Build...
-
Senior Data Engineer
1 week ago
Remote, India Vtricks Technologies Full time ₹ 5,00,000 - ₹ 18,41,823 per yearJob Title: Senior Data EngineerLocation: RemoteExperience: 4–5 YearsRole OverviewWe are looking for a Senior Data Engineer with strong hands-on expertise in building and optimizing data pipelines on the Azure cloud ecosystem. The ideal candidate should have solid experience with Azure DataBricks, Azure Data Factory, SQL, and Python to design, develop, and...
-
Senior Data Engineer
2 weeks ago
Remote, India Hunarstreet Technologies Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDescription : Position : Senior Data EngineerOverview : We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure to support cross-functional teams and next-generation data initiatives. The ideal candidate is a hands-on data expert with strong technical proficiency in Big Data...
-
Senior Data Engineer
2 weeks ago
Remote, India IMRIEL TECHNOLOGY SOLUTIONS PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per yearDescription : If you are a smart & passionate team player - then this Senior Data Engineer [Snowflake] opportunity is for you We at IMRIEL(An Allata Company) are looking for a Senior Data Engineer to implement methods to improve data reliability and quality. You will combine raw information from different sources to create consistent and...
-
Senior Data Engineer
2 days ago
Remote, India TriDevSofts Full time ₹ 7,00,000 - ₹ 8,00,000 per yearJob Title: Senior Data Engineer – Databricks (Azure)Location: RemoteEmployment Type: ContractBudget : 70k -80k Per monthAbout the RoleWe are seeking a highly skilled Databricks Engineer with strong expertise in Azure Cloud to design, build, and optimize large-scale data solutions. The ideal candidate will have a solid background in PySpark, SQL/PLSQL, and...
-
Senior Data Engineer
2 days ago
Remote, India Unify CX Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRequired Experience: 8+ Years for Senior Data EngineerPreferred Skillsets: Very Strong Python skills.Very efficient in SQL/Stored procedures.At least 8 years of Hands on Experience in AWS Step function, AWS Lambda, AWS S3, AWS ECS, AWS Cloud Watch, AWS Event Bridge, AWS Athena, AWS Glue.At least 8 years of Experience in TerraformAt least 8 years of...
-
Senior Data Engineer
2 weeks ago
Remote, India Hyqoo Full time ₹ 5,00,000 - ₹ 25,00,000 per yearRemote (LATAM)5-8 yrs Exp.Contract6 MonthsStarts - Sep 7, 2025JOBJob DescriptionJob Responsibilities:Job Title: Senior Data Engineer Location: Latin America preferred (Mexico, Brazil, Caribbean); must work CST hoursInterview Process: 2 rounds Introduction: The Senior Data Engineer plays a critical role in designing, coding, testing, and analyzing software...
-
Senior Data Integration Engineer
2 days ago
Remote, India AK Infolution Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAbout the Role:We are seeking a Senior Data Integration Engineer with 7–10 years of experience in building and managing enterprise-grade data solutions. The ideal candidate will have strong expertise in SnapLogic, Snowflake, and MDX, and will drive the design and optimization of scalable data pipelines to support analytics and business decision-making.Key...