Technical Manager, Data Engineering

7 days ago


Pune, Maharashtra, India Mastercard Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Technical Manager, Data EngineeringBackground

Mastercard is on a journey to modernize and advance our Finance Technology landscape, covering Billing, Financial Planning, Accounting, Settlement, Treasury, Reporting and Analytics. This position will be responsible for developing and delivering high-impact technology solutions that align with our business and technical objectives. By collaborating with cross-functional teams, including business/product owners and other technical experts, you will ensure that our solutions meet evolving customer needs while improving performance, scalability, and reliability.

Responsibilities

  • Manage a technical team, mentoring them, providing technical guidance, measuring performance and helping in their career growth. As a leader of Data platform / technology, providing guidance on complex technical challenges and driving resolution, ensuring solutions align with Mastercard's engineering and data principles, and technical policies.
  • Partnering with data owners, engineering and platform teams to establish robust data pipelines, implement data models, and ensure seamless integration across diverse systems and domains.
  • Ensure alignment between business goals and technical execution, making sure features and solutions meet business requirements and customer needs.
  • Participate in sprint planning, retrospectives, and other agile ceremonies to ensure the team is aligned and delivering efficiently.
  • Assigning tasks to the team and ensuring delivery within time and quality

  • Adoption and ensure implementation by the team - best practices in software / data engineering, automated code reviews, testing, and continuous integration/continuous delivery (CI/CD).

  • Optimize the cost/benefit of software features and architecture, ensuring scalability, performance, and operational efficiency.

  • Ensuring solutions align with Mastercard's engineering and data principles, and technical policies.
  • Identify opportunities for process improvements, helping to streamline workflows and enhance team productivity.
  • Work closely with Product Owners / business to understand requirements and implement technical solutions with engineering best practices.
  • Stay abreast of Data Platform technology trends and industry best practices to hone and maintain your talent
  • Participate in architectural discussions, iteration planning, and feature sizing meetings
  • Adhere to Agile processes and participate actively in agile ceremonies

All About You

15+ years of hands-on experience developing solutions on Cloud data platform, including Databricks, and managing teams. Proven experience as a hands-on data engineer, with a strong focus on delivering large-scale projects in an agile environment.

  • Hands-on experience in Databricks and deep understanding of its architecture. Design, develop and implement large-scale, high-volume, high-performance, highly available, scalable data-based solution and pipelines for the Databricks Lakehouse platform in AWS cloud. Hands-on experience with Hadoop, Nifi, pyspark. Hands-on with open table formats including Apache Iceberg and Parquet. Strong programming skills in Python and frameworks, with a focus on building scalable, reliable, and performant solutions. Experience with Bit Bucket, Jenkins.
  • Hands-on experience developing and supporting data lakes, lakehouses, warehouses on-premise and on cloud, ETL solutions and other analytics solutions.
  • Experience of AWS cloud infrastructure and services, and cloud-native software design. Experience with all tiers of applications deployed in the cloud, configuring network, cloud native services, infrastructure, and privileges for development teams (AWS Accounts, IAM Users and Roles, VPCs, S3 buckets, cloud native services) and Knowledge of cloud networking concepts, subnets, routing, load balancing, firewalls, and cloud security.
  • Prior experience with financial systems, such as Oracle Financials, Oracle Fusion Cloud, and Hyperion, with experience optimizing their integration into broader data ecosystems, is a plus.
  • Experience with data lifecycle management, including ingestion, ETL, pruning, modeling, and governance, within highly regulated environments.
  • Expertise in modern data engineering best practices, CI/CD, automated testing, and code reviews, etc.
  • Experience in partnering with data owners and other engineering and platform teams to build and manage a single source of truth for data, leveraging end-to-end technology stacks and best practices in data architecture.
  • Strong programming skills in Python and frameworks, with a focus on building scalable, reliable, and performant solutions. Experience with performance engineering, ensuring systems are built to scale and meet varying demands.
  • Knowledge of security best practices and experience in ensuring the secure development of applications.
  • Experience in driving technical decision-making and trade-offs, balancing competing priorities such as business goals, technical constraints, and user experience.
  • Ability to identify process inefficiencies and drive continuous improvement initiatives within the team.
  • Experience working with development / engineering teams in a global environment.
  • Experience on native AWS cloud services.
  • Experience and knowledge of Bit Bucket, Rally, and Jenkins a plus
  • Strong understanding of cloud DevOps practices and implementation.
  • Experience in cloud data migration for large sized enterprise data warehouse environments.
  • Understanding of cloud data governance, compute optimization, cost control, etc.
  • Understanding cloud security models, encryption strategy, network layers for on-prem + cloud hybrid model and other related concepts.

-Understanding of any one database technology - like Exadata / Oracle / Netezza / SQL server

  • Understanding of SDLC and experience in establishing processes, standards and governance to bring efficiency within development team

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.


  • Pune, Maharashtra, India Lubrizol Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a highly skilled and experienced Technical Engineering Manager for Data Engineers to join our Information Technology team. This role is pivotal in managing workloads across multiple projects and diverse engineering skill sets. The Technical Engineering Manager will be accountable for overseeing the delivery of engineering work from vendors and...


  • Pune, Maharashtra, India Mastercard Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Data Engineer

    6 days ago


    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionKey Responsibilities:Design and develop data ingestion pipelines.Work on ETL/ELT processes for large-scale data systems.Good experince in Machine LearningCollaborate with cross-functional teams to ensure data quality and performance.Required Skills:PythonETLDatabricksPySparkSQLMachine LearningWorks in the area of Software Engineering, which...


  • Pune, Maharashtra, India Peoplefy Infosolutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Hi,Greetings from Peoplefy Infosolutions We are hiring for one of our reputed MNC client based in Pune.We are looking for candidates with 11+ years of experience in data engineering along with 2+ years of experience in team handling.Job Description:Lead, mentor, and manage a technical team, ensuring effective work allocation and project delivery.Collaborate...


  • Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Technical Lead

    2 weeks ago


    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This center delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...


  • Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345390NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Technical Operations Manager to join our team in Pune, Mahārāshtra (IN-MH), India (IN). We are...

  • Technical Architect

    6 days ago


    Pune, Maharashtra, India NTT DATA Full time ₹ 1,50,00,000 - ₹ 2,50,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Networking...


  • Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...