Sr. Data Engineer

Overview:

• As a Sr Data Engineer of the AICOE team, you will develop analytical products and solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies
• The challenge will be to create high-performance algorithms built on data sets measured in the billions of transactions that allow our users to derive insights from big data that in turn drive their businesses with a keen eye for data privacy and governance

Role:-

• Leads talent acquisition efforts and initiatives, facilitates training programs and conducts performance management for team of direct reports
• Lead teams in the creation of portfolio robust ML solutions through effective use of Mastercards global data assets and software platform
• Build, productionize and maintain data driver AI/ML application and data processing workflows or pipelines
• Consult with clients/ stakeholders to understand and translate their needs into a data analyses and/or solution, ensuring that their requirements are accurately captured and technically feasible
• Guide others in comprehensive technical analyses and allocates work across teams to ensure the delivery of high quality and effective solutions
• Liaise with internal stakeholders (e.g, MA TECH, Data Strategy Management, AI governance) to identify and elaborate on opportunities as they relate to analytical solution development, feasibility, and other technical offerings
• Lead development of presentations and technical documentation
• Identify and recommend opportunities to standardize and automate efforts to ensure quality and enable scaling of ML products
• Meet project deadlines for accountable deliverables and anticipates delays or foreseeable barriers to progress and escalates issues when necessary
• Conduct due diligence quality assurance testing for prototypes and tools in stage and resolves reoccurring complex issues and bugs
• Ensure that all machine learning processes, from data preparation to model deployment, are well-documented for internal use and compliance
• Mentor and guide junior developers.

All about you:-

• Expertise in Big Data Technologies: Proficiency in big data frameworks and tools such as Hadoop, Spark, Hive- Technical Proficiency: Strong programming skills in languages such as Python and SQL
• Experience with data visualization tools (e.g, Tableau, Power BI) and understanding of cloud computing services (AWS, Azure, GCP) related to data processing and storage is a plus
• Experience with testing frameworks and test-driven development (TDD) practices- Advanced Analytical Skills: Strong applied knowledge and hands on experience in machine learning algorithms and deep learning frameworks
• Familiarity with AI and machine learning platforms such as TensorFlow, PyTorch, or similar
• Familiar with training and deploying models with large datasets including strategies for parallelizing and optimizing the training/deployment workflows
• Experience in productionizing of GenAI products a plus
• Leadership and Strategic Planning: Proven experience in leading engineering teams, defining vision and strategy for data-driven initiatives, and driving projects from conception to implementation
• Ability to mentor and develop talent within the team
• Problem-Solving Skills: Strong analytical and critical thinking abilities to solve complex problems, along with the creativity to find innovative solutions
• Communication and Collaboration: Excellent verbal and written communication skills, with the ability to explain complex analytical concepts to non-technical stakeholders
• Experience in working cross-functionally with departments and flexibility to work as a member of a matrix based diverse and geographically distributed project teams
• Project Management Skills: Proficiency in managing multiple projects simultaneously, with a focus on delivering results within tight deadlines
• Responsible AI knowledge: Awareness of the principles and practices surrounding responsible AI, including fairness, transparency, accountability, and ethics in AI deployments
• Innovation and Continuous Learning: A mindset geared towards innovation, staying abreast of industry trends, emerging technologies in big data and analytics, and continuously seeking opportunities for personal and professional growth.