
Manager, Data Engineer
2 days ago
Title and Summary
Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow
Who is Mastercard?
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Overview:
The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend.
Role:
• Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner.
• Successfully lead definition, development and delivery of major cross-department initiatives with broad scope and long-term business implications.
• Provide technical leadership and direction to software development teams in the development of services and capabilities, Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
• Work closely with product and architecture teams on product definition, technical design, and overall execution for the team.
• Ensure the project or effort is adequately staffed; trained and managed. Ensure personnel have appropriate skills and behaviors; and effectively communicate performance results; as necessary, managing each effort within approved manpower and budget guidelines
• Technically manage and drive deliveries from scrum teams that will be responsible implementing, documenting, testing, maintaining and supporting applications in adherence with industry best practices specially in Big Data space.
• Developing high quality, secure, scalable solutions based on technical requirements specifications and design artifacts within expected time and budget.
• Work across on-premises and cloud environments (AWS, Azure, Databricks).
• Design & development of high quality data driven applications and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO.
• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
• Expertise to guide team in using SDLC tools such Git-based version control systems, CI/CD pipelines using Jenkins, Checkmarx, test automation tools etc
• Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
• Good to have experience in developing enterprise solutions (standalone applications, services & SDK) using J2EE, JDBC (SQL & NoSQL) related technologies like Spring & Spring framework, micro services on Cloud.
• Integrating content feeds via API, JSON, XML, and RSS from both internal and external sources.
• supporting internal and external users of the applications/systems, performing production incident management and participating in on-call escalation pager support rotation.
• Documenting application components for support and training materials for MasterCard Quality Assurance and Quality Control processes.
About You:
• Hands-on technical leader who brings considerable experience doing application development and managing teams by using a broad range of technologies and dives deep into everything team does.
• Demonstrate leadership, ethics and values to generate high trust with team, peers, and management.
• Must be high-energy, detail-oriented and proactive with the ability to function under pressure in an independent environment.
• Must provide the necessary skills to have a high degree of initiative and self-motivation with a willingness and ability to learn and take on challenging opportunities.
• Strong communication skills – both verbal and written – with strong relationship building, collaborative skills and organizational skills.
• Must be obsessed with results, and effectively communicate objectives and how success will be measured to the team and other stakeholders.
• Have strong decision-making skills, lead retrospection and continually improve as a result.
• Understands how to guide an engineer’s career including performance evaluation, coaching, and motivation.
-
Senior Manager
2 weeks ago
Pune, Maharashtra, India, Maharashtra Opus Technologies Full timeJob Title: Data Engineering LeaderLocation: PuneExperience: 15+ YearsEmployment Type: Full-TimeCompany Name: Opus TechnologiesAbout the Role:We are looking for a dynamic and visionary Data Engineering Leader to help build and scale our Data Practice. This leadership role is ideal for someone with deep technical expertise, strong delivery acumen, and a...
-
Data Engineer
2 days ago
Pune, Maharashtra, India, Maharashtra Bajaj Technology Services Full timeWe are looking for Immediate Joiner for below positionData Engineer ( ADF , SQL , Python )Experience – 5 to 10 years Working Hours – 4AM to 1PM IST Remote Interview Process :1st Round – Virtual 2nd Round – Face to Face ( Pune )Primary Skill – Azure Data Factory ( ADF ) , SQL , DBT , Python , Snowflake . Primary RoleWe are seeking a skilled Senior...
-
Data Engineer
6 hours ago
Pune, Maharashtra, India, Maharashtra Bits In Glass Full timeTitle: Data EngineerPractice: Data Engineering & AILocation: Office (Pune / Mohali / Hyderabad)Job DescriptionAs a Data Engineer, you will be an integral part of our team, working on data pipelines, data warehousing, and data integration for various analytics and AI use cases. You will collaborate closely with Delivery Managers, ML Engineers and other...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra Kalyani Technologies Full timeOverview:We are looking for a highly skilled Python Data Engineer to join our team in an on-premise data engineering environment. The ideal candidate will have experience in ETL tools, data processing technologies, data orchestration, and relational databases. Additionally, you should be proficient in Python scripting for data engineering tasks and have...
-
Data Engineer
4 days ago
Pune, Maharashtra, India, Maharashtra Infarsight Full timeAbout:At Infarsight, we simplify complex operations across Finance, HR, Operations, and Supply Chain using platforms like Task Sight, Trip Sight, and Fleet Sight. Our engineering teams build scalable software, and our data solutions unlock real-time insights to help businesses move faster and smarter.Role Overview:As an AWS Data Engineer, you’ll design and...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra Bits In Glass Full timeTitle: Senior Data Engineer / ETL EngineerLocation: Pune / Hyderabad / MohaliJob Summary:As a Senior Data Engineer / ETL Engineer, you will be instrumental in designing, developing, and optimizing data processing systems that support our organization's data initiatives. Your expertise in Bigdata and Google Cloud Platform (GCP) will be essential in building...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra Zensar Technologies Full timeOpportunity for Data EngineerLocation-Bangalore, Hyderabad, PuneImmediate Joiner to 15 daysKey Responsibilities Design and develop a data lakehouse solution using Apache Iceberg and Apache SparkEnable high-performance Treasury analytics, integrating financial datasets and reporting enginesWork with AWS services to create secure and scalable infrastructureUse...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra Response Informatics Full timeExperience: 4 to 7 yrs in total/ almost all on skillsBudget: 18 LPALocation: Pune/ Noida/ GurgaonMode of work: WFONotice Period: immediate Joiner or within 15 Days Requirements: Expert Data Engineer - Hands-on experience with PySpark/Spark-SQL - Hands-on with Spark, SQL optimization - Deep understanding of DWH, Data modelling - Decent understanding of any...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra Hireologist Full timeJob Title: Big Data EngineerLocation: Pune (Hybrid)Experience - 5-7 YOESalary Range: ₹35–40 LPAAbout the RoleWe are looking for a Big Data Engineer to design, build, and scale high-performance data pipelines that power our products and insights. You’ll be working closely with product managers, architects, and engineering leads to define technical...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India, Maharashtra Live Connections Full timeMinimum 5 - 8Years Skill SetDatabricks Engineer, Azure Databricks, SQL, PysparkSkill to EvaluateDatabricks Engineer, Azure Databricks, SQLExperience5 to 8 YearsLocationPune, Maharashtra, IndiaJob Description Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Collaborate with data scientists and analysts to...