Technical Manager, Data Engineering
7 days ago
To ensure that Visa’s payment technology is truly available to everyone, everywhere requires the success of our key bank or merchant partners and internal business units. The Global Data Science group supports these partners by using our extraordinarily rich data set that spans more than 3 billion cards globally and captures more than 100 billion transactions in a single year. Our focus lies on building creative solutions that have an immediate impact on the business of our highly analytical partners. We work in complementary teams comprising members from Data Science and various groups at Visa. To support our rapidly growing group, we are looking for data engineers who are equally passionate about the opportunity to use Visa’s rich data to tackle meaningful business problems.
This position will be part of the Global Solution Data Engineering team under the Global Data Office function, responsible for building and maintaining global data assets and data solutions. We are looking for expertise in data warehousing and building large-scale data processing systems by using the latest database technologies. The Staff Data Engineer takes responsibility for building and running data pipelines, designing our local data warehouse and data frameworks, and catering for different data presentation techniques. The position is based at Visa's offices in Bangalore, India.
Essential Functions
• Define, Execute and Manage large scale data pipelines to build data solutions with required scalability and flexibility to support delivery to clients across all regions.
• Strong Data Analytical and Visualization skills along with experience in self-service reporting tools like Tableau or Power BI with KPIs and facilitate Visa Consulting engagements including data exchange
• Should have strong problem-solving capabilities and ability to quickly propose feasible solutions and effectively communicate strategy and risk mitigation approaches to leadership
• Build ETL pipelines in Spark, Python, HIVE that process transaction and account level data and standardize data fields across various data sources
• Responsible for the on-time delivery of dashboards and model scores to clients using the global solutions in the portfolio
• Build and maintain high performing ETL processes, including data quality and testing aligned across technology, internal reporting and other functional teams
• Responsible for the enhancements, data processing and monthly/quarterly deliverables of the products/solutions assigned from the Global solutions portfolio
• Create data dictionaries, setup/monitor data validation alerts and execute periodic jobs like performance dashboards, predictive models scoring for client’s deliverables
• Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency
• Find opportunities to create, automate and scale repeatable financial and statistical analysis for Visa Consulting and Analytics
• Collaborate with various business and technical teams across Global regions, ensuring smooth management of solution build and operations
• Strong written, verbal, and interpersonal skills needed to effectively communicate technical insights and recommendations with business customers and leadership team
• Exposure working with Global teams & Fortune 500 companies and possess strong experience working directly in client facing roles
• Exposure to model management and governance practices. Ability to take decisions around model drift to monitor and refine models continuously
• Manage a team of Data engineers, providing the required mentoring and support in building a strong team and deliver as per expectations.
Technical skills:
• Strong experience in creating large scale data engineering pipelines, data-based decision-making and quantitative analysis.
• Experience with SQL for extracting, aggregating and processing big data Pipelines using Hadoop
• Experience with complex, high volume, multi-dimensional data, as well as machine learning models based on unstructured, structured, and streaming datasets
• Strong Experience with Visualization Tools like Tableau, Power BI, D3 and exposure to code version control systems (git)
• Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling Large Data Sets in Big-Data Environments
• Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems
• Experience with Unix/Shell or Python scripting and exposure to Scheduling tools like Oozie and Airflow.
• Exposure to deploying large scale ML/AI models built by the data science teams and experience with development of models is a strong plus.
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.
Qualifications
9+ yrs. work experience with a Bachelor’s Degree or 8+ years of work experience with a Master's or Advanced Degree in an analytical field such as computer science, electronics.
Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, Python, Pandas etc.)
Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
-
bangalore, India NTT DATA Full timeJob Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...
-
Technical Lead
1 day ago
bangalore, India NTT DATA Full timeJob Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...
-
Bangalore, India NTT DATA Services Full timeAzure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...
-
Senior Engineering Manager
4 weeks ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
4 weeks ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Data Centre Remote Technical Support Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...
-
Senior Engineering Manager
4 weeks ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Sr data engineer
5 days ago
bangalore, India NTT DATA Full timeJob Description Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior...
-
Technical Lead
4 days ago
Bangalore, Karnataka, India Relic Consultancy Services Full timeExperience : 8-14 years. Notice period : 30 days. Key Responsibilities : Technical Leadership : - Lead and mentor a team of data engineers, providing technical guidance and support. - Drive the design, development, and deployment of scalable data pipelines and solutions using Databricks, Airflow, PySpark/Spark, Kafka, and cloud technologies. - Ensure best...
-
Technical Lead
3 days ago
Bangalore, India Relic Consultancy Services Full timeExperience : 8-14 years. Notice period : 30 days. Key Responsibilities : Technical Leadership : - Lead and mentor a team of data engineers, providing technical guidance and support. - Drive the design, development, and deployment of scalable data pipelines and solutions using Databricks, Airflow, PySpark/Spark, Kafka, and cloud technologies. - Ensure best...
-
Technical Lead
6 days ago
bangalore, India Relic Consultancy Services Full timeExperience : 8-14 years. Notice period : 30 days. Key Responsibilities : Technical Leadership : - Lead and mentor a team of data engineers, providing technical guidance and support. - Drive the design, development, and deployment of scalable data pipelines and solutions using Databricks, Airflow, PySpark/Spark, Kafka, and cloud technologies. - Ensure best...
-
bangalore, India NTT DATA Full timeJob Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...
-
Solutions Engineer
2 weeks ago
bangalore, India Altair Engineering Full timeJob Summary: We are seeking a dynamic and skilled Digital Twin & Data Analytics solutions engineer to join our technical presales and support team. The candidate should have strong background in data science and digital twin tools and technologies with a passion for understanding client needs from manufacturing and engineering domain with a...
-
Manager , Global Support Engineering
1 day ago
bangalore, India NTT DATA Full timeJob Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...
-
Technical Project Manager
1 month ago
bangalore, India Global Pharma Tek Full timeJob Description As a Technical Project Manager, you will be responsible for planning, organizing, and executing data-led technology projects (Data Engineering- ETL , BigData , Cloud , BI ). You will work across engineering teams, sales teams, Talent pool and domain experts throughout the lifecycle of projects: from proposal to project closure. Your...
-
Technical Account Manager- ETL/Database
4 weeks ago
bangalore, India Hevo Data Full timeAbout HevoHevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies have one thing in common. They all use Hevo Data’s fully managed Automated Pipelines to consolidate...
-
Technical Lead
1 week ago
bangalore, India NTT DATA Full timeJob Description Want to be a part of our team? Provides leadership for those involved in the development, design and optimization of one or more information technology and systems functions supporting company business processes and technical information systems platforms. Responsibilities include, but are not limited to, analysis, selection and...
-
Sr. Technical Manager
2 weeks ago
bangalore, India Collabera Digital Full timeJob Title: Senior Technical ManagerExperience : 15+ yearsLocation: Bangalore, Work from officeJob DescriptionAbout the Role:We are seeking a highly skilled Senior Technical Manager with hands-on experience in data-related technologies and a strong background in program management. The ideal candidate will have 15-18 Years of Experience with a ...
-
Technical Architect
3 weeks ago
bangalore, India NTT DATA Services Full timePosition Overview What is the nature of the position and its services provided to the client? We are currently seeking a Technical Solutions Architect Specialist Advisor to join our team in Bengaluru, India (Remote). As an experienced Technical Solutions Architect, you will become part of our growing Applications Solutions practice, helping NTT DATA create...
-
Technical Writer
2 weeks ago
bangalore, India Hevo Data Full timeAt Hevo, we believe the hallmark of a great product is its clear and succinct documentation. To achieve this, we are looking for writers with 4 -10 years of experience, who can perform independently yet work as part of a dynamic product team to scale the documentation in sync with the product functionality.If you are aspiring for a fulfilling role where you...
