Staff Data Engineer-(java/python

Company DescriptionVisa is a world leader in payments and technology with over 259 billion payments transactions flowing safely between consumers merchants financial institutions and government entities in more than 200 countries and territories each year Our mission is to connect the world through the most innovative convenient reliable and secure payments network enabling individuals businesses and economies to thrive while driven by a common purpose - to uplift everyone everywhere by being the best way to pay and be paid Make an impact with a purpose-driven industry leader Join us today and experience Life at Visa Team SummaryThe Risk Solution Services RSS team part of the Acceptance Risk organization includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients These insights help tune fraud detection rules maximizing automated acceptance while minimizing fraud losses What a Staff Data Engineer does at Visa The Staff Data Engineer will be a member of RSS team in Asia Pacific The position will be based in Visa s Bangalore office You will be responsible for mentoring top engineering talent keeping the team highly engaged and motivated while delivering exceptional results Your ability to work across functions and teams will allow you to drive results and foster the right culture and environment to achieve Engineering Excellence and Innovation You will be responsible for working with product development quality engineering security engineering enterprise operations and other internal and external technology partners to deliver products for business integration enablement ResponsibilitiesStrong technology and leadership background building and managing enterprise scale Data Engineering pipelines Hadoop Hive Spark Should posses a solid understanding of data engineering principles and best practicesResponsible for the design implementation and test of scalable distributed systems that take advantage of technology to allow standardization security timeliness and quality of data Lead code reviews ensuring adherence to coding standards and promoting clean efficient code within the team Experience creating supporting production software systems and a proven track record of identifying and resolving performance bottlenecks for production systems Work closely with senior engineers to develop the best technical design and approach for new product development Work with product managers in developing a strategy and road map to provide compelling capabilities that helps them succeed in their business goals Identify opportunities for further enhancements and refinements to standards and processes This is a hybrid position Hybrid employees can alternate time between both remote and office Employees in hybrid roles are expected to work from the office 2-3 set days a week determined by leadership site with a general guidepost of being in the office 50 or more of the time based on business needs QualificationsBasic Qualifications 5 or more years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree e g Masters MBA JD MD or 0 years of work experience with a PhD Preferred Qualifications 8 yrs work experience with a Bachelor s degree or 7 Master s or Advanced degree in an analytical field such as computer science statistics finance economics or relevant area Working knowledge of Hadoop ecosystem and associated technologies For e g Apache Spark etc Strong experience in writing and optimizing spark code and Hive code to process large data sets in Hadoop environments Experience with Advanced SQL for extracting aggregating and processing big data using Hadoop Strong Development experience in one or more of the following Scala Python or Java Experience with Linux systems with Unix Shell or Python scripting and exposure to Scheduling tools like Airflow and Control - M Experience with Continuous Integration and Automated Test tools such as Jenkins Artifactory Git Selenium Chef desirable Familiarity with RDBMs viz MS SQL DB2 Oracle etc for data retrieval Knowledge on Streaming technologies like Kafka Spark streaming etc with Apache Hudi will be a plus Experience in managing and operating AWS other cloud services including EC2 S3 SageMaker etc Exposure to public cloud equivalents and ecosystem shall be a plus Knowledge on Visualization Tools like Tableau Power BI is a plus Additional InformationVisa is an EEO Employer Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law