Sr. Data Engineer

Company DescriptionVisa is a world leader in payments and technology with over 259 billion payments transactions flowing safely between consumers merchants financial institutions and government entities in more than 200 countries and territories each year Our mission is to connect the world through the most innovative convenient reliable and secure payments network enabling individuals businesses and economies to thrive while driven by a common purpose - to uplift everyone everywhere by being the best way to pay and be paid Make an impact with a purpose-driven industry leader Join us today and experience Life at Visa Team SummaryThe Risk Solution Services RSS team part of the Acceptance Risk organization includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients These insights help tune fraud detection rules maximizing automated acceptance while minimizing fraud losses What a Sr Data Engineer does at Visa The Sr Data Engineer will be a member of RSS team in Asia Pacific The position will be based in Visa s Bangalore office The individual will be accountable for supporting and driving the design development and implementation of analytics-driven strategies as well as high-impact solutions for Visa clients He she will bring in deep expertise from banking and payments with a strong background in data pipelines to solve complex problems and unlock business value ResponsibilitiesExperience on developing maintaining and supporting big data ETL pipelines Hadoop Hive Spark Responsible for the implementation and test of scalable distributed ensuring security timeliness and quality of data Experience supporting production systemsWork closely with other engineers and peers to design and develop ETL pipelinesWork with product managers in understanding and clarifying on the requirementsDemonstrate inclination towards continuous learning and professional development Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment This is a hybrid position Hybrid employees can alternate time between both remote and office Employees in hybrid roles are expected to work from the office 2-3 set days a week determined by leadership site with a general guidepost of being in the office 50 or more of the time based on business needs QualificationsBasic Qualifications2 or more years of work experience with a Bachelor s Degree or an Advanced Degree e g Masters MBA JD MD or PhD Preferred Qualifications 5 yrs work experience with a Bachelor s degree or 4 Master s or Advanced degree in an analytical field such as computer science statistics finance economics or relevant area Working knowledge of Hadoop ecosystem and associated technologies For e g Apache Spark etc Experience in writing Spark and Hive code to process large data sets in Hadoop environments Strong experience with SQL for extracting aggregating and processing big data using Hadoop Development experience in one or more of the following Scala Python or Java Basic experience with Unix Shell or Python scripting Exposure to Scheduling tools like Airflow and Control - M will be a plus Experience using VCS like Git Basic understanding of RDBMs viz MS SQL DB2 Oracle etc for data retrieval Understanding of Kafka Apache Hudi is a plus Additional InformationVisa is an EEO Employer Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law