Sr. Data Engineer(4+ Yrs, Hadoop, Scala, Python, Java

2 weeks ago

Bangalore, India Visa Full time
Job Description

Team Summary

 

The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing fraud losses.

 

What a Sr Data Engineer does at Visa:

The Sr Data Engineer will be a member of RSS team in Asia Pacific. The position will be based in Visa’s Bangalore office.

The individual will be accountable for supporting and driving the design, development and implementation of analytics-driven strategies as well as high-impact solutions for Visa clients. He/she will bring in deep expertise from banking and payments with a strong background in data pipelines to solve complex problems and unlock business value.

 

Responsibilities

  • Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)

  • Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.

  • Experience supporting production systems

  • Work closely with other engineers and peers to design and develop ETL pipelines

  • Work with product managers in understanding and clarifying on the requirements

  • Demonstrate inclination towards continuous learning and professional development.

  • Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.

 

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.


Qualifications

Basic Qualifications

• 2 or more years of work experience with a Bachelor’s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)

Preferred Qualifications

• 5+ yrs. work experience with a Bachelor’s degree or 4+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
• Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
• Experience in writing Spark and Hive code to process large data sets in Hadoop environments
• Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop
• Development experience in one or more of the following: Scala, Python or Java.
• Basic experience with Unix/Shell or Python scripting
• Exposure to Scheduling tools like Airflow and Control – M will be a plus
• Experience using VCS like Git
• Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc for data retrieval
• Understanding of Kafka, Apache Hudi is a plus.

Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.



Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

  • Sr. Data Engineer

    2 months ago

    Bangalore, India Visa Full time

    Job DescriptionTeam Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...

  • Data Engineer

    3 months ago

    Hyderabad/Bangalore/Chennai, India SPG Consulting Solutions Pvt.Ltd Full time

    Job Description: Senior Data EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for Hadoop applications as part of our Enterprise Data...

  • Sr. Data Engineer

    2 months ago

    Bangalore Urban, India Visa Full time

    • 5+ yrs. work experience with a Bachelor’s degree or 4+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area. • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.) • Experience in writing Spark and Hive code to process large data...

  • Sr. Data Engineer

    2 months ago

    Bangalore Urban, India Visa Full time

    • 5+ yrs. work experience with a Bachelor’s degree or 4+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.• Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)• Experience in writing Spark and Hive code to process large data sets...

  • Sr. Data Engineer

    2 months ago

    Bangalore, India Visa Full time

    Job Description Team Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...

  • Data Engineer python, spark, Hadoop, big data

    22 hours ago

    bangalore, India Prontoex Consulting Services Pvt Ltd Full time

    Client : Capgemini - Direct PayrollsLocation: BangaloreMax Budget : 3-4 Yrs : 12LPA / 4 -6 Yrs : 18LPATitle: Data Engineer with python, spark, Hadoop, big dataExp: 3 to 6 yrsData Engineerpython, spark, Hadoop, big dataExp: 3-6 YrJob Description:As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, you will beresponsible for...

  • Data Engineer

    2 months ago

    Bangalore, India Visa Full time

    Job DescriptionTeam Summary The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing...

  • Data Engineer python, spark, Hadoop, big data

    2 days ago

    bangalore, India Prontoex Consulting Services Pvt Ltd Full time

    Client : Capgemini - Direct Payrolls Location: Bangalore Max Budget : 3-4 Yrs : 12LPA / 4 -6 Yrs : 18LPA Title: Data Engineer with python, spark, Hadoop, big data Exp: 3 to 6 yrs Data Engineer python, spark, Hadoop, big data Exp: 3-6 Yr Job Description: As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, you will be ...

  • Big Data Engineer

    3 months ago

    Bangalore/Pune, India Confidentail Full time

    Experience : 4+ YearsLocations : Pune & BangaloreWorking Mode : Hybrid Job Responsibilities :- Design, develop, and maintain highly scalable data processing applications- Write efficient, reusable and well-documented code- Deliver big data projects using Spark, Scala, Python, SQL, HQL, Hive- Maintain and tune existing Hadoop/Hbase applications- Work closely...

  • Data Engineer

    3 months ago

    bangalore, India Hunarstreet Technologies Pvt Ltd Full time

    Job Description :- We are seeking a highly skilled Trainer with extensive experience in Data Engineering to join our team.- The ideal candidate will possess a robust background in developing data pipelines, ETL processes, and data warehousing solutions.- As a Trainer, you will be responsible for delivering comprehensive training sessions on data engineering...

  • Java Spark

    2 weeks ago

    Bangalore City, India Ankyah Infinity Pvt. Ltd. Full time

    Java SparkMin Experience – 8+Key Points Must Have● Advanced Java proficient● Microservices● Spring boot● Writing SQL Queries (proficient)● AWS● 4-5 Yrs in Java, 2-3 exp Spark● Good to have● Unix Shell scriptingJD● Minimum of 8 years of experience in building complex Data Platforms and Data Engineering● Minimum of 6 years of hands on...

  • Nielsen - Big Data Engineers Java/Scala/Hadoop/Spark/AWS

    2 months ago

    Bengaluru/ Bangalore, India timesjobs Full time

    Big Data Engineers (Java/Scala/Hadoop/Spark/AWS) Bangalore, IndiaTechnology Engineering /Full Time/ HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when...

  • Hadoop Developer

    2 weeks ago

    bangalore, India Wipro Full time

    Mandatory Skills: Java, Hadoop, Big Data, Scala, SparkLocation: BangaloreExp: 6 to 10 yrsNP: Max 30 daysNote: Conducting Face to Face drive on 31st Aug 2024For more details kindly share your updated CV to below mail IDName: Divyashree M SMail ID:

  • Staff Data Engineer

    1 month ago

    Bangalore, India Visa Full time

    Job DescriptionAs a Staff Data Engineer for the Risk and Identity (RaIS) technology organization, you will discover, and maintain a variety of Applied AI research projects for Visa Protect A2A. In this role, you will drive innovations by introducing technologies, methods, and solutions to deliver innovative products. You will drive innovation from...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Visa Full time

    • Bachelor's degree, OR 3+ years of relevant work experience Preferred Qualifications • 2 yrs. work experience with a bachelor’s degree or master’s or advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area. • Working knowledge of Hadoop ecosystem and associated technologies - Hadoop, Hive,...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Visa Full time

    • Bachelor's degree, OR 3+ years of relevant work experiencePreferred Qualifications• 2 yrs. work experience with a bachelor’s degree or master’s or advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.• Working knowledge of Hadoop ecosystem and associated technologies - Hadoop, Hive,...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Visa Full time

    • 12+ yrs. work experience with a Bachelor’s degree or 10+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area. • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.) • Strong experience in writing and optimizing spark code and Hive...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Visa Full time

    • 12+ yrs. work experience with a Bachelor’s degree or 10+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.• Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)• Strong experience in writing and optimizing spark code and Hive...

  • Nielsen - Sr. Data Engineer - Big Data, Spark, Scala, Python, AWS, RDBMS, SQL- Bengaluru/ Bangalore-Nielsen Research Ltd. Co.-4-8 - TimesJobs.com

    2 weeks ago

    Bengaluru/ Bangalore, India Nielsen Research Ltd. Co. Full time

    Apply Nielsen - Sr. Data Engineer - Big Data, Spark, Scala, Python, AWS, RDBMS, SQL, Nielsen Research Ltd. Co. in Bengaluru/ Bangalore for 4 - 8 year of Experience on TimesJobs.com

  • Sr. Data Engineer- Data Engineering-

    4 months ago

    Bangalore, India Visa Full time

    Job DescriptionAuthentication is an exciting and rapidly developing field, teeming with fresh and innovative ideas. With a strong demand for new solutions, this space promises to be a hotbed of innovation for the next 5 to 10 years. If you're eager to immerse yourself in the dynamic world of identity, risk measurement and consumer authentication, learn...