Sr. Data Engineer

6 days ago

Bengaluru, Karnataka, India Visa Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa is seeking highly energetic, passionate, technology enthusiast for Data Engineering team.

The successful candidate will work as a Senior Data Engineer and be part of the Risk Solution Services team to design and develop solutions for all data requirements. The ideal candidate will bring robust technical strength in developing solutions in extremely high volume, low latency ETL workflow design and also bring an excellent understanding of data. This role will participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities. This role will assume technical ownership of multiple applications and create robust and scalable solutions.

 Visa provides a challenging environment of volume, velocity and variety that is rarely matched.

Candidates looking forward to thrive in such environment are encouraged to apply.

Responsibilities:

  • Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)
  • Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.
  • Experience supporting production systems
  • Work closely with other engineers and peers to design and develop ETL pipelines
  • Work with product managers in understanding and clarifying on the requirements
  • Demonstrate inclination towards continuous learning and professional development.
  • Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications

  • 5+ years of relevant work experience and Bachelors degree or with an Advanced Degree
  • 4+ years of experience in Hadoop using Core Java Programming, Scala, Spark, Kafka, Hive on Linux/Unix environment.
  • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
  • Experience in writing Spark and Hive code to process large data sets in Hadoop environments
  • Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop
  • Development experience in one or more of the following: Scala, Python or Java.
  • Basic experience with Unix/Shell or Python scripting
  • Exposure to Scheduling tools like Airflow and Control – M will be a plus
  • Experience using VCS like Git
  • Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc. for data retrieval
  • Understanding of Kafka, Apache Hudi is a plus.
  • Thrive in self-motivated internal innovation driven environment.
  • Adapting fast to new application knowledge and changes.
Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

  • Sr Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

  • AWS Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...

  • Sr. Data Science

    1 week ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Job...

  • Sr. Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Nasdaq Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Nasdaq Technology is looking for a passionate Data Engineer with a focus on ETL pipelines, to join the Bangalore technology center in India. If Innovation and effectiveness drive you forward, this is the place for you Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions,...

  • Search Engine Optimization Team Lead

    5 days ago

    Bengaluru, Karnataka, India SR WAVE Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionSR Wave is a leading technology partner specializing in a diverse range of innovative services, including UX/UI design, mobile app development, full-stack web development, and cloud computing. With expertise in AI, blockchain, IoT, VR/AR, and data analytics, we empower businesses with cutting-edge digital solutions. Our interdisciplinary...

  • Sr. Data Engineer

    1 week ago

    Bengaluru, Karnataka, India TCP Corps Full time ₹ 16,00,000 - ₹ 32,00,000 per year

    Job Description Job Role - Sr Data Engineer Location - Bangalore, Pune Salary - Up to 32 LPA Notice Period - Immediate joiners -15 days only. (Who can join form 20Jan ) Mandatory Key skills - AWS ,Data ware house, Integration , ETL,ML Key Responsibilities:Develop and implement portfolio Data modelling, assurance and utilization strategies and frameworks...

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Sr. Data Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Sr. Data Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...