Data Engineer

7 days ago

Bangalore, India Visa Full time
Job Description

At Visa, the Corporate Information Technology, Billing & Incentives Platforms team, enables Visa's revenue growth through flexible pricing engines and global revenue platforms built on next-generation technologies. This includes managing system requirements, evaluating cutting-edge technologies, design, development, integration, quality assurance, implementation and maintenance of corporate revenue applications. The team works closely with business owners of these services to deliver customer developed solutions, as well as implement industry leading packaged software. This team has embarked on a major transformational journey to build and implement best of breed revenue and billing applications to transform our business as well as technology.  

The candidate should enjoy working on diverse technologies and should be excited to take initiatives to solve complex business problems and get the job done while taking on new challenges. You should thrive in team-oriented and fast-paced environments where each team-member is vital to the overall success of the projects.

Key Responsibilities

  • Develop and maintain test automation scripts using PySpark for big data applications.
  • Collaborate with data engineers and developers to understand data processing workflows and requirements.
  • Design and implement automated tests for data ingestion, processing, and transformation in a Hadoop ecosystem.
  • Perform data validation, data integrity, and performance testing for Spark applications.
  • Utilize Spark-specific concepts such as RDDs, Data Frames, Datasets, and Spark SQL in test automation.
  • Create and manage CI/CD pipelines for automated testing in a big data environment.
  • Identify, report, and track defects, and work with the development team to resolve issues.
  • Optimize and tune Spark jobs for performance and scalability.
  • Maintain and update test cases based on new features and changes in the application.
  • Document test plans, test cases, and test results comprehensively.
  • Perform QA and manual testing for payments applications, ensuring compliance with business requirements and standards.
  • Work with limited direction, usually within a complex environment, to drive delivery of solutions and meet service levels.
  • Productively work with stakeholders in multiple countries and time zones.
  • With active engagement, collaboration, effective communication, quality, integrity, and reliable delivery develop and maintain a trusted and valued relationship with the team, customers and business partners.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.


Qualifications

Basic Qualifications
Bachelors degree, OR 3+ years of relevant work experience

Preferred Qualification
bachelor’s degree in computer science, Information Technology, or related field.
Relevant certifications in Big Data, Spark, QA.
Experience with on premise infrastructure
Knowledge of ETL processes and tools.



Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

  • Data Engineer

    3 weeks ago

    Bangalore, India Amazon Full time

    Amazon Prime team is building an evergreen platform that will provide real time insights of traffic, sales, deals, prime engagement and is looking for rock start data engineer to build this. At Amazon Prime, understanding customer data is paramount to our success in providing customers with relevant and enticing benefits such as fast free shipping, instant...

  • Staff Data Engineer, Data Engineering

    6 days ago

    Bangalore, India Visa Full time

    Job DescriptionPrimary ResponsibilitiesDesign: Lead the data pipeline designs as per the defined architecture of the metric repository, using/building re-usable functions and frameworks ensuring scalability, reliability and performance.Data Analysis: Understand the metric definitions, perform the analysis and lead the discussions with the requestors from...

  • Manager Data Engineering

    4 weeks ago

    bangalore, India Giant Eagle GCC Full time

    Manager Engineer Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...

  • Data Engineer II, ROW Central Data Engineering Team

    4 weeks ago

    Bangalore, India Amazon Full time

    Are you interested in rapidly growing business? The Amazon ARTS team is responsible for creating core analytics tech capabilities and data engineering services for ROW (the rest of the world excl. NA and EU) countries. It comprises of platforms development, research science, software development and data engineering. ARTS develops scalable analytics...

  • Data Engineer

    4 weeks ago

    Bangalore/Hyderabad, India Talent Divas Consulting Full time

    Job Description :Are you someone looking for a challenge to work in a startup environment and innovate in a global environment to help build a SaaS Service to scale? Are you willing to roll up your sleeves and do what it takes to deliver value to Customers?As we expand our Engineering operations in India, we are looking for a Sr. Data Engineer to join us and...

  • Data Engineer 4

    3 weeks ago

    bangalore, India Porter Full time

    Porter: Creating Impactful Journeys At Porter, we're not just passionate about improving productivity; we're on a vision to Moving a billion dreams one delivery at a time. We empower businesses, both large and small, to optimize their operations and unleash unprecedented growth in their core functions. Join us in pioneering the future of last-mile...

  • Director, Data Engineering

    5 days ago

    Bangalore, India Visa Full time

    Job DescriptionOverviewVisa Inc. is at the forefront of the GenAI revolution, aiming to establish itself as the world's leading data-driven payments company. We are seeking a hands-on Director of Data Engineering, Data Science, and GenAI/ML. This role is crucial to the development and management of our Loyalty and Marketing platforms while leveraging...

  • Data Engineer

    4 weeks ago

    Chennai/Bangalore, India SMARTWORK IT SERVICES Full time

    Job Summary : We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience in designing, building, and maintaining scalable data pipelines and architectures using Snowflake, Python, and Databricks. This role requires a strong foundation in data engineering practices, cloud...

  • Cloud and Data Solutions Specialist

    7 days ago

    Bangalore, Karnataka - Noida, Uttar Pradesh, India NTT DATA Full time

    About the JobNNT DATA Services is a recognized leader in IT and business services, including cloud, data, and applications, headquartered in Texas.The OpportunityYou will design, implement, and manage robust and scalable Oracle, SQL Server Applications, Database infrastructure.You will collaborate with development teams to enhance database design for optimal...

  • Snowflake Data Engineer

    4 weeks ago

    bangalore, India Tavant Full time

    About Tavant: With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Consumer Lending, Manufacturing, Agtech, Media & Entertainment, and Retail in...

  • Data Engineer

    4 days ago

    Bangalore/Chennai, India Getinz Full time

    We are seeking a skilled and motivated Data Engineer to join our dynamic data team. Role : Data Engineer Exp : 2-3 yrs Work Mode : Remote & Hybrid Location : Bangalore, Chennai Skills : Python, SQL, ETL Tools, Snowflake, AWS/Azure/GCP Skills and Qualifications : - Snowflake: Proficiency in Snowflake for data warehousing and management. - Python: Strong...

  • Data Engineer

    4 weeks ago

    Bangalore/Pune, India Rohini IT Consulting LLP Full time

    Job Title: Cloud Data Engineer Location: Bangalore / PuneJob Type: Full TimeExperience Required: 6-12 yearsNotice Period: 0-30 DaysJob Category:Digital, Cloud, Web TechnologiesJob Description:We are seeking an experienced Cloud Data Engineer with expertise in building and maintaining data pipelines and analytics solutions on AWS and Azure cloud platforms....

  • Sr. Data Engineer

    5 days ago

    Bangalore, India Visa Full time

    Job DescriptionCompany DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient,...

  • Data Engineer

    4 weeks ago

    Bangalore, India InOpTra Digital Full time

    About the Job :We are seeking a highly skilled Data Engineer with certification in Databricks to join our team and help drive cloud data engineering initiatives. The ideal candidate will have extensive experience in building and optimizing scalable data architectures, developing and managing ETL/ELT pipelines, and leveraging Databricks for large-scale data...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, India Accolite Full time

    Job Description: Airflow, data pipeline, ETL , Pyspark, batch processing, AWS (Mandatory) (Immediate Joiners Only) Exp: 4 years to 7 years *Job Summary: * -The Data Engineer will design, develop, and maintain scalable data pipelines and ETL processes using tools like Airflow and PySpark. -The ideal candidate will have experience with batch processing...

  • Data Center Engineer

    4 weeks ago

    bangalore, India ACL Digital Full time

    Dear Connections, ACL Digital is hiring for Data Center Engineer for Gurugram- Manesar(Hybrid). Job Title: Data Center Architect - Cloud & Networking Location: Gurgaon, India Experience: 5 - 15 Years About the Role: We are seeking a highly skilled and experienced Data Center Architect with a strong focus on Cloud Infrastructure and advanced networking...

  • Senior Data Engineer

    2 weeks ago

    Bangalore/Chennai, India MNR Solutions Pvt Ltd Full time

    This job description outlines the responsibilities and qualifications for a Data Engineer, focusing on experience with cloud platforms, particularly Google Cloud Platform (GCP) and AWS. It seeks an individual with solid technical expertise and the ability to collaborate with various teams to design, develop, and optimize data workflows. The role requires...

  • Data Engineering

    4 weeks ago

    Bangalore, India Jobted IN C2 Full time

    Overview: Annalect is currently seeking a data engineer to join our technology team. In this role you will build Annalect products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will...

  • Data Engineering Expert

    7 days ago

    Bangalore/Chennai, India MNR Solutions Pvt Ltd Full time

    Data Engineer Job DescriptionMNR Solutions Pvt Ltd seeks a highly skilled Data Engineer to lead the design, development, and optimization of scalable data pipelines using Google Cloud Platform (GCP).Responsibilities:Design and build robust data pipelines on GCP, ensuring they are scalable to handle increasing data loads.Collaborate with cross-functional...

  • Senior Data Engineer

    4 weeks ago

    Bangalore/Chennai, India MNR Solutions Pvt Full time

    Role : Senior Data Engineer roleExperience required : 8+ YearsLocation : Bangalore/ChennaiWork Mode : Hybrid (5 days)Mandate skills : Python, SQL, Tensorflow, any cloud experience.Job Description :- Qualifications : Bachelor's degree in Computer Science, Information Technology, or a related field.- Collaborate with cross-functional teams to collect, process,...