Staff Data Engineer

22 hours ago

India Visa Full time

Who We Are Looking For: (Open-source Committers/Contributors)

We are seeking seasoned professionals with a deep understanding and expertise in large-scale distributed systems and platform development using open-source software. Ideal candidates will have:

  • Expertise in Distributed Systems : Proven experience in designing, developing, and maintaining large-scale distributed systems.
  • Open-Source Contributions : Active involvement in the open-source community, particularly in streaming, analytical, and low-latency services.
  • Technical Proficiency : Strong proficiency in technologies such as Apache Druid, Apache Pinot, Apache Spark, Apache Flink, Apache Kafka, Temporal, and Yugabyte.
  • Innovative Mindset : A passion for innovation and a drive to stay ahead of the curve by continuously exploring and implementing new technologies.

Job Description

Visa's Data and AI Platform team is at the forefront of transforming the payment industry by harnessing the power of big data, artificial intelligence, and cutting-edge open-source technologies. Our mission is to build scalable, high-performance data platforms and services that enable Visa’s businesses to innovate and deliver unparalleled value to our customers worldwide.

Our Work

At Visa, we are dedicated to developing robust data platforms that handle massive volumes of data, ensuring real-time processing, analytics, and low-latency responses. Our team leverages a variety of open-source software to create flexible, efficient, and reliable solutions that meet the dynamic needs of our business operations.

  • Big Data Platforms : We design and implement platforms capable of processing and analyzing vast amounts of data generated by millions of transactions daily. These platforms support various use cases, from fraud detection to personalized customer experiences.
  • Open-Source Software : Our development approach heavily relies on open-source technologies, allowing us to build innovative solutions while contributing to the wider tech community. We use and contribute to projects like Apache Hadoop, Apache Druid, Apache Pinot, Apache Spark, Apache Flink, and Apache Kafka, among others.
  • Cutting-Edge Technologies : To achieve our goals, we incorporate state-of-the-art technologies in our stack. This includes leveraging streaming analytics, real-time data processing, and low-latency services to ensure that our platforms are always at the cutting edge of performance and reliability.

The candidate must have:

  • Actively participate in all phases of software development lifecycle: analysis, technical design, planning, development, testing/CICD, release, post production/escalation support
  • Work on a highly scalable, available and resilient multi-tenant Platforms that can host large scale and highly critical applications.
  • Develop large scale multi-tenant software components on the Platform in an Agile based methodology to provide self-service capabilities.
  • Collaborating with partners from business and technology organizations, develop key deliverables for Data Platform Strategy - Scalability, optimization, operations, availability, roadmap.
  • Build partnerships with other technology teams to drive efficiency in their use of platforms and services that PaaS provide
  • Expertise in applying the appropriate software engineering patterns to build robust and scalable systems.
  • Be a self-starter, work independently and Mentor junior members in the scrum team. Stays current with new and evolving technologies
  • Builds strong commitment within the team to support the appropriate team priorities
  • This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

  • Data Warehouse Engineer | Data Warehouse Engineer | india

    2 weeks ago

    india Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    2 weeks ago

    India Data Warehouse Engineer Full time

    Experience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Expert for Analytics Projects

    2 weeks ago

    India Data Warehouse Engineer Full time

    About the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    2 weeks ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    2 weeks ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...

  • Staff Data Engineer

    4 weeks ago

    India Summit Consulting Services Full time

    About the role: The Staff Data Engineer will architect, build, and maintain data lake and data warehousing solutions for a B2B multi-tenant SaaS solution. Position requires a demonstrated ability to design processes from end to end and a strong technical understanding of modern data pipelines and strategies. In depth knowledge of multiple data sources,...

  • Grow Your Staff | Lead Engineer | india

    2 weeks ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for an Lead Engineer for a leading tech company based in the US. This is a full-time remote opportunity.The role offers excellent growth opportunities as you work directly with a dynamic team based in the US.Experience Required: 5+ yearsCTC: 20- 30 LPALocation: RemoteType of Employment: Full-timeWorking Hours: 5:30 PM - 2:30 AM IST...

  • Grow Your Staff | Lead Engineer | india

    2 weeks ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for an Lead Engineer for a leading tech company based in the US. This is a full-time remote opportunity. The role offers excellent growth opportunities as you work directly with a dynamic team based in the US. Experience Required: 5+ years CTC : 20- 30 LPA Location: Remote Type of Employment: Full-time Working Hours : 5:30 PM -...

  • Grow Your Staff | Techical Product Manager | india

    2 weeks ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for a Technical Product Manager for a leading tech company based in the US. This is a full-time remote opportunity. The role offers excellent growth opportunities as you work closely with dynamic engineering teams and stakeholders to bridge business strategy and technical execution. Experience Required : 3+ years CTC : 14-17 LPA...

  • Grow Your Staff | Techical Product Manager | india

    2 weeks ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for a Technical Product Manager for a leading tech company based in the US. This is a full-time remote opportunity.The role offers excellent growth opportunities as you work closely with dynamic engineering teams and stakeholders to bridge business strategy and technical execution.Experience Required: 3+ yearsCTC: 14-17...

  • Grow Your Staff | C# Desktop Developer | india

    7 days ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for a C# Desktop Developer for a leading software solutions company based in Hamburg, Germany. The position is a full-time remote opportunity. The role will have excellent growth opportunities. You will work directly with the team based in Germany. Experience Required: 3-5 years CTC: 10-13 LPA   Location: Remote   Time: 1...

  • Grow Your Staff | C# Desktop Developer | india

    7 days ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for a C# Desktop Developer for a leading software solutions company based in Hamburg, Germany. The position is a full-time remote opportunity.The role will have excellent growth opportunities. You will work directly with the team based in Germany.Experience Required: 3-5 yearsCTC: 10-13 LPA  Location: Remote  Time: 1 PM to 10...

  • Cloud Data Engineering Lead

    1 week ago

    India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • ITI Data | PySpark Data Engineer

    1 day ago

    india ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • ITI Data | PySpark Data Engineer

    3 days ago

    india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • Lead data engineer

    3 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Grow Your Staff | Mernstack Developer | india

    4 weeks ago

    india Grow Your Staff Full time

    Grow Your Staff is looking for a Mern Stack Developer for a technology company in the United States. This is a remote role.    The role will have excellent growth opportunities. You will be directly working with the team based out of New York.  Experience required - 2- 4 years  CTC - 8 LPA- 10 LPA Location - Remote  Time - 5:30 PM to 2:30 AM IST  Type...

  • Lead Data Engineer

    4 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    4 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...