Sr Data Engineer

1 month ago

bangalore, India Visa Full time

Company Description:

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa


Job Description:

Role: Sr Data Engineer

Location: Bangalore (Hybrid: 2-3 set days a week)


As a Senior Data Engineer, you'll join our Value-Added Services – Digital Marketing & Engagement organization. You will help design, enhance, and build our data infrastructure and pipelines within an agile development environment, collaborating with colleagues who will support and challenge you daily.

Key Responsibilities:

  • Design, develop, and maintain robust and scalable data pipelines and ETL processes.
  • Ensure data services are highly available, secure, scalable, and resilient.
  • Drive innovation to differentiate our data products and accelerate time-to-market delivery.
  • Utilize containerization technologies such as Docker and Kubernetes, and expertise in Java/Python, and both relational and non-relational databases.
  • Apply your data engineering skills with Hadoop/ Spark and Scala.
  • Represent the team in various technical forums and build deep partnerships with product management.
  • Analyze business requirements to architect highly secure, robust, and scalable data solutions.
  • Lead internal proof of concept initiatives and quickly design and implement prototypes.
  • Champion efforts to design and implement components of our global data processing systems.
  • Follow and create software best practices and processes.
  • Mentor team members and create an atmosphere of mutual accountability.
  • Play a key role in meetings and discussions with cross-functional and non-technical teams.


Qualifications:

Basic Qualifications:

3+ years of relevant work experience with a Bachelor’s degree or at least 2 years of experience with an Advanced Degree (e.g., Master's, MBA, JD, MD) or 1 year of work experience with a PhD.


Preferred Qualifications:

  • 4+ years of relevant work experience with a Bachelor's Degree or 3+ years with an Advanced Degree or 2+ years with a PhD.
  • Demonstrated leadership in delivering high-quality, large-scale, enterprise-class data applications.
  • Solid experience in big data engineering, with knowledge of Hadoop, Apache Spark, Python, and SQL.
  • Expertise in Java, REST APIs, and container-based technologies (Docker, Kubernetes).
  • Proficiency in creating and managing large-scale data pipelines and ETL processes.
  • Experience developing and maintaining Spark pipelines and productizing AI/ML models.
  • Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services.
  • Skilled in Unix/Shell or Python scripting and scheduling tools like Airflow and Control-M.
  • Strong experience with data storage technologies and databases (e.g., MySQL, PostgreSQL, MongoDB).
  • Familiarity with Agile development, TDD, CI/CD, and various data warehousing solutions.
  • Proven track record of building reliable, scalable, and operable data applications.
  • Ability to manage component security analysis and collaborate with security teams.
  • Strong work ethic, focus on immediate goals, and proven experience as a technical leader.
  • Passion for mentoring and helping juniors grow professionally.
  • Excellent communication and interpersonal skills, and a strong team player.


Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

  • Sr Data Engineer

    1 month ago

    bangalore, India Mewar Infotech Limited Canada Full time

    Company DescriptionMewar Infotech Limited Canada is an Information Technology and Consulting company specializing in software testing services across various domains. With a focus on Functional testing, Automation testing, Performance testing, and Security testing, we aim to enhance the quality of applications for our global clients. Our expertise lies in...

  • Sr Data Engineer

    1 month ago

    Bangalore, India Mewar Infotech Limited Canada Full time

    Company Description Mewar Infotech Limited Canada is an Information Technology and Consulting company specializing in software testing services across various domains. With a focus on Functional testing, Automation testing, Performance testing, and Security testing, we aim to enhance the quality of applications for our global clients. Our expertise lies in...

  • Sr data engineer

    1 month ago

    Bangalore, India Mewar Infotech Limited Canada Full time

    Company Description Mewar Infotech Limited Canada is an Information Technology and Consulting company specializing in software testing services across various domains. With a focus on Functional testing, Automation testing, Performance testing, and Security testing, we aim to enhance the quality of applications for our global clients. Our expertise lies...

  • Sr Data Engineer

    1 month ago

    bangalore, India Mewar Infotech Limited Canada Full time

    Company DescriptionMewar Infotech Limited Canada is an Information Technology and Consulting company specializing in software testing services across various domains. With a focus on Functional testing, Automation testing, Performance testing, and Security testing, we aim to enhance the quality of applications for our global clients. Our expertise lies in...

  • Sr. Data Engineer-GCP

    1 week ago

    bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools, including...

  • Sr. data engineer-gcp

    7 days ago

    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • Sr. Data Engineer-GCP

    7 days ago

    bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications:● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools● Experience working with Data warehousing tools, including DynamoDB,...

  • Sr. Data Engineer-GCP

    7 days ago

    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • Sr. Data Engineer-GCP

    5 days ago

    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • DevOps - Digital Engineering Sr. Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 299315  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a DevOps - Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Sr data engineer

    4 weeks ago

    Bangalore, India Visa Full time

    Company Description: Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and...

  • Sr Data Engineer

    1 month ago

    Bangalore, India Visa Full time

    Company Description: Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and...

  • Sr Data Engineer

    2 weeks ago

    bangalore, India Visa Full time

    Company Description: Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and...

  • Sr Data Engineer

    1 month ago

    bangalore, India Visa Full time

    Company Description:Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr. Data Engineer

    1 month ago

    bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full timeSkills Required: T-SQL, SSIS, SSRSPreferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark.Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both Structured...

  • Sr. data engineer

    1 month ago

    Bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, py Spark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...

  • Sr. Data Engineer

    1 month ago

    Bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...

  • Sr Data Engineer

    2 weeks ago

    bangalore, India Visa Full time

    Company Description:Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr Data Engineer

    2 weeks ago

    bangalore, India Visa Full time

    Company Description: Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and...

  • Sr Data Engineer

    3 weeks ago

    bangalore, India Visa Full time

    Company Description: Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and...