Sr Data Engineer

2 months ago

Bengaluru, India Visa Full time

Company Description:

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa


Job Description:

Role: Sr Data Engineer

Location: Bangalore (Hybrid: 2-3 set days a week)


As a Senior Data Engineer, you'll join our Value-Added Services – Digital Marketing & Engagement organization. You will help design, enhance, and build our data infrastructure and pipelines within an agile development environment, collaborating with colleagues who will support and challenge you daily.

Key Responsibilities:

  • Design, develop, and maintain robust and scalable data pipelines and ETL processes.
  • Ensure data services are highly available, secure, scalable, and resilient.
  • Drive innovation to differentiate our data products and accelerate time-to-market delivery.
  • Utilize containerization technologies such as Docker and Kubernetes, and expertise in Java/Python, and both relational and non-relational databases.
  • Apply your data engineering skills with Hadoop/ Spark and Scala.
  • Represent the team in various technical forums and build deep partnerships with product management.
  • Analyze business requirements to architect highly secure, robust, and scalable data solutions.
  • Lead internal proof of concept initiatives and quickly design and implement prototypes.
  • Champion efforts to design and implement components of our global data processing systems.
  • Follow and create software best practices and processes.
  • Mentor team members and create an atmosphere of mutual accountability.
  • Play a key role in meetings and discussions with cross-functional and non-technical teams.


Qualifications:

Basic Qualifications:

3+ years of relevant work experience with a Bachelor’s degree or at least 2 years of experience with an Advanced Degree (e.g., Master's, MBA, JD, MD) or 1 year of work experience with a PhD.


Preferred Qualifications:

  • 4+ years of relevant work experience with a Bachelor's Degree or 3+ years with an Advanced Degree or 2+ years with a PhD.
  • Demonstrated leadership in delivering high-quality, large-scale, enterprise-class data applications.
  • Solid experience in big data engineering, with knowledge of Hadoop, Apache Spark, Python, and SQL.
  • Expertise in Java, REST APIs, and container-based technologies (Docker, Kubernetes).
  • Proficiency in creating and managing large-scale data pipelines and ETL processes.
  • Experience developing and maintaining Spark pipelines and productizing AI/ML models.
  • Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services.
  • Skilled in Unix/Shell or Python scripting and scheduling tools like Airflow and Control-M.
  • Strong experience with data storage technologies and databases (e.g., MySQL, PostgreSQL, MongoDB).
  • Familiarity with Agile development, TDD, CI/CD, and various data warehousing solutions.
  • Proven track record of building reliable, scalable, and operable data applications.
  • Ability to manage component security analysis and collaborate with security teams.
  • Strong work ethic, focus on immediate goals, and proven experience as a technical leader.
  • Passion for mentoring and helping juniors grow professionally.
  • Excellent communication and interpersonal skills, and a strong team player.


Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

  • Sr. Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302055 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Build data...

  • Sr. Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 302055 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Build data pipelines to...

  • Sr Data Engineer

    1 month ago

    Bengaluru, India Almighty HRD Consultants Full time

    Job OverviewWe are seeking a highly skilled and experienced Sr Data Engineer for our client located in Bangalore. As a Sr Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure and systems. You will collaborate with cross-functional teams to ensure the availability, integrity, and accessibility of our data...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 295146 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 295146 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Digital Engineering Sr. Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 299332 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).How We...

  • Sr. data engineer-gcp

    4 weeks ago

    Bengaluru, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications:● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools● Experience working with Data warehousing tools, including Dynamo...

  • Sr. Data Engineer-GCP

    4 weeks ago

    Bengaluru, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications:● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools● Experience working with Data warehousing tools, including DynamoDB,...

  • Hevo Data

    1 month ago

    Bengaluru, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Sr. Data Engineer-GCP

    4 weeks ago

    Bengaluru, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools, including...

  • Sr. Data Engineer-GCP

    4 weeks ago

    Bengaluru, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools, including...

  • Sr. Data Engineer-GCP

    4 weeks ago

    Bengaluru, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • Digital Engineering Sr. Engineer

    1 month ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 299332 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).How We Will Help...

  • Sr Data Engineer

    1 month ago

    Bengaluru, India Visa Full time

    Company Description:Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr Data Engineer

    6 months ago

    Bengaluru, India Syniverse Full time

    Syniverse is the world’s most connected company. Whether we’re developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world’s most recognized brands. Eight...

  • Sr. Data Engineer

    1 month ago

    Bengaluru, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/LeadJob Location: Bangalore, Mysore, CoimbatoreFull timeSkills Required: T-SQL, SSIS, SSRSPreferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark.Job Description:6+Years Handson experience in Design, Develop, Deploy and MonitorData Extraction Pipelines in Python to process both Structured (SQL)...

  • Senior SAP Data Migration Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:-Sr Syniti ADM Consultant:As a highly experienced SAP Data Migration Consultant, you will lead the execution of data migration projects from SAP ECC to SAP S4/HANA, utilizing your expertise in data cleansing, profiling, and harmonization. Your proficiency in project planning, cutover planning, and gathering business requirements is essential...

  • Sr Data Engineer

    2 months ago

    Bengaluru, India Visa Full time

    Company Description:Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr. Data Engineer

    2 months ago

    Bengaluru, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full timeSkills Required: T-SQL, SSIS, SSRSPreferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark.Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both Structured...

  • Sr. Data Engineer

    2 months ago

    Bengaluru, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full timeSkills Required: T-SQL, SSIS, SSRSPreferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark.Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both Structured...