Data Domain Architect Associate

JOB DESCRIPTION

Join us for an exciting opportunity to leverage your advanced data annotation skills in the financial industry and contribute to cutting-edge machine learning models.

As a Data Domain Architect Associate within the Consumer & Community Banking team, you will conduct ML assisted data labeling to evaluate and train machine learning models. You will apply your technical knowledge and problem-solving skills across multiple applications, supporting data quality and summarization to enable Operations Management to achieve strategic objectives while ensuring compliance with all controls, policies, and procedures.

Job responsibilities

• Build & Annotate banking domain text data for LLM/Gen AI models using various data labeling tools, taxonomy, and guidelines.
• Analyze structured and unstructured text data, identify labels through context and disambiguation, and annotate with the correct label.
• Understand the nuances of language used in the financial industry and stay updated with the business aspects of products.
• Validate business results from a model perspective. Document & impart feedback for model improvement using formulated metrices.
• Document & Conduct retrospective data analyses and contribute to clarifying business definitions and concepts.
• Provide feedback and suggestions for tool improvements to enhance efficiency and accuracy.
• Work closely with stakeholders, including machine learning engineers, data scientists, data engineers, and product managers across Chase's lines of businesses.
• Work on revising prompts, flow descriptions in LLM framework. Analyze, document LLM response and run feedback loop to improve performance.

Required qualifications, capabilities, and skills

• Bachelor's or Master's degree in Linguistic, Engineering, Computer Science, Information Technology, Data Science or related field..
• Three years of hands-on experience working with Conversation data as a data analyst (conversational AI/ NLP), data annotator, or data architect.
• Good understanding of LLM/Gen AI with expertise in text data labeling processes and quality control.
• Analytical and problem-solving skills, along with good project management skills (self-driven, well-organized, ability to meet tight deadlines).
• Experience in Python script, LLM metrics, Hallucination Detection & at least one annotation tool.
• Intermediate experience with Microsoft Office suite.
• Experience in conversational AI/ Chat bots training data needs.

Preferred qualifications, capabilities, and skills

• Strong organizing and documentation skills
• Excellent verbal and written communication skills to clearly present analytical findings and business recommendations to global stakeholders.
• Familiarity or experience with Data Analytics and Visualization.

ABOUT US

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

ABOUT THE TEAM

Our Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We're proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions – all while ranking first in customer satisfaction.

The CCB Data & Analytics team responsibly leverages data across Chase to build competitive advantages for the businesses while providing value and protection for customers. The team encompasses a variety of disciplines from data governance and strategy to reporting, data science and machine learning. We have a strong partnership with Technology, which provides cutting edge data and analytics infrastructure. The team powers Chase with insights to create the best customer and business outcomes.