Data Domain Architect Associate

Join us for an exciting opportunity to leverage youradvanceddata annotation skills in the financial industry and contribute to cutting-edge machine learning models.

As a Data Domain Architect Associate within the Consumer & Community Banking team, you will conductML assisteddatalabeling to evaluate and train machine learning models. You will apply your technical knowledge and problem-solving skills across multiple applications, supporting data quality and summarization to enable Operations Management to achieve strategic objectives while ensuring compliance with all controls, policies, and procedures.

Job responsibilities

• Build & Annotate banking domain text data for LLM/Gen AI models using various data labeling tools, taxonomy, and guidelines.
• Analyze structured and unstructured text data, identify labels through context and disambiguation, and annotate with the correct label.
• Understand the nuances of language used in the financial industry and stay updated with the business aspects of products.
• Validate business results from a model perspective. Document & impart feedback for model improvement using formulated metrices.
• Document & Conduct retrospective data analyses and contribute to clarifying business definitions and concepts.
• Provide feedback and suggestions for tool improvements to enhance efficiency and accuracy.
• Work closely with stakeholders, including machine learning engineers, data scientists, data engineers, and product managers across Chase's lines of businesses.
• Work on revising prompts, flow descriptions in LLM framework. Analyze, document LLM response and run feedback loop to improve performance.

Required qualifications, capabilities, and skills

• Bachelor's or Master's degree in Linguistic, Engineering, Computer Science, Information Technology, Data Science or related field..
• Three years of hands-on experience working with Conversation data as a data analyst (conversational AI/ NLP), data annotator, or data architect.
• Good understanding of LLM/Gen AI with expertise in text data labeling processes and quality control.
• Analytical and problem-solving skills, along with good project management skills (self-driven, well-organized, ability to meet tight deadlines).
• Experience in Python script, LLM metrics, Hallucination Detection & at least one annotation tool

  .

• Intermediate experience with Microsoft Office suite.
• Experience in conversational AI/ Chat bots training data needs.

Preferred qualifications, capabilities, and skills

• Strong organizing and documentation skills
• Excellent verbal and written communication skills to clearly present analytical findings and business recommendations to global stakeholders.
• Familiarity or experience with Data Analytics and Visualization.