AI Conversation Analyst

About Joveo At Joveo, we're on a mission to transform the job search landscape with the power of AI, automation, and human insight. Our cutting-edge platform enables global organizations to attract, engage, and hire talent more intelligently and efficiently. From smart job ad distribution to real-time decision-making, Joveo is crafting the future of recruitment marketing, creating a fairer and more efficient labor market along the way. If you're passionate about connecting ideas, challenging the status quo, and making scalable impacts, we welcome you to join the team pioneering the next era of AI in the workplace. About the Role We are seeking a highly articulate and perceptive individual to join our team as an AI Conversation Analyst. In this unique role, you will be the primary human user of our AI Interviewer, acting as a candidate in thousands of mock interviews. Your interactions and detailed feedback will be the lifeblood of our product development, directly shaping the future of AI in recruitment. Think of yourself as a specialized data annotator for conversations, providing the critical human perspective needed to train a world-class AI. If you are a phenomenal communicator who is fascinated by language, technology, and human interaction, this is the perfect role for you. What You'll Do: - Conduct High-Volume AI Interviews: Engage in a high volume of mock interviews with our AI system, role-playing as a candidate for various job types, industries, and seniority levels. - Systematic Scenario Testing: Systematically test the AI's performance across a wide range of scenarios, including different candidate personas, communication styles, and response types (e.g., concise, verbose, technical, evasive, nervous, confident). - Provide Granular Feedback: Meticulously document and categorize the AI's performance after each session. You will evaluate conversational flow, question quality, follow-up relevance, tone, and overall user experience. - Identify and Report Issues: Identify, reproduce, and clearly report bugs, inconsistencies, logical fallacies, and areas for improvement in the AI's conversational logic and language understanding. - Annotate Conversational Data: Analyze and label interview transcripts to provide structured data for our machine learning models, highlighting both positive and negative interaction patterns. - Collaborate with Product and Engineering: Work closely with our product and engineering team to translate your qualitative feedback into actionable product improvements and new features. - Refine Testing Protocols: Help create and refine the test plans and evaluation guidelines that will be used to measure the AI's quality and progress over time. What We're Looking For - Exceptional Communication: Native or near-native fluency in English with exceptional verbal and written communication skills. You can articulate complex thoughts clearly, both when speaking to the AI and when writing your feedback. - Meticulous Attention to Detail: You have a keen eye for nuance and can spot subtle inconsistencies in language and logic. - High Empathy and Creativity: The ability to genuinely role-play and embody different candidate personas to test the AI's adaptability. - Resilience and Focus: You are comfortable with performing repetitive tasks while maintaining a high level of engagement and quality in your feedback. - Tech-Savvy: You are comfortable learning and using new software, spreadsheets, and communication tools (e.g., Slack, Jira, or similar). - Analytical Mindset: You possess a natural curiosity and a critical mindset, with the ability to dissect a conversation and identify its strengths and weaknesses. Preferred Qualifications: - Experience in data annotation, data labeling, or Quality Assurance (QA) testing. - Familiarity with HR, recruitment processes, or conducting interviews. - Experience interacting with or testing AI assistants, chatbots, or other conversational AI products. Why Joveo - Impact: Be at the heart of our product development cycle. Your work will directly and immediately impact the quality of our AI. - Unique Role: This isn't a typical QA role. You'll be on the cutting edge of human-AI interaction. - Growth: Gain deep insights into how AI products are built, trained, and refined. - Collaborative Team: Join a passionate and innovative team dedicated to changing the future of work. At Joveo, we unleash state-of-the-art technology and inventive strategies to transform the realm of recruitment, all within a vibrant and inclusive team atmosphere. Be part of something extraordinary— join us in making a true difference. Apply now at www.joveo.com.