Artificial Intelligence Research Engineer

About TalentGumTalentGum is transforming extracurricular learning for children aged 5–14 years through engaging live online courses in music, dance, chess, and public speaking etc.Our mission is to build the next generation of learning intelligence — an AI-driven platform that can observe, understand, and help children improve their creative and cognitive skills through personalized, real-time insights.We are looking for AI Research Engineers who are passionate about bridging human creativity and machine intelligence, and want to work at the intersection of AI, performance, and education.Role OverviewAs an AI Research Engineer, you’ll design and develop machine learning systems that can understand and evaluate human performance — starting with sound (music, speech) and later expanding to vision (movement, gestures).You’ll collaborate with Audio/Vision Engineers, Backend Developers, and Subject Matter Experts (SMEs) such as musicians, dancers, and coaches to convert expert intuition into measurable, scalable AI feedback.Key Responsibilities• Research, design, and train AI models for real-time performance evaluation across domains (music first, then dance/speech/chess).• Implement and optimize deep learning architectures for audio and/or visual understanding (CNNs, RNNs, Transformers).• Work closely with Audio/Vision Engineers to build data pipelines for clean, real-time feature extraction (spectrograms, keypoints, pose sequences).• Collaborate with SMEs to define “performance quality” metrics and label datasets.• Develop evaluation frameworks to quantify model accuracy vs. expert feedback.• Experiment with cross-modal fusion (audio + vision) for synchronized analysis in future domains like dance.• Optimize models for low-latency inference on web/mobile devices (ONNX, TensorRT, TF Lite).• Document research findings, prototype outcomes, and contribute to internal knowledge-sharing.Required Skills & Experience• 3+ years of hands-on experience in Machine Learning / Deep Learning (PyTorch, TensorFlow).• Strong mathematical foundation in signal processing, time-series analysis, and statistics.• Proven experience with audio or visual data — music, speech, motion, or similar perceptual domains.• Familiarity with MIR (Music Information Retrieval) or Computer Vision tasks like:o Pitch detection, beat tracking, timbre classification, speech analysis,o Pose estimation, gesture recognition, or motion tracking.• Experience with model optimization and deployment (TorchScript, ONNX, TensorRT).• Strong Python skills and familiarity with libraries such as NumPy, pandas, Librosa, Essentia, OpenCV, or MediaPipe.Nice to Have• Research or published work in audio AI, multimodal AI, or performance evaluation.• Experience building or experimenting with real-time ML inference systems.• Background in music, performing arts, or educational AI.• Familiarity with cloud platforms (AWS, GCP) and CI/CD for ML (MLflow, DVC).• Curiosity and creativity in experimenting with human-centered AI.What You’ll Achieve• Shape the foundation of TalentGum’s AI Learning Intelligence Platform.• Transform expert musical and artistic insights into measurable, adaptive AI systems.• Build models that listen, see, and guide young learners around the world.• Contribute to a system that evolves across music, dance, public speaking, and chess.Why Join Us• Work at the intersection of AI, art, and education.• Collaborate with passionate technologists and subject matter experts.• Creative freedom to explore cutting-edge models in audio and vision AI.• Build something with direct impact — helping children discover their best selves.• Competitive compensation, equity options, and global career visibility.