AIM: Artificial Intelligence in Music

Using Artificial Intelligence to Transform Music Performers' training and practice. This project will investigate how AI technology could transform the work of future music performers for both individual practice and collaborative practice.



This project will develop and integrate techniques to create two AI-enabled tools to support string music performers. The first tool, the Evaluator, aims to improve individual practice and performance. It analyzes a musician’s sound and compares it to digitized music scores to detect deviations in intonation, rhythm, and dynamics and suggest better posture based on sample performers’ recording with correct posture. The second tool, the Companion, plays the part of one or several instruments to replace absent musicians with matching tempo, and style of the human musicians through audio analysis of their performance while also responding in real-time to verbal instructions.


Relevant Technologies:

  • Computer Vision
  • Natural Language Processing
  • Audio Analysis
  • Machine Learning

Pre-requisite knowledge/skills:

  • Computer Programming

Meeting time:

  • Fall 2023: Thursday, 10:00 - 10:50 am