DEV Community

Mike Young
Mike Young

Posted on • Originally published at aimodels.fyi

AI System Tracks Live Music with Sheet Music in Real-Time

This is a Plain English Papers summary of a research paper called AI System Tracks Live Music with Sheet Music in Real-Time. If you like these kinds of analysis, you should join AImodels.fyi or follow us on Twitter.

Overview

  • Novel approach to score following using Gaussian Process regression
  • Maps live musical performance to positions in sheet music
  • Uses two-stage system: note prediction followed by position tracking
  • Works on piano, violin, oboe and flute performances
  • Processes audio in 18ms segments for real-time following
  • First application of Gaussian Processes to score following

Plain English Explanation

Score following is like having a smart assistant that listens to someone playing music and follows along with the sheet music in real-time. Think of it as a GPS for music - it tracks where ...

Click here to read the full summary of this paper

Top comments (0)