March 9, 2006.
Music 209 : Calendar : Week 8Techniques for synthesizing audio from score notation or guide audio.
We began the lecture with a description of Vocalign, a plug-in for aligning audio recorded on location during a movie shoot with audio re-recorded in a studio environment. An informative review of Vocalign is available here. More information is available on the company website.
We then showed how one might implement Vocalign using dynamic time warping. We also showed how the Viterbi algorithm (the main algorithm behind dynamic time warping) could be used for score alignment and for concatenative synthesis. This material was based on Chapters 6, 16, and 17 of Diemo Schwarz's thesis (available here).