This preview shows page 1-2-3-4-5-6-7-8-9-10-11-12-86-87-88-89-90-91-92-93-94-95-96-97-98-174-175-176-177-178-179-180-181-182-183-184-185 out of 185 pages.
Phantom Sight ReaderAbstractPhantom Sight Reader converts sheet music to audio output. It captures an image of the sheet music from an external camera, detects the notes, and finally synthesizes the audio. It is comprised of three components: image capture and video display, note recognition, and audio generation. Image capture involves interfacing the external camera with the FPGA and capturing a still image to memory. The video display is the user interface that allows the user to interact with the Phantom Sight Reader by telling it to play notes or allowing selection of different instruments. Note recognition involves determining the location of the staff and then identifying whole notes, half notes, and quarter notes along with their position on the treble clef in one octave. Audio synthesis entails generating and combining sinusoidal tones so that they emulate the sound of real instruments. The final goal of this project was to read sheet music and produce instrument sounds corresponding to the notes.Lance CollinsJing HanDilini WarnakulasuriyarachcDecember 10, 2008Table of Contentspageâ—Ź Project Overview .................................................................................................................06â—Ź Video Display Unit...............................................................................................................07â—‹ Module Descriptions......................................................................................................08â– NTSC Decoder Block & Filter.................................................................................08â– Orientation Box........................................................................................................09â– Frequency Display Box............................................................................................09â– Underline..................................................................................................................09â– Mouse Pointer..........................................................................................................10â– PLAY, PAUSE, and STOP Buttons.........................................................................10â– Instrument Selector Buttons.....................................................................................11â– Volume Control Slider.............................................................................................11â—‹ Testing and Debugging: Video Display.........................................................................12â—‹ Further Enhancements: Video Display..........................................................................13â—Ź Overview: Note Decoder......................................................................................................14â—‹ Detailed Description of Note Decoder...........................................................................15â– The BRAM filter module.........................................................................................16â– The Staff Finder module..........................................................................................17â– The Staff Display module........................................................................................18â– The Note Finder module..........................................................................................18â– Scan Local Module...................................................................................................19â– The Count Space module.........................................................................................20â– Find Note State.........................................................................................................20â– Beat Finder Module..................................................................................................21â– The Minor FSM module...........................................................................................222pageâ– BRAM Decision module..........................................................................................22â– Note BRAM module................................................................................................24â—‹ Testing & Debugging: Note Decoder.............................................................................25â—‹ Further Enhancements: Note Decoder...........................................................................27â—Ź Audio Generator...................................................................................................................28â—‹ Overview and Background.............................................................................................29â– Audio Synthesis........................................................................................................29â—Ź AC97..................................................................................................................29â—Ź Sine Wave Generation........................................................................................29â—Ź Amplitude Modulation.......................................................................................30â—‹ Detailed Description: Audio Generator..........................................................................31â– Audio Synthesizer....................................................................................................31â– Tone Selector............................................................................................................31â– Sine Wave Generation..............................................................................................31â—Ź Tone Parameters.................................................................................................31â—Ź Theta Memory....................................................................................................32â—Ź Sine Calculator...................................................................................................32â– Timbre......................................................................................................................32â—Ź Timbre Transformer...........................................................................................32â—Ź Instrument Generator..........................................................................................32â—Ź Harmonic
View Full Document
Unlocking...