Wolfe Styke i Gesture Recognition Remote Control Abstract The Gesture Recognition Remote Control system effectively replaces the functionality of the remote control for a Sony brand television. The user interface for the system is a wand, which the user can wave in one of eight gestures to send a specific command to the television. A color NTSC video camera tracks the movement of the wand while the user is making a gesture, and hardware programmed on the Field Programmable Gate Arrays of a 6.111 Labkit analyzes the video to determine which gesture the wand is making and responds by sending the corresponding infrared signal to the television using the correct bit encoding. The resulting behavior of this design turned out to be easy to use due to the simplistic nature of the gestures.[Type text] Wolfe Styke ii Table of Contents Abstract ............................................................................................................................................ i 1. OVERVIEW ............................................................................................................................... 1 2. DESCRIPTION ........................................................................................................................... 2 2.1 Frame Storage and Retrieval ............................................................................................ 3 2.2 Wand Filter Module ......................................................................................................... 3 2.2.1 Pixel Filters ................................................................................................................ 4 2.2.2 Finding Coordinates .................................................................................................. 5 2.3 Gesture Generator Module .............................................................................................. 7 2.3.1 The Start Button ........................................................................................................ 7 2.3.2 The End Button ......................................................................................................... 7 2.3.3 Testing ....................................................................................................................... 8 2.4 Infrared Signal Generator Module ................................................................................... 8 2.4.1 Gesture to Command ................................................................................................ 8 2.4.2 Debugging the Infrared Signal .................................................................................. 9 2.5 Infrared LED Circuit ........................................................................................................ 10 3. CONCLUSION ......................................................................................................................... 10 4. REFERENCES .......................................................................................................................... 12 5. APPENDICES .......................................................................................................................... 13 5.1 Wand Filter Module ............................................................................................................ 13 5.2 Gesture Generator Module ................................................................................................ 17 5.3 Infrared Signal Generator Module ...................................................................................... 19[Type text] Wolfe Styke iii LIST OF FIGURES FIGURE 1: ABOVE: ONLY RED FILTER APPLIED, NOISY VIDEO. BELOW: RED FILTER AND BAND-PASS INTENSITY FILTER REMOVES EXTRA NOISE. ................................................................................................................. 4 FIGURE 2 : A MAP RELATING THE DIRECTION OF THE GESTURE MADE BY THE USER WITH THE WAND WITH ITS CORRESPONDING COMMAND. ......................................................................................................... 7 FIGURE 3: SONY SIRC SIGNALS USE A PULSE-WIDTH ENCODING. .................................................................... 8 FIGURE 4: THE ENTIRE SIGNAL, WITH ITS THREE PHASES. .............................................................................. 9 FIGURE 5: THE INFRARED LED IN ITS CIRCUIT. .......................................................................................... 10[Type text] Wolfe Styke 1 1. OVERVIEW Remote controls for televisions have become fairly similar in the past years. The user presses a button on the remote which results in circuitry inside the remote changing the button press into a waveform which is fed to an infrared LED. This signal propagates throughout the room and the television receives and decodes the infrared signal into a simple command. My project aims to redesign the way television viewers interact with their TV sets, by changing the basic method of command generation from button pressing to gesturing with an LED wand device. The Gesture Recognition Remote Control functions like a cross between a Wiimote and a conventional remote control. Its purpose is to combine both the functionality of a remote control and the movement recognition of the Wiimote into one device. This combination allows the user to make gestures by waving a red LED wand in one of eight gestures to generate commands such as change volume or channel, mute or power on/off within the receiving device which are sent through the device’s infrared LED to the television. The receiving device consists of a video camera to capture the red LED’s movements, a field-programmable gate array (FPGA) programmed to turn the video feed into a command waveform, and an infrared LED to turn this waveform into a signal that can be received by the TV. For televisions with multiple potential users, this allows for those who prefer to use this device over a conventional remote to be able to use it without preventing others from being able to use a conventional remote. The design of the Gesture Recognition Remote Control system makes some assumptions about the space where it will be used. The first and most important assumption is that the general area around which the user will be using the red LED wand will be free of other red colors of the same intensity as the LED. This means
View Full Document
Unlocking...