DOC PREVIEW
MIT 6 111 - Finger Art

This preview shows page 1-2-3-4-5-6 out of 18 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 18 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

FingerArtGrace Li & Sean LiuOverview• Artists draw on blank 800 by 600 screen• Camera recognizes gestures• System translates to virtual brush and paintModules• Gesture DetectionIdentifies the location of the user’s hands, velocity, and intention. TV data adv7185 Video input decoder ZBT (debug only) Video Capture ZBT addr, data Filter 4 pixel 10 ypos 10 pixel 4 xpos Center of mass calculation Velocity Calculator (Squared distance calculator) Intention x1 y1 x2 y2 distance^2 absorb color • Paint GenesisTranslates the position and speed of user’s hands to paint.10 10 10 10 22 15 Brush Generator Painter Display Saturation Color Gen ZBT sel_sat 3 color 15 centers Pixel_color 15 10 2Gesture Detection• Video capture• Center of mass calculation• Velocity calculation• Intention detection TV data adv7185 Video input decoder ZBT (debug only) Video Capture ZBT addr, data Filter 4 pixel 10 ypos 10 pixel 4 xpos Center of mass calculation Velocity Calculator (Squared distance calculator) Intention x1 y1 x2 y2 10 10 10 10 22 distance^2 absorb 15 color 2Gesture Detection Video Capture• Obtain data from camera• Filter to accept/reject pixels based on threshold•Write to ZBT (debug only) TV data adv7185 Video input decoder Video Capture Filter 4 pixel 10 ypos 10 pixel 4 xpos •Write to ZBT (debug only)ZBT (debug only) ZBT addr, data 4 4Gesture Detection Center of Mass• Calculates the left and right centers of mass• Saves two centers of mass clusters• For each pixel input, if distance is < threshold, updates center of mass. If distance is > threshold, counts as second 10 ypos 10 pixel 4 xpos Center of mass calculation x1 y1 x2 y2 of mass. If distance is > threshold, counts as second center of mass or discards• Keeps track of the last 8 centers of mass and outputs the average10 10 10 10Gesture Detection Velocity Calculation• Averages the two centers of mass• Stores last 32 averages• Keeps a total distance•For each new average x1 Velocity Calculator (Squared distance calculator) •For each new average center of mass, subtracts off the squared distance from the oldest two points and adds distance from newest pointsy1 x2 y2 10 10 10 10 22 distance^2Gesture Detection Intention Detection• Determines if the user is trying to pick up paint from the palette or trying to paint•Looks at the left center of mass x1 Intention •Looks at the left center of mass• If the user is picking up paint, intention generator also outputs colorx1 y1 10 10 absorb 15 color 2Paint Genesis Brush Generator 100 y1 x2 y2 10 10 10 22 distance^2 enable 15 color centers x1 10 Saturation Color Gen sel_sat 3 2 color, saturation 15, 3 enable Painter Display ZBT pixel_color 15 100 centers pixel_color 15 2 pixel_color 15Paint Genesis Saturation Module• Keeps track of whether the saturation is increasing or decreasing• Interacts with Intention & ColorGen modulesColorGen modules• Counts the number of absorb or paint signals at 65mHz• sel_saturation is either -1 or +1Paint Genesis Color Generator• Remembers and modifies the current color on the paintbrush• Keeps internal state of color and saturation• color = a * curr_color + (1 – a) * sel_color•saturation = curr_saturation + sel_saturation •saturation = curr_saturation + sel_saturationPaint Genesis Brush Generator• Takes the (x, y) coordinates & velocity• Makes three equidistant, intermediate points• Total of 5 (x, y) points to use as centers of blobscenters of blobsPaint Genesis Painting Brush Generator y1 x2 y2 10 10 10 22 distance^2 absorb 15 color x1 10 Saturation Color Gen sel_sat 3 2 color, saturation 15, 3 absorb Painter Display ZBT pixel_color 15 100 centers pixel_color 15 2 pixel_color 15Paint Genesis Painter module• Gets color information for pixel• Determines whether the color changes• Weights previous and paintbrush colors• Creates new color• Writes new color into ZBT• 5 clock cyclesPaint Genesis Picture ZBT• Stores pixels of the picture, RGB value = 18 bits• Clocked at 80MHz• Interact with Painter & Display modulesDisplay modules• Painter writes current, reads 5 pixels ahead• Display reads current pixel to displayPaint Genesis Display• Shows picture and positions of LEDs• Displays a new frame at 60Hz• Fetches color information for at 40MHzScheduleFilter & Center of massVelocity & intentionIntegrationZBT & PainterSaturation & Brush Generator & Color Generator & DisplayVelocity & intentionIntegrationIntegrationExpansionExpansionExpansionExpansionExpansions• Intention detection– Circular motions to absorb color– Blinking LED•Paint genesis•Paint genesis– Additional brush options– Fading of paint• Game– User attempts to match system


View Full Document

MIT 6 111 - Finger Art

Documents in this Course
Verilog

Verilog

21 pages

Video

Video

28 pages

Bass Hero

Bass Hero

17 pages

Deep 3D

Deep 3D

12 pages

SERPENT

SERPENT

8 pages

Vertex

Vertex

92 pages

Vertex

Vertex

4 pages

Snapshot

Snapshot

15 pages

Memories

Memories

42 pages

Deep3D

Deep3D

60 pages

Design

Design

2 pages

Frogger

Frogger

11 pages

SkiFree

SkiFree

81 pages

Vertex

Vertex

10 pages

EXPRESS

EXPRESS

2 pages

Labyrinth

Labyrinth

81 pages

Load more
Download Finger Art
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Finger Art and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Finger Art 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?