Illustrating motion through DLP Photography Sanjeev J Koppal and Srinivasa G Narasimhan Carnegie Mellon University Strobe photography Densmore Shute Bends the Shaft Harold Edgerton 1938 Today Strobe kit Splash Dancer Hammer Incense High frequency illumination Strobe intensity 1 1 f time 0 Strobe S f Scene Camera exposure 1 time Camera 0 0 T 1 Image Maximum number of scene copies Tf Selecting the strobe light Digital light processing Strobe S f DLP projector Camera LEDs Scene DLP projector DLP projector as a strobe light image 60Hz projector Strobe signal computer camera scene Maximum number of scene copies 60 T Can we get more copies Inside a DLP projector mirror state image 60Hz DMD controller 9600Hz time projector micro mirrors scene computer camera The DMD effect Intensity mosaic input to projector Video captured at 3000 Hz Inside a DLP projector mirror state image 60Hz DMD controller 9600Hz time micro mirrors scene computer camera Inside a DLP projector mirror state DMD image 60Hz DMD controller 9600Hz time Colorwheel Controller 125Hz colorwheel scene computer camera Inside a DLP projector colorwheel state DMD image 60Hz time DMD controller 9600Hz Colorwheel Controller 125Hz colorwheel scene computer camera The DMD colorwheel effect Intensity mosaic input to projector Intensity mosaic input to two projectors Video captured at 3000 Hz Video captured at 250 Hz DLP photography Slingshot at 250Hz DLP photography Colorwheel strobing Slingshot at 1Hz DLP photography DMD strobing Slingshot at 1Hz DLP projectors in vision and graphics Programmable imaging Nayar et al 04 Stereoscopic display Jones et al 2007 Imperceptible display Raskar et al 98 Colorwheel in Displays Scanning Cotting et al 2004 Ogata et al 05 Packer et al 01 Mori et al 1999 Removing colorwheel Chen and Wada 05 Lee at al 05 What can we do with DLP photographs Summaries through Shape time photography Related methods Photomontage Agarwala et al 2004 Video surrealism Raskar et al 2005 Storyboarding Goldman et al 2006 Dynamosaics Rav Acha et al 2005 Freeman and Zhang 2003 What can we do with DLP photographs Summaries through Shape time photography Related methods Photomontage Agarwala et al 2004 Video surrealism Raskar et al 2005 Storyboarding Goldman et al 2006 Dynamosaics Rav Acha et al 2005 Freeman and Zhang 2003 Motion illusions from single images Related methods Motion without movement Flutter shutter Motion magnification Blur identification Deblurring methods Freeman et al 1991 Raskar et al 2006 Liu et al 2005 You and Kaveh 1996 Blurred Image What can we do with DLP photographs Summaries through Shape time photography Related methods Photomontage Agarwala et al 2004 Video surrealism Raskar et al 2005 Storyboarding Goldman et al 2006 Dynamosaics Rav Acha et al 2005 Freeman and Zhang 2003 Motion illusions from single images Related methods Motion without movement Flutter shutter Motion magnification Blur identification Deblurring methods Freeman et al 1991 Raskar et al 2006 Liu et al 2005 You and Kaveh 1996 Static component Blurred component What can we do with DLP photographs Summaries through Shape time photography Related methods Photomontage Agarwala et al 2004 Video surrealism Raskar et al 2005 Storyboarding Goldman et al 2006 Dynamosaics Rav Acha et al 2005 Freeman and Zhang 2003 Motion illusions from single images Related methods Motion without movement Flutter shutter Motion magnification Blur identification Deblurring methods Freeman et al 1991 Raskar et al 2006 Liu et al 2005 You and Kaveh 1996 Flip between these High speed scenes 125Hz Slingshot under fluorescent light 1000Hz No motion blur Shape time photography time 1000Hz No motion blur Summary image Shape time photography High frequency pattern Summary image Lower frame rate 250Hz Motion blur Shape time photography time 250Hz Motion blur Summary image Comparison under fluorescent lighting 1000Hz with no motion blur 250Hz with motion blur Lower frame rate under DLP illumination 250Hz High frequency blur Single frame with object copies 250Hz High frequency blur Summary 250Hz High frequency blur DLP vs Fluorescent 250Hz with motion blur 250Hz with no motion blur DLP allows capture at lower frame rate 1000Hz with no motion blur 250Hz with no motion blur Slingshot in action 250Hz Strobing in single frames Impact Ricochet Backlash Full event 10000Hz air balloon burst 3000Hz under fluorescent 3000Hz under a single DLP 500Hz with three DLP projectors Illustrating motion Illustrating motion Real time scenes 125Hz Color wheel effect Water balloon Start Water balloon First try Water balloon Second try Ballet video DLP photographs Motion summary Segmenting motion blur Original Blur strobed component Static component Motion illustration video Tabla player Motion summary Exploiting RGB channels Higher frame rate grayscale video Overview Strobing in DLP projectors Illustration and summary Ballet Balloon Tabla Slingshot Future work Programmable strobe light Pattern at 10000Hz Frame 1 Frame 50 Mask wheel with Pete Barnum Multi spectral flash Exploiting RGB Multi spectral camera Artist Acknowledgements Julia Erickson Asish Sinha