Illustrating motion through DLP PhotographyStrobe photographyTodaySlide 5High-frequency illuminationSelecting the strobe-lightDLP projector as a strobe-lightInside a DLP projectorThe DMD effectSlide 11Slide 12Slide 13The DMD-colorwheel effectDLP photographySlide 16Slide 17DLP projectors in vision and graphicsWhat can we do with DLP photographs?Slide 20Slide 21Slide 22High-speed scenes (>> 125Hz)Slingshot under fluorescent lightShape-time photographySlide 26Lower frame rateSlide 28Comparison under fluorescent lightingLower frame-rate under DLP illuminationSingle frame with object copiesSummaryDLP vs. FluorescentDLP allows capture at lower frame rateSlingshot in actionSlide 38Slide 4010000Hz air balloon burstIllustrating motionSlide 43Real-time scenes (~ 125Hz) Color-wheel effectWater balloon: StartWater balloon: First tryWater balloon: Second tryBallet videoSlide 49Slide 50Slide 51Slide 52Tabla playerMotion summaryExploiting RGB channelsHigher frame-rate grayscale videoOverviewFuture workArtist AcknowledgementsIllustrating motion through DLP PhotographySanjeev J. Koppal and Srinivasa G. NarasimhanCarnegie Mellon UniversityDensmore Shute Bends the Shaft(Harold Edgerton, 1938)Strobe photographyTodayStrobe kitSplash DancerHammer IncenseHigh-frequency illuminationSceneCameraStrobe S(f)01Strobe intensity1ftime0 T = 1Camera exposuretime01ImageMaximum number of scene copies = TfSceneCameraStrobe S(f)Selecting the strobe-lightLEDs DLP projectorDigital light processing (DLP) projectorDLP projector as a strobe-lightprojectorcameracomputerimage (60Hz)StrobesignalsceneMaximum number of scene copies = 60 TCan we get more copies?image (60Hz)DMD controller(9600Hz)micro-mirrorsInside a DLP projectorprojectortimemirror statescenecomputercameraThe DMD effectIntensity mosaic input to projector Video captured at 3000 Hzimage (60Hz)DMD controller(9600Hz)micro-mirrorsInside a DLP projectortimemirror statecomputercamerascenecomputerimage (60Hz)DMD controller(9600Hz)DMDInside a DLP projectorcameratimemirror statecolorwheelColorwheelController(125Hz)scenetimecolorwheel statecomputerimage (60Hz)DMD controller(9600Hz)DMDInside a DLP projectorcameracolorwheelColorwheelController(125Hz)sceneThe DMD-colorwheel effectIntensity mosaic input to projector Video captured at 3000 HzIntensity mosaic input to two projectorsVideo captured at 250 HzDLP photographySlingshot at 250HzDLP photographySlingshot at 1HzColorwheel strobingDLP photographySlingshot at 1HzDMD strobingDLP projectors in vision and graphicsImperceptible display [Raskar et al 98] Scanning [Cotting et al, 2004]Programmable imaging [Nayar et al 04]Stereoscopic display [Jones et al, 2007]Colorwheel in Displays ([Ogata et al, 05], [Packer et al, 01], [Mori et al. 1999] …)Removing colorwheel ([Chen and Wada, 05], [Lee at al 05])What can we do with DLP photographs?•Summaries through Shape-time photography Related methods: Photomontage [Agarwala et al 2004] Video surrealism [Raskar et al 2005] Storyboarding [Goldman et al 2006] Dynamosaics [Rav-Acha et al 2005] Freeman and Zhang, 2003What can we do with DLP photographs?•Summaries through Shape-time photography Related methods: Photomontage [Agarwala et al 2004] Video surrealism [Raskar et al 2005] Storyboarding [Goldman et al 2006] Dynamosaics [Rav-Acha et al 2005]•Motion illusions from single images Related methods: Motion without movement [Freeman et al, 1991] Flutter shutter [Raskar et al, 2006] Motion magnification [Liu et al 2005] Blur identification [You and Kaveh 1996] Deblurring methods […] Freeman and Zhang, 2003 Blurred ImageWhat can we do with DLP photographs?•Summaries through Shape-time photography Related methods: Photomontage [Agarwala et al 2004] Video surrealism [Raskar et al 2005] Storyboarding [Goldman et al 2006] Dynamosaics [Rav-Acha et al 2005]•Motion illusions from single images Related methods: Motion without movement [Freeman et al, 1991] Flutter shutter [Raskar et al, 2006] Motion magnification [Liu et al 2005] Blur identification [You and Kaveh 1996] Deblurring methods […] Static componentFreeman and Zhang, 2003 Blurred componentWhat can we do with DLP photographs?•Summaries through Shape-time photography Related methods: Photomontage [Agarwala et al 2004] Video surrealism [Raskar et al 2005] Storyboarding [Goldman et al 2006] Dynamosaics [Rav-Acha et al 2005]•Motion illusions from single images Related methods: Motion without movement [Freeman et al, 1991] Flutter shutter [Raskar et al, 2006] Motion magnification [Liu et al 2005] Blur identification [You and Kaveh 1996] Deblurring methods […] Freeman and Zhang, 2003 Flip between theseHigh-speed scenes (>> 125Hz)Slingshot under fluorescent light1000Hz : No motion blurShape-time photography1000Hz : No motion blur…timeSummary imageShape-time photographySummary imageHigh-frequencypatternLower frame rate250Hz : Motion blurShape-time photography250Hz : Motion blur…timeSummary imageComparison under fluorescent lighting250Hz with motion blur1000Hz with no motion blurLower frame-rate under DLP illumination250Hz: High frequency blurSingle frame with object copies250Hz: High frequency blurSummary250Hz: High frequency blurDLP vs. Fluorescent 250Hz with no motion blur250Hz with motion blurDLP allows capture at lower frame rate1000Hz with no motion blur250Hz with no motion blurSlingshot in action250HzStrobing in single framesImpactRicochetBacklash Full event10000Hz air balloon burst3000Hz under fluorescent3000Hz under a single DLP500Hz with three DLP projectorsIllustrating motionIllustrating motionReal-time scenes (~ 125Hz)Color-wheel effectWater balloon: StartWater balloon: First tryWater balloon: Second tryBallet videoDLP photographsMotion summarySegmenting motion blurOriginalBlur/strobed componentStatic componentMotion illustration videoTabla playerMotion summaryExploiting RGB channelsHigher frame-rate grayscale videoOverview•Strobing in DLP projectors •Illustration and summary BalletBalloonTabla SlingshotFuture work•Programmable strobe-light•Multi-spectral flashPattern at10000HzFrame 1Frame 50Mask-wheel(with Pete Barnum)Exploiting RGBMulti-spectral cameraArtist AcknowledgementsJulia Erickson Asish