Plan for TodayFinal Project IdeasSample Final ProjectsAuto FocusHomeworksSecond Homework: Option ASynthetic aperture videographySecond HW (b): Lightfield PhotographySecond HW (c): Lightfield PhotographyComputational Illumination, Part 2PollMeasuring LightWhat do we see?What do we see?The Plenoptic FunctionGrayscale snapshotColor snapshotA movieHolographic movieThe Plenoptic FunctionSampling Plenoptic Function (top view)RayRayLumigraph/Lightfield - Organization Reducing GlareEnhancing GlareConventional versus plenoptic cameraConventional versus plenoptic cameraPrototype camera Example of digital refocusingAdaptive OpticsShack Hartmann wavefront sensor (commonly used in Adaptive optics).Measuring shape of wavefront = Lightfield CaptureDoF Depends on apertureDepends on focusing distanceDepends on focal length Scheimpflug principleHow do we see the world?Material not coveredAnti-Paparazzi Flash Auto FocusLens = Pin-holes + PrismsSub-Aperture = Pin-hole + PrismIves 1930Lenslet-based Light Field cameraLight FieldsCoded Aperture CameraModeling and Synthesis of Aperture Effects in CamerasLens Glare Reduction [Raskar, Agrawal, Wilson, Veeraraghavan SIGGRAPH 2008]Reducing GlareEnhancing GlareGlare due to Lens Inter-ReflectionsEffects of Glare on ImageKey IdeaReducing Glare using a Light Field CameraKey IdeaLight FieldsLight Field ApplicationsMIT Media LabMIT Media LabCamera CultureCamera CultureRamesh RaskarRamesh RaskarMIT Media LabMIT Media Labhttp:// CameraCulture . info/http:// CameraCulture . info/Computational Camera & Photography:Computational Camera & Computational Camera & Photography:Photography:Plan for TodayPlan for Today••Computational IlluminationComputational Illumination••Introduction to LightfieldsIntroduction to Lightfields••Assignment #2: OpticsAssignment #2: Optics––A: Virtual Optical BenchA: Virtual Optical Bench––B: LightfieldsB: Lightfields••Check Wiki for Reading MaterialCheck Wiki for Reading Material––Pl edit, add URLs, figures, comments etcPl edit, add URLs, figures, comments etc••Everyone on compEveryone on comp--cam mailing list?cam mailing list?••Listeners: Pl send a topic you would like to present (15Listeners: Pl send a topic you would like to present (15--20 mins)20 mins)••Youtube videos on camera tutorial (DoF etc)Youtube videos on camera tutorial (DoF etc)http://www.youtube.com/user/MPTutorhttp://www.youtube.com/user/MPTutorFinal Project IdeasFinal Project Ideas••User interaction deviceUser interaction device––Camera basedCamera based––Illumination basedIllumination based––Photodetector or linePhotodetector or line--scan camerascan camera••Capture the invisibleCapture the invisible––Tomography for internalsTomography for internals––Structured light for 3D scanningStructured light for 3D scanning––Fluorescence for transparent materialsFluorescence for transparent materials••Cameras in different EM/other spectrumCameras in different EM/other spectrum––Wifi, audio, magnetic, haptic, capacitiveWifi, audio, magnetic, haptic, capacitive––Visible Thermal IR segmentationVisible Thermal IR segmentation––Thermal IR (emotion detection, motion Thermal IR (emotion detection, motion detector)detector)––Multispectral camera, discriminating (camelMultispectral camera, discriminating (camel--sand)sand)••IlluminationIllumination––MultiMulti--flash with lighfieldflash with lighfield––Schielren photographySchielren photography––Strobing and Colored strobingStrobing and Colored strobing••External nonExternal non--imaging sensorimaging sensor––Camera with gyro movement sensors, find Camera with gyro movement sensors, find identity of useridentity of user––Cameras with GPS and online geoCameras with GPS and online geo--tagged tagged photo collectionsphoto collections––Interaction between two cameras (with Interaction between two cameras (with lasers onlasers on--board)board)••OpticsOptics––LightfieldLightfield––Coded apertureCoded aperture––BioBio--inspired visioninspired vision••TimeTime––TimeTime--lapse photoslapse photos––Motion blurMotion blurSample Final ProjectsSample Final Projects••Schlieren Photography Schlieren Photography ––(Best project award + Prize in 2008)(Best project award + Prize in 2008)••Camera array for Particle Image VelocimetryCamera array for Particle Image Velocimetry••BiDirectional ScreenBiDirectional Screen••Looking Around a Corner (theory)Looking Around a Corner (theory)••Tomography machineTomography machine••....••....Auto FocusAuto Focus••Contrast method compares contrast of images at three depths,Contrast method compares contrast of images at three depths,if in focus, image will have high contrast, else notif in focus, image will have high contrast, else not••Phase methods compares two parts of lens at the sensor plane,Phase methods compares two parts of lens at the sensor plane,if in focus, entire exit pupil sees a uniform color, else notif in focus, entire exit pupil sees a uniform color, else not••--assumes object has diffuse BRDFassumes object has diffuse BRDFHomeworksHomeworks••Submit to class websiteSubmit to class website––Commented Source codeCommented Source code––Input images and output images PLUS intermediate resultsInput images and output images PLUS intermediate results––CREATE a webpage and send me a linkCREATE a webpage and send me a link••Ok to use online softwareOk to use online software––HDRshopHDRshop••Update results on Flickr (group) pageUpdate results on Flickr (group) pageSecond Homework: Option ASecond Homework: Option A••Extending Andrew AdamExtending Andrew Adam’’s Virtual Optical Benchs Virtual Optical Bench••(a) Create new optical bench(a) Create new optical bench––Ability to add new elementsAbility to add new elements••(b) Form images(b) Form images––Integrate light from multiple raysIntegrate light from multiple rays––Show image effects (DoF, LF etc)Show image effects (DoF, LF etc)Courtesy of Andrew Adams. Used with permission.Synthetic aperture videographyVaish, V., et al. "Using Plane + Parallax for Calibrating Dense Camera Arrays." Proceedings of CVPR 2004.Courtesy of IEEE. Used with permission. © 2004 IEEE.Second HW (b): Lightfield PhotographySecond HW (b): Lightfield Photography••Translate camera and take photosTranslate camera and take