Today s plan 6 098 Digital and Computational Photography 6 882 Advanced Computational Photography Introduction of Computational Photography Course facts Camera advice Syllabus History Bill Freeman Fr do Durand MIT EECS What is computational photography Quick demos Convergence of image processing computer vision computer graphics an dphotography Digital photography Simply replaces traditional sensors and recording by digital technology Involves only simple image processing Computational photography More elaborate image manipulation more computation New types of media panorama 3D etc Camera design that take computation into account Computational Photography MIT Tone mapping Defocus Matting Motion magnification Superresolution Tone mapping Defocus Matting One of your assignments With Morgan McGuire Wojciech Matusik Hanspeter Pfister John Spike Hughes Data rich use 3 streams with different focus Before After 1 Super resolution Get a sharp high resolution image from low resolution Important principle Learn from examples Bicubic spline Original 70x70 Altamira Our technique Freeman et al Our technique Freeman et al Motion magnification Today s plan Introduction of Computational Photography Course facts Camera advice Syllabus History Administrivia Grading policy Staff Bill Freeman billf csail mit edu Fr do Durand fredo csail mit edu Ce Liu celiu csail mit edu comp photo staff lists csail mit edu Office hours email for other time Bill Freeman Tuesday 2 30 4pm 32 D476 Fr do Durand Friday 2 30 4pm 32 D426 Ce Liu Wednesday 2 30 4pm 32 D460 Prereq 18 06 6 003 or equivalent level Web page http groups csail mit edu graphics classes CompPhoto06 6 098 Assignments 75 Final project 25 6 882 Assignment 70 With additional questions compared to 6 098 Final project 22 Paper review 8 Read and write a review Siggraph form for a paper from the literature participation Lecture notes will be posted 2 Assignment Textbook Every two week written questions programming Camera Not required but can help Can be borrowed from us Matlab First office hour Tuesday Ce will give an intro Or see Xiaoxu Ma s slides No textbook required Lots of resources on the net Siggraph course notes http www merl com people raskar photo Will post references with lectures http courses csail mit edu 6 869 handouts 6869 20Matlab 20Tutorial ppt Turn in code and results Final project Proposal due with PSet 5 Individual or teams of 2 Questions Introductions Who are you What do you know about photography Why you want to take this class What do you think you will learn What the class is not about Little about art photographers Little about EE sensors A D etc Not much about optics but some cool stuff such as wavefront coding Not how to use Photoshop But how its coolest tools work Not much about 3D imaging Not too much fundamentals of signal processing Not much computational imaging no tomography no radar no microscopy See Berthold Horn s class Not much computer vision computer graphics We avoided overlap with 6 837 and 6 801 6 866 3 What the class is about Skills you will acquire Software aspects of computational photography but a bit of hardware as well lens technology new camera designs Basic tools Linear non linear image processing color Emphasis on applications High dynamic range photography photomontage panoramas foreground extraction inpainting morphing Emphasis on recent research results Implementation of basic tools Color demosaicing Multiscale blending Matting Bilateral filter Gradient reconstruction Panorama stitching Markov Random Field Optical flow General approaches to computational photography Important problems ion computational photography By the end of the class you should be able to make contributions to the state of the art Your final project could lead to a publication Non photo motivation Questions It s about any kind of data Speech motion geometry etc Example Music Motion graphs Poisson mesh editing BTF shop Today s plan Syllabus Introduction of Computational Photography Course facts Camera advice Syllabus History Image formation Color and color perception Demosaicing Image processing and wavelets Applications of wavelets pyramid texture synthesis Matting High Dynamic Range Imaging Bilateral filtering and HDR display Gradient image manipulation Taking great pictures Markov Random Fields Non parametric image synthesis inpainting analogies Tampering detection and higherorder statistics Panoramic imaging Image and video registration Spatial warping operations Motion analysis Temporal sequence re rendering Active flash methods Lens technology Depth and defocus Non photorealistic rendering Future cameras Plenoptic function and light fields Student project presentations 4 Syllabus Syllabus Image formation Image processing and wavelets Applications of wavelets pyramid texture synthesis Color and color perception Demosaicing Syllabus Syllabus High Dynamic Range Imaging Bilateral filtering and HDR display Matting Gradient image manipulation Syllabus Syllabus Taking great pictures Markov Random Fields Non parametric image synthesis inpainting analogies Art Wolfe Ansel Adams 5 Syllabus Syllabus Tampering detection and higher order statistics Panoramic imaging Image and video registration Spatial warping operations Syllabus Syllabus Temporal sequence re rendering Motion analysis Syllabus Syllabus Flash Active flash methods Lens technology Depth and defocus Non photorealistic rendering No flash our result 6 Syllabus Questions Future cameras Plenoptic function and light fields Today s plan Equipment Introduction of Computational Photography Course facts Camera advice Syllabus History Do get an SLR compacts are way too limited Don t worry about brand Don t worry about the body get the cheapest one Worry about lenses Zooms are convenient but quality can be a problem avoid the basic zoom but the one above is usually great Maximum aperture matters the smaller the number the better Get a prime in the 35 85mm range cheap high quality wide aperture 50mm f 1 8 both Canon Nikon Get a tripod Get an external flash if you want to take event pictures And orient towards ceiling Good flash photography is very difficult Count 1k for camera standard zoom 50mm Nikon Canon Tends to be a tad cheaper D50 is a great body D70 is a little better 18 70 55 200 is surprisingly not so bad and super cheap Get the 50mm f 1 8 Rebel XT or 20D 17 85 70 200 f 4 0 amazing lens 50mm f 1 8 100mm f 2 8 macro great also for portraits 7 Other brands Shooting Not as big a