VisionComputer vision class, fast-forwardImages and image formationCameras, lenses, and sensorsRadiometryLow-level visionImage filteringNon-linear filtering, and applicationsModels of textureShape from shadingBayesian framework for visionEdge detection and optical flowEdge detection and optical flowLearning and visionSupport vector machines and boostingSupport vector machines and boostingApplicationsComputer vision applicationsas ocean-going vesselsGame: DecathleteOptical-flow-based Decathlete figure motion analysisDecathlete 100m hurdlesDecathlete javelin throwDecathlete javelin throwvideoNintendo Game Boy CameravideoThe course, in broad categorieshttp://www.ai.mit.edu/courses/6.801/Vision• What does it mean, to see? “to know what is where by looking”.• How to discover from images what is present in the world, where things are, what actions are taking place.from Marr, 1982Computer vision class, fast-forwardImages and image formationCameras, lenses, and sensors•Pinhole cameras•Lenses•Projection models•Geometric camera parametersFrom Computer Vision, Forsyth and Ponce, Prentice-Hall, 2002.RadiometryWolfgang Luchthttp://geography.bu.edu/brdf/brdfexpl.htmlFrom Foundations of Vision, by Brian Wandell, Sinauer Assoc., 1995ColorLow-level visionImage filtering• Review of linear systems, convolution• Bandpass filter-based image representations• Probabilistic models for imagesImageOriented, multi-scale representationviewer television displayIEEE Computer Graphics and Applications, 18, no. 3, 1998templateimage Normalized correlationNon-linear filtering, and applicationsModels of textureNon-parametric modelA. Efros and W. T Freeman, Image quilting for texture synthesis and transfer, SIGGRAPH 2001A Parametric Texture Model based on Joint Statistics of Complex Wavelet Coefficients J. Portilla and E. Simoncelli, International Journal of Computer Vision 40(1): 49-71, October 2000.© Kluwer Academic Publishers. Parametric modelShape from shadingShape from shading, Horn and Brooks, MIT Press, 1986Bayesian framework for visionGahan Wilson’s Still Weird, Forge, 1994Bayesian framework for visionCoincidental appearance of face profile in rock?http://www.cs.dartmouth.edu/whites/old_man.htmlBayesian framework for visionCoincidental appearance of faces in rock?http://bensguide.gpo.gov/3-5/symbols/print/mountrushmore.htmlEdge detection and optical flowM. Heath, S. Sarkar, T. Sanocki, and K.W. Bowyer, "A Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms" IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 12, December 1997, pp. 1338-1359.Edge detection and optical flowTrue optical flowImagesin "Statistical Theories of the Brain", edited by R. Rao, B. Olshausen, and M. Lewicki, MIT Press, 2001Estimated optical flowLearning and visionStatistical classifiers– MIT Media Lab face localization results.– Applications: database search, human machine interaction, video conferencing.Support vector machines and boostingLarge-margin classifierwww.support-vector.net/nello.htmlSupport vector machines and boosting“The kernel trick”www.support-vector.net/nello.htmlApplications• Computer vision for computer gamesthisapplicationComputer vision applicationsas ocean-going vesselsGame: DecathleteOptical-flow-based Decathlete figure motion analysisDecathlete 100m hurdlesDecathlete javelin throwDecathlete javelin throwvideoNintendo Game Boy Camera• Several million sold (most of any digital camera). Imaging chip is Mitsubishi Electric’s “Artificial Retina” CMOS detector.videoThe course, in broad categories• Images and image formation• Geometry• Low-level vision• High-level vision• Implementations and