15-463 (15-862): Computational PhotographyTodayA bit about mePhD Thesis on Texture and Action SynthesisSome hot-off-the-press stuffThe Story So Far…Depicting Our WorldDepicting Our World: The Middle AgesDepicting Our World: RenaissanceSlide 10Depicting Our World: Toward PerfectionSlide 12Depicting Our World: Perfection!Depicting Our World: Perfection?Depicting Our World: Ongoing QuestSlide 16Enter Computer Graphics...Traditional Computer GraphicsState of the ArtThe richness of our everyday worldBeauty in complexityWhich parts are hard to model?PeopleFaces / HairUrban ScenesNatureIn search of realism…Virtual World vs. the Real WorldVirtual Real WorldProgramming Project 1Programming Project 2Programming Project 3Programming Project 4Programming Project 5Programming Project 6Final ProjectAdministrative StuffGeneral CommentsCameras15-463 (15-862): Computational PhotographyStaff•Prof: Alexei Efros (efros@cs), 4207 NSHWeb Page•http://graphics.cs.cmu.edu/courses/15-463/ Newsgroup:•cmu.cs.class.cs463TodayIntroductionOverview of the courseAdministrative stuffA bit about meAlexei (Alyosha) EfrosRelatively New faculty (RI/CSD)Ph.D 2003, from UC Berkeley (signed by Arnie!)Research Fellow, University of Oxford, ’03-’04TeachingMy second time… still learningThe plan is to have fun and learn cool things, both you and me!Social warning: I don’t see well ResearchGraphics, Vision, Machine LearningPhD Thesis on Texture and Action SynthesisAntonio’s son cannot walk but he can flySmart Erase button in MS Digital Image Pro:Some hot-off-the-press stuffAutomatic Photo Pop-up: The World Behind the ImageThe Story So Far…(brief overview of prior work)Computational PhotographyDepicting Our WorldPrehistoric Painting, Lascaux Cave, FranceDepicting Our World: The Middle AgesSt. Johnfrom the Gospel Book of Abbot Wedricus (1147) Cimabue Madonna Enthroned (c.1280-1290)Depicting Our World: RenaissanceEast Doors (1452)North Doors (1424)Lorenzo Ghiberti(1378-1455)Depicting Our World: RenaissancePiero della Francesca,The Flagellation (c.1469)Depicting Our World: Toward PerfectionJan van Eyck, The Arnolfini Marriage (c.1434)Depicting Our World: Toward PerfectionLens Based Camera Obscura, 1568Depicting Our World: Perfection!Still Life, Louis Jaques Mande Daguerre, 1837Depicting Our World: Perfection?Depicting Our World: Ongoing QuestPablo PicassoMarc ChagallDepicting Our World: Ongoing QuestAntonio Torralba & Aude Oliva (2002) David Hockney, 1985Enter Computer Graphics...GRAPHICSTraditional Computer Graphics3D geometryphysicsSimulationprojectionState of the Art•Amazingly real•But so sterile, lifeless, futuristic (why?)The richness of our everyday worldPhoto by Svetlana LazebnikBeauty in complexityUniversity Parks, OxfordWhich parts are hard to model?Photo by Svetlana LazebnikPeopleFrom “Final Fantasy”On the Tube, LondonFaces / HairPhoto by Joaquin Rosales GomezFrom “Final Fantasy”Urban ScenesVirtual LA (SGI)Photo of l LANatureRiver Cherwell, OxfordIn search of realism…Graphics is easy:•We know how to represent geometry (polygonal meshes, splines, subdivision surfaces, CSG, etc.)•Physics of light transport worked out (ray tracing, radiosity, Monte Carlo techniques, etc.)•Good progress in participating media (e.g. subsurface scattering)•Learned it all in 15-462!Graphics is still hard:•We want to model our world (visual realism!)•How do we create enough geometry?•How do we find reflectance properties for all materials?•Is it feasible? It is even needed? (human perception)•Can we use texture maps?•Where do we get all this DATA? Capture it from the real world – Computational Photography!Virtual World vs. the Real WorldTraditional Graphics: we played in our little sandboxComp. Photography: Now we are ready to embrace the world!Virtual Real WorldCampanile Moviehttp://www.debevec.org/Campanile/Programming Project 1Images of the Russian Empire -- colorizing the Prokudin-Gorskii photo collectionProgramming Project 2Photo MosaicsFull screen panoramas (cubic): http://www.panoramas.dk/ Mars: http://www.panoramas.dk/fullscreen3/f2_mars97.html2003 New Years Eve: http://www.panoramas.dk/fullscreen3/f1.htmlProgramming Project 3Automatic Mosaic StitchingProgramming Project 4Face warping and morphingProgramming Project 5Fun with Image StacksProgramming Project 6Tour Into the PictureFinal ProjectSomething cool!!!Administrative StuffGrading•Programming Projects (60%)•Midterm + Quizzes (20%)•Final Project (20%)Late Policy•Five late days total, to be spent wiselyCheating•Let’s not embarrass ourselvesHardware/Software•Graphics cluster, Wean 5336 (should have card access and login by now)•MATLAB!!!General CommentsPrerequisites•Linear algebra •Some computer graphics or vision (or talk to me)Emphasis on programming projects!•Building something from scratch (Matlab!)CamerasReally coolNot too expensive nowadays (<$250)Canon
View Full Document