DOC PREVIEW
CMU CS 15463 - ModelingLight

This preview shows page 1-2-3-25-26-27-28-50-51-52 out of 52 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

Modeling LightWhat is light?What do we see?What do we see?On Simulating the Visual ExperienceThe Plenoptic FunctionGrayscale snapshotColor snapshotA movieHolographic movieThe Plenoptic FunctionSampling Plenoptic Function (top view)RayHow can we use this?Ray ReuseOnly need plenoptic surfaceSynthesizing novel viewsLumigraph / LightfieldLumigraph - Organization Lumigraph / LightfieldLumigraph - RenderingStanford multi-camera arrayLight field photography using a handheld plenoptic cameraConventional versus light field cameraConventional versus light field cameraPrototype camera Digitally stopping-downDigital refocusingExample of digital refocusingDigitally moving the observerExample of moving the observerMoving backward and forward3D Lumigraph3D Lumigraph2D: ImageImageSpherical PanoramaOther ways to sample Plenoptic FunctionSpace-time imagesThe “Theatre Workshop” MetaphorPainter (images)Lighting Designer (environment maps)Sheet-metal Worker (geometry)… working togetherModeling Light15-463: Computational PhotographyAlexei Efros, CMU, Fall 2005© Michal HavlikWhat is light?Electromagnetic radiation (EMR) moving along rays in space•R(λ) is EMR, measured in units of power (watts)– λ is wavelengthUseful things:• Light travels in straight lines• In vacuum, radiance emitted = radiance arriving • i.e. there is no transmission lossPoint of observationFigures © Stephen E. Palmer, 2002What do we see?3D world 2D imageWhat do we see?3D world 2D imagePainted backdropOn Simulating the Visual ExperienceJust feed the eyes the right data• No one will know the difference!Philosophy:• Ancient question: “Does the world really exist?”Science fiction:• Many, many, many books on the subject• Latest take: The MatrixPhysics:• Slowglass might be possible?Computer Science:• Virtual RealityTo simulate we need to know:What does a person see?The Plenoptic FunctionQ: What is the set of all things that we can ever see?A: The Plenoptic Function (Adelson & Bergen)Let’s start with a stationary person and try to parameterize everythingthat he can see…Figure by Leonard McMillanGrayscale snapshotis intensity of light • Seen from a single view point• At a single time• Averaged over the wavelengths of the visible spectrum(can also do P(x,y), but spherical coordinate are nicer)P(θ,φ)Color snapshotis intensity of light • Seen from a single view point• At a single time• As a function of wavelengthP(θ,φ,λ)A movieis intensity of light • Seen from a single view point• Over time• As a function of wavelengthP(θ,φ,λ,t)Holographic movieis intensity of light • Seen from ANY viewpoint• Over time• As a function of wavelengthP(θ,φ,λ,t,VX,VY,VZ)The Plenoptic Function• Can reconstruct every possible view, at every moment, from every position, at every wavelength• Contains every photograph, every movie, everything that anyone has ever seen! it completely captures our visual reality! Not bad for a function…P(θ,φ,λ,t,VX,VY,VZ)Sampling Plenoptic Function (top view)Just lookup -- Quicktime VRRayLet’s not worry about time and color:5D• 3D position•2D directionP(θ,φ,VX,VY,VZ)Slide by Rick Szeliski and Michael CohenSurface CameraNoChangeinRadianceLightingHow can we use this?Ray ReuseInfinite line• Assume light is constant (vacuum)4D•2D direction• 2D position• non-dispersive mediumSlide by Rick Szeliski and Michael CohenOnly need plenoptic surfaceSynthesizing novel viewsSlide by Rick Szeliski and Michael CohenLumigraph / LightfieldOutside convex space4DStuffEmptySlide by Rick Szeliski and Michael CohenLumigraph - Organization 2D position2D directionsθSlide by Rick Szeliski and Michael CohenLumigraph - Organization 2D position2D position2 plane parameterizationsuSlide by Rick Szeliski and Michael CohenLumigraph - Organization 2D position2D position2 plane parameterizationusts,tu,vvs,tu,vSlide by Rick Szeliski and Michael CohenLumigraph - OrganizationHold s,t constantLet u,v varyAn images,tu,vSlide by Rick Szeliski and Michael CohenLumigraph / LightfieldLumigraph - Capture Idea 1• Move camera carefully over s,tplane• Gantry– see Lightfield papers,tu,vSlide by Rick Szeliski and Michael CohenLumigraph - Capture Idea 2• Move camera anywhere• Rebinning– see Lumigraph papers,tu,vSlide by Rick Szeliski and Michael CohenLumigraph - Rendering For each output pixel• determine s,t,u,v• either• use closest discrete RGB• interpolate near valuessuSlide by Rick Szeliski and Michael CohenLumigraph - RenderingNearest•closest s•closest u•draw itBlend 16 nearest• quadrilinear interpolationsuSlide by Rick Szeliski and Michael CohenStanford multi-camera array• 640 × 480 pixels ×30 fps × 128 cameras• synchronized timing• continuous streaming• flexible arrangementLight field photography using a handheld plenoptic cameraRen Ng, Marc Levoy, Mathieu Brédif,Gene Duval, Mark Horowitz and Pat Hanrahan© 2005 Marc LevoyConventional versus light field camera© 2005 Marc LevoyConventional versus light field camerauv-plane st-planePrototype camera4000 × 4000 pixels ÷ 292 × 292 lenses = 14 × 14 pixels per lensContax medium format camera Kodak 16-megapixel sensorAdaptive Optics microlens array 125μ square-sided microlenses© 2005 Marc LevoyDigitally stopping-down• stopping down = summing only the central portion of each microlensΣΣ© 2005 Marc LevoyDigital refocusing• refocusing = summing windows extracted from several microlensesΣΣ© 2005 Marc LevoyExample of digital refocusing© 2005 Marc LevoyDigitally moving the observer• moving the observer = moving the window we extract from the microlensesΣΣ© 2005 Marc LevoyExample of moving the observer© 2005 Marc LevoyMoving backward and forward3D LumigraphOne row of s,t plane• i.e., hold t constants,tu,v3D LumigraphOne row of s,t plane• i.e., hold t constant• thus s,u,v• a “row of images”su,vby David DeweyP(x,t)2D: ImageWhat is an image?All rays through a point• Panorama?Slide by Rick Szeliski and Michael CohenImageImage plane2D• positionSpherical PanoramaAll light rays through a point form a ponoramaTotally captured in a 2D array --P(θ,φ)Where is the geometry???See also: 2003 New Years Evehttp://www.panoramas.dk/fullscreen3/f1.htmlOther ways to sample Plenoptic FunctionMoving in time: • Spatio-temporal volume: P(θ,φ,t)• Useful to study temporal changes• Long an interest of artists:Claude Monet, Haystacks studiesSpace-time


View Full Document

CMU CS 15463 - ModelingLight

Documents in this Course
Lecture

Lecture

36 pages

Lecture

Lecture

31 pages

Wrap Up

Wrap Up

5 pages

morphing

morphing

16 pages

stereo

stereo

57 pages

mosaic

mosaic

32 pages

faces

faces

33 pages

MatTrans

MatTrans

21 pages

matting

matting

27 pages

matting

matting

27 pages

wrap up

wrap up

10 pages

Lecture

Lecture

27 pages

Lecture

Lecture

40 pages

15RANSAC

15RANSAC

54 pages

lecture

lecture

48 pages

Lecture

Lecture

42 pages

Lecture

Lecture

11 pages

Lecture

Lecture

52 pages

Lecture

Lecture

39 pages

stereo

stereo

57 pages

Lecture

Lecture

75 pages

texture

texture

50 pages

Lectures

Lectures

52 pages

Load more
Download ModelingLight
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view ModelingLight and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view ModelingLight 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?