InvariantsSummaryPlanar InvariantsSlide 4Perspective ProjectionPerspective motion and projectionFor Planar ObjectsProjective TransformationsPlanar Projective InvariantsTransform to Canonical PositionAffineCross RatioLines: ParameterizationLine IntersectionIntersection of Parallel LinesInvariants of LinesInvariance in 3D to 2DNon-Invariance in 3D to 2DProof StrategyConstructing O1 … Ok-1Invariants of LightingHow do we represent light?Lambertian + Point SourcePlanar ObjectsNon-Planar ObjectsSlide 26Invariants(continued)Summary•Rigid rotation is 3x3 orthonormal matrix.•3-D Translation is 3x4 matrix.•3-D Translation + Rotation •Scaled Orthographic Projection: Remove row three and allow scaling.•Planar Object, remove column 3.Planar Invariants111...111000......21212,21,22,11,121213,22,21,23,12,11,12121nnyxnnyxnnyyyxxxtsstssyyyxxxtssstsssvvvuuuA tp1p2p3p4p4 = p1 + a(p2-p1) + b(p3-p1)A(p4)+ t = A(p1+a(p2-p1) + b(p3-p1)) + t = A(p1)+t + a(A(p2)+t – A(p1)-t) + b(A(p3)+t – A(p1)-t)p4 is linear combination of p1,p2,p3. Transformed p4 is same linear combination of transformed p1, p2, p3.We call (a,b) affine coordinates of p4.Perspective Projection•Problem: perspective is non-linear.•Solution: Homogenous coordinates.–Represent points in plane as (x,y,w)–(x,y,w), (kx, ky, kw), (x/w, y/w, 1) represent same point.–If we think of these as points in 3D, they lie on a line through origin. Set of 3D points that project to same 2D point.Perspective motion and projection1110000001000100013,32,31,33,22,21,23,12,11,13,32,31,33,22,21,23,12,11,1zyxtrrrtrrrtrrrzyxrrrrrrrrrtttzyxzyxFor Planar Objects1102,31,32,21,22,11,13,32,31,33,22,21,23,12,11,1yxtrrtrrtrryxtrrrtrrrtrrrzyxzyxThe first two columns on right are orthonormal. Scale is irrelevant. So there are 6 degrees of freedom.We ignore constraints to get 8. This is called a projective transformation.Projective Transformations•Mapping from plane to plane.•Form a group.–They can be composed–They have inverses.–Projective transformations equivalent to set of images of images.Planar Projective Invariants•Strategy. –Suppose P represents five points. V1 transforms P so that first 4 to canonical position, and fifth to (a,b,c). – Next, suppose we are given TP, with T unknown. Find V2 to transform first 4 points of TP to canonical position. –V2 = V1*T-1. V2P has fifth point = (a,b,c).–For this to work, V1, V2 must be uniquely determined.Transform to Canonical Position10011111kyxhgfedcbaExample: transform point 1 to (0,0,1). Three linear equations with 8+1 unknowns.Similarly, transform other points to: (1,0,1), (0,1,1), (1,1,1). Get 12 equations, 4 unknowns. • Unique solution.• Must be non-degenerate. This will be true if no three points collinear.Affine•Note that this is equivalent to what we did in the affine case. Affine coordinates are coordinates of 4th point after first three are transformed to (0,0), (1,0), (0,1).Cross Ratio•Let p1, p2, p3, p4 be collinear points.•Let (xj,yj) denote the coordinates of pj.•Let |xj xk| denote the determinate of a matrix whose first column is xj1, xj2, and whose second column is xk1, xk2.•Cross(p1,p2,p3,p4) =(|x1 x2| |x3 x4|)/(|x1 x3| |x2 x4|)•This cross-ratio is invariant to projective transformations.Lines: Parameterization•Equation for line: ax+by+c=0.•Parameterize line as l = (a,b,c)T.•p=(x,y,1)T is on line if <p,l>=0.Line Intersection•The intersection of l and l’ is l x l’ (where x denotes the cross product).•This follows from the fact that the cross product is orthogonal to both lines.Intersection of Parallel Lines•Suppose l and l’ are parallel. We can write l=(a,b,c), l’ = (a,b,c’). l x l’ = (c’-c)(b,-a,0). This equivalent to (b,-a,0).•This point corresponds to a line through the focal point that doesn’t intersect the image plane.•We can think of the real plane as points (a,b,c) where c isn’t equal to 0. When c = 0, we say these points lie on the ideal line at infinity.•Note that a projective transformation can map this to another line, the horizon, which we see.Invariants of Lines•Notice that affine transformations are the subgroup of projective transformations in which the last row is (0, 0, 1).•These map the line at infinity to itself.•So parallel lines are affine invariants, since they continue to intersect at infinity.Invariance in 3D to 2D•Invariance isn’t captured by mathematical definition of invariance because 3D to 2D transformations don’t form a group.–You can’t compose or invert them.•Let f be a function on images. f is an invariant iff for every Object O, if I1 and I2 are images of O, f(I1)=f(I2).•f is a non-trivial invariant if there exist two image I1 and I2 such that f(I1)~=f(I2).Non-Invariance in 3D to 2D•Theorem: Valid objects are any 3D point sets of size k, for some k. There are no non-trivial invariants of the images of these objects under perspective projection.Proof Strategy•Let f be an invariant.•Suppose two objects, A and B have a common image. Then f(I)=f(J) if I and J are images of either A or B.•Given any O0, Ok, we construct a series of objects, O1, …, Ok, so that Oi and O(i+1) have a common image for all i, and Ok and j have a common image.•So for any pair of images, I, J, from any two objects, f(I) = f(J).Constructing O1 … Ok-1•Oi has its first i points identical to the first i points of Ok, and the remaining points identical to the remaining points of O0.•If two objects are identical except for one point, they produce the same image when viewed along a line joining those two points.–Along that line, those two points look the same.–The remaining points always look the same.Invariants of Lighting•If I and J are images of the same object with the same pose, but different lighting, f(I)=f(J).How do we represent light? •Ideal distant point source: - No cast shadows - Light