13D Computer Visionand Video ComputingIntroductionIntroductionCSc I6716Spring 20113D Computer Vision IntroductionInstructor: Zhigang ZhuCity College of New [email protected] Computer Visionand Video ComputingCourse InformationCourse Information Basic Information: Course participationpp Books, notes, etc. Web page – check often! Homework, Assignment, Exam Homework and exams Grading Goal What I expect from you What you can expect from me Resources23D Computer Visionand Video ComputingBookBook Textbook“Introductory Techniques for 3D Computer Vision”TruccoIntroductory Techniques for 3-D Computer Vision Trucco and Verri, 1998 Additional readings when necessary “Computer Vision – A Modern Approach” Forsyth and Ponce, 2003 “Three-Dimensional Computer Vision: A Geometric Viewpoint” O. Faugeras, 1998 “Image Processing, Analysis and Machine VIsion” Sonika, Hlavac and Boyle, 1999 On-Line References3D Computer Visionand Video ComputingPrequisitesPrequisites Linear Algebra A little Probability and Statistics Programming Experience  Reading Literature (A little) An Inquisitive Nature (Curiosity)No FearNo Fear33D Computer Visionand Video ComputingCourse Web PageCourse Web Page Lectures available in Powerpoint formathttp://www-cs.engr.ccny.cuny.edu/~zhu/CSCI6716-2011s/VisionCourse-Spring-2011.html All homework assignments will be distributed over the web Additional materials and pointers to other web sites Course bulletin board contains last minute items, changes to assignments, etc. CHECK IT OFTEN!You are responsible for material posted thereYou are responsible for material posted there3D Computer Visionand Video ComputingCourse OutlineCourse Outline Complete syllabus on the web pages (14 meets) Rough Outline ( 3D Computer Vision):Part 1. Vision Basics (Total 4) ()1. Introduction (1) 2. Image Formation and Processing (1) (hw 1, matlab)3-4. Features and Feature Extraction (2) ( hw 2)Part 2. 3D Vision (Total 7)5. Camera Models (1)6. Camera Calibration (2)(hw 3)7. Stereo Vision (2) (project assignments) 8. Visual Motion (2) (hw 4)Part 3. Exam and Projects (Total 3)9. Project topics and exam review/discussion (1)10. Midterm exam (1)11. Student Project presentations (1)43D Computer Visionand Video ComputingGradingGrading Homework (4): 40% Exam (midterm): 40%() Course Project + Presentation: 20% Groups (2-3 students) for discussions Experiments – independently + collaboratively Written Report - independently + collaboratively All homework must be yours….but you can work together until the final submission Teaching Assistant: Mr. Wai L. Khoo <[email protected]> 3D Computer Visionand Video ComputingC++ and MatlabC++ and Matlab C++ For some simple computation you may use C++For some simple computation, you may use C++ Matlab An interactive environment for numerical computation Available on Computer Labs machines (both Unix and Windows) Matlab primer available on line (web page) Pointers to on-line manuals also availableGood rapid prototyping environmentGood rapid prototyping environment Use C++ and/or Matlab for your homework assignments and project(s); However Java will also be fine53D Computer Visionand Video ComputingCourse Goals and QuestionsCourse Goals and Questions What makes (3D) Computer Vision interesting ?2D Image Modeling/Analysis/Interpretation Interpretation is an Artificial Intelligence Problem Sources of Knowledge in Vision Levels of Abstraction Interpretation often goes from 2D images to 3D structures  since we live in a 3D worldImage Rendering/Synthesis/Composition2D imagesCVCGImage Rendering/Synthesis/Composition Image Rendering is a Computer Graphics problem Rendering is from 3D model to 2D images3D world3D Computer Visionand Video ComputingRelated FieldsRelated Fields Image Processing: image to image Computer Vision: Image to model Computer Graphics: model to imageAll three are interrelated! Pattern Recognition: image to class image data mining/ video mining Artificial Intelligence: machine smarts Machine perception Photogrammetry: camera geometry, 3D reconstructionMedical Imaging:CAT MRI 3D reconstruction (2ndmeaning)AIApplicationsMedical Imaging: CAT, MRI, 3D reconstruction (2meaning) Video Coding: encoding/decoding, compression, transmission Physics & Mathematics: basics Neuroscience: wetware to concept Computer Science: programming tools and skills?basics63D Computer Visionand Video ComputingApplicationsApplications Visual Inspection (*)  Robotics (*)Intelligent Image ToolsIntelligent Image Tools Image Compression (MPEG 1/2/4/7) Document Analysis (OCR) Image and Video on the Web Virtual Environment Construction (*) Environment (*) Media and Entertainment Medicine Astronomy Law Enforcement (*) surveillance, security Traffic and Transportation (*) Tele-Conferencing and e-Learning (*) Human Computer Interaction (HCI)3D Computer Visionand Video ComputingJob MarketsJob Markets Homeland SecurityPort security–cargo inspection, human ID, biometricsPort security cargo inspection, human ID, biometrics Facility security – Embassy, Power plant, bank  Surveillance – military or civilian  Media Production Cartoon / movie/ TVs/ photography Multimedia communication, video conferencing Research in image, vision, graphics, virtual reality 2D image processing3D d li i t l lkth h3D modeling, virtual walk-thorugh Consumer/ Medical Industries Video cameras, Camcorders, Video phone Medical imaging 2D -> 3D73D Computer Visionand Video ComputingIP vs CVIP vs CV Image processing (mainly in 2D) Image to Image transformations Image to Description transformationsgp Image Analysis - extracting quantitative information from images: Size of a tumor distance between objects facial expression Image restoration. Try to undo damageneeds a model of how the damage was madeneeds a model of how the damage was made Image enhancement. Try to improve the quality of an image Image compression. How to convey the most amount of information with the least amount of data3D Computer Visionand Video ComputingWhat is Computer Vision?What is Computer Vision?Vision is the art of seeing things invisible.-Jonathan Swift