Content-Based Image RetrievalMotivationSlide 3Feature ExtractionColor FeaturesSlide 6Texture FeaturesSlide 8Slide 9Feature SelectionProject GoalReferencesContent-Based Image RetrievalMichele Saad Email: [email protected]: Multi-Dimensional Digital Signal ProcessingMarch 06, 2008Motivation•Exponential increase in computing power and electronic storage capacity•Exponential increase in digital image/video database sizes •Increased use of image and video:–Entertainment–Education–Commercial purposes•Need abstractions for efficient and effective browsing•Feature extraction/selection•Indexing•System DesignChallenge: Gap between low-level features and high level user semanticsContent-Based Image Retrieval SystemFeature Extraction•Primary Features–Color–Texture–Shape–Spatial location•Feature Selection Methods–Relevance feedback (supervised learning)–Fuzzy approachColor Features•Conventional color histogram (CCH)–Easy computation–Does not encode spatial info–Does not encode color pixel similarity•Fuzzy color histogram (FCH)–Considers degree of color similarity between pixels–Robust to quantization error–Robust to changes in light intensity•Color correlogram–Easy computation–Distills spatial correlation of colors •Color-shape based method–Includes area and shape infoColor FeaturesN. R. Howe, D. P. Huttenlocher, “Integrating Color, Texture and Geometry for Image Retrieval”, Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. II, pp. 239-246, June 2000. Key Paper #1Texture Features•Steerable pyramid–Basic filters are translation and rotation of a single function–Filter is linear combination of basis functions–Only for rotation-invariant texture retrieval•Contourlet transform–Combination of a Laplacian pyramid and directional filter bank–Low computational complexity•Gabor wavelet–Optimally achieves joint resolution in space and spatial frequency–Computationally intensive–Highest texture retrieval results•Complex directional filter bank (CDFB)–Retrieval results comparable with Gabor wavelet results–Shift InvariantKey Paper #2Texture FeaturesS. Oraintara, T. T. Nguyen, “Using Phase and Magnitude Information of the Complex directional Filter Bank for Texture Image Retrieval”, Proc. IEEE Int. Conf. on Image Processing, vol. 4, pp. 61-64, Oct. 2007Texture FeaturesS. Oraintara, T. T. Nguyen, “Using Phase and Magnitude Information of the Complex directional Filter Bank for Texture Image Retrieval”, Proc. IEEE Int. Conf. on Image Processing, vol. 4, pp. 61-64, Oct. 2007Feature Selection•Online feature selection•Relevance feedback learning•Fuzzy feature contrast model (FFCM)•Boosting algorithm•Feature contrast model (FCM) psychological similarity between two objects: Key Paper #3Project Goal•Comparison of color, shape and texture feature extraction algorithms•Comparison of two feature selection algorithms incorporating relevance feedback. •Simulations to be done on an image dataset of 10,000 images from the misc databaseReferences•[1]. A. Bovik, Handbook of Image and Video Processing, 2nd Edition, Elsevier Academic Press, ISBN 0-12-119792-1, 2005. •[2]. J. Huang, S. R. Kumar, M. Mitra, W. J. Zhu and R. Zabih, “Time Indexing Using Color Correlograms”, Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 762 – 768, June 1997. •[3]. S. Oraintara and T. T. Nguyen, “Using Phase and Magnitude Information of the Complex directional Filter Bank for Texture Image Retrieval”, Proc. IEEE Int. Conf. on Image Processing, vol. 4, pp. 61-64, Oct. 2007. •[4]. W. Jiang, G. Er, Q. Dai and J. Gu, “Similarity-Based Online Feature Selection in Content-Based Image Retrieval”, IEEE Trans. on Image Processing, vol. 15, no. 3, pp. 101-104, March 2006.•[5]. M. Kokare, P.K. Biswas and B.N. Chatterji, “Texture Image Retrieval Using New Rotated Complex Wavelet Filters”, IEEE Trans. on Systems, Man and Cybernetics- Part B: Cybernetics, vol. 23, no. 6, pp. 1168 - 1178, Dec. 2005.•[6]. P Liu, K. Jia, Z. Wang and Z. Lv, “A New and Effective Image Retrieval Method Based on Combined Features”, Proc. IEEE Int. Conf. on Image and Graphics, vol. I, pp. 786-790, August 2007.•[7]. N. R. Howe and D. P. Huttenlocher, “Integrating Color, Texture and Geometry for Image Retrieval”, Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. II, pp. 239-246, June 2000.•[8]. N. V. Shirahatti and K. Barnard, “Evaluating Image Retrieval”, Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, vol. I, pp. 955-961, June 2005.•[9]. S. Deb and Y. Zhang, “An Overview of Content-Based Image Retrieval Techniques”, Proc. IEEE Int. Conf. on Advanced Information Networking and Application, vol. I, pp. 59-64,
View Full Document
Unlocking...