ENEE 731: Image Understanding

END SEMESTER EXAM. (Due Dec. 20)

Date(s) Topic References Additional Readings
06 Sept. Extraction of optimal Edge, Shape and Skeleton Features. Hough Transform.
  • Marr, D. and Hildreth, E. "Theory of Edge Detection," Proceedings of the Royal Society of London, Series B, Vol. 207, p.187-217, 1980.
  • J. Canny, "A Computational Approach to Edge Detection, " IEEE Transactions on PAMI, vol. 8, pp. 679--698, 1986.
  • H. Blum, "A Transformation for Extracting New Descriptors of Shape," Models for the Perception of Speech and Visual Form,W. Wathen-Dunn, ed., MIT Press, 1967, pp. 362--380.
  • R. M. Haralick, "Digital Step Edges from Zero Crossing of Second Directional Derivatives," IEEE Trans. PAMI, Vol. PAMI-6, No. 1, Jan. 1984.
  • H. Moon, R. Chellappa, and A. Rosenfeld, "Optimal Edge-Based Shape Detection," IEEE Trans. Image Processing, Nov. 2002.
11 Sept.
18 Sept.
Segmentation 1 - Markov Random Fields
  • Markov Random Field Modeling in Computer Vision . Webpage
  • B. S. Manjunath, T. Simchony, & R. Chellappa, "Stochastic and Determinstic Networks for Texture Segmentation," IEEE Acoustic, Speech, and Signal Processing, Vol. 38, No. 5, July 1990.
  • Fure-Ching Jeng, J. W. Woods, & S. Rastogi, "Compound Gauss-Markov Random Fields for Parallel Image Processing," Markov Random Fields Theory and Application, Academic Press, 1993.
  • Rotation-invariant Texture Classification
13 Sept. Overview of Camera Models, Calibration and Optimization Theory
  • Camera models: Perp, Para-perp, Affine and Omnidirectional.
  • Geometry and Invariance (as related to Camera models)
  • Optimization Theory
Notes to be uploaded
25 Sept./27. Sept MRF and Simulated Annealing
  • S. Chib, E. Greenberg, Understanding the Metropolis-Hastings Algorithm The American Statistician, Vol. 49, No. 4. (Nov., 1995), pp. 327-335.
  • Oct. 02 Segmentation 1 - Filtering Methods To Be Updated
    04 Oct. Segmentation 2 - Graph based Spectral Methods
  • Jianbo Shi and Jitendra Malik, "Normalized Cuts and Image Segmentation," IEEE Transactions on PAMI, Vol. 22, No. 8, Aug. 2000.
  • Wu and Leahy, An optimal graph theoretic approach to data clustering: theory and its application to image segmentation T-PAMI, Vol 15., Issue 11, pp. 1101-1113, Nov. 1993
  • V. M. Govindu , A Tensor Decomposition for Geometric Grouping and Segmentation Proc. IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 2005
  • On Spectral Clustering: Analysis and an algorithm, Andrew Y. Ng, Michael Jordan, and Yair Weiss. In NIPS 14,, 2002

    Deepak Verma and Marina Meila  "Comparison of Spectral Clustering Methods" (submitted).

    Learning Segmentation with Random Walk Marina Maila and Jianbo Shi Neural Information Processing Systems, NIPS, 2001

    Segmentation using eigenvectors: a unifying view. Weiss Y.  Proceedings IEEE International Conference on Computer Vision p. 975-982 (1999)

    Oct. 09 Partcle Filters/Sequential Important Sampling (SIS)
  • PPT on Particle Filtering, Unscented PF etc.
  • Oct. 11 PF Methods for Tracking
  • S. Zhou, V. Krueger, and R. Chellappa. Probabilistic recognition of human faces from video. Computer Vision and Image Understanding (CVIU) (special issue on Face Recognition), Vol. 91, pp. 214-245, 2003.
  • S. Zhou, R. Chellappa, and B. Moghaddam. Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Transactions on Image Processing (TIP), Vol. 11, pp. 1434-1456, November 2004.
  •   Videos from Shaohua Zhou's Website.
    16 Oct. Structure From Motion 1- Early approaches
    • Structure from Motion - Problem Description
    • Structure from motion, prior to 1981.
    • R. Y. Tsai and T. S. Huang, "Estimating 3-d motion parameters of a rigid planar patch," IEEE ASSP, pp. 525--534, Vol. 30, 1981.
    • R. Tsai and T. S. Huang, "Estimating Three-dimensional motion parameters of a rigid planar patch, II: singular value decomposition," IEEE Transactions on Acoustic, Speech and Signal Processing, 30, 1982.
    • R.Y. Tsai and T. S. Huang. "Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surface." IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI6: 13--26, 1984.
    • Jia-Qi Fang and T. S. Huang, "Some experiments on estimating the 3-D motion parameters of a rigid body from two consecutive frames," IEEE PAMI, Vol PAMI-6, No. 5, September 1984. 
    18 Oct., 23 Oct.

    Structure From Motion 2 - Filtering based approaches

    • T. J. Broida and Rama Chellappa, "Estimating the kinematics and structure of a rigid object from a sequence of monocular images," IEEE Trans. Pattern Analysis and Machine Intelligence, 13(6):497--513, June 1991.
    • Gang Qian and R.Chellappa, "Structure from motion using Sequential Monte Carlo," accpeted by ICCV, 2001. download
    25 Oct. Structure From Motion 5 -Optical Flow estimation
    • H. Liu, T-H Hong, M. Herman and R. Chellappa, "A General Motion Model and Spatio-Temporal Filters for Computing Optical Flow," International Journal of Computer Vision 22(2), 141-172(1997) download
    Oct. 30 Small Brains, Smart Minds
  • Mandyam V. Srinivasan; Matthew Davey Strategies for Active Camouflage of Motion Proceedings: Biological Sciences, Vol. 259, No. 1354. (Jan. 23, 1995), pp. 19-25.
  • Nov. 1 Structure From Motion 6 - Direct Methods
  • Jerian, C.P. Jain, R., Structure from motion-a critical analysis of methods, IEEE Trans. on Systems, Man and Cybernetics,May/Jun 1991, Volume: 21, Issue: 3
  • John Oliensis, A Critique of Structure-from-Motion Algorithms Volume 80, Number 2 (2000), pages 172–214, Computer Vision and Image Understanding, Volume 84, Issue 3, December 2001, Pages 407-408
  • Nov 6, 8. Structure From Motion 4 - Factorization  
    Nov. 8 Structure From Motion 3 - More Filtering Approaches
    • Z. Zhang and O.D. Faugeras, "Estimation of displacements from two 3-D frames obtained from stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(12):1141--1155, December 1992.
    • G. Young and R. Chellappa, "3D motion estimation using a sequence of noisy stereo images: Models, estimation, and uniqueness results," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, pp. 735--759, Aug. 1990.
    13 Nov. Multibody Motion Segmentation
    • J.P. Costeira and T. Kanade. A multibody factorization method for independently moving objects. IJCV, 29(3):159--179, 1998.
    • C.W. Gear. multibody grouping from motion images. IJCV, 29(2):133--150, 1998.
    15 Nov. Shape from shading  
    20 Nov. Stereo vision I
    • Marr, "Vision"
    • Grimson, "From images to surfaces"
     
    22 Nov. Stereo vision II
    • H. S. Lim and T. O. Binford, "Stereo Correspondence: A Hierarchical Approach," Proceedings of Image Understanding Workshop, pp. 234-241, Feburary, 1987.
    • V. Venkateswar and R.Chellappa, "Hierarchical stereo and motion correspondence using feature groupings." IJCV, 1995. 
     
    27 Nov. 2-D object recognition
    • B. Bhanu and O. Faugeras,  "Shape matching of two-dimensional objects," IEEE Transactions on PAMI, Vol. PAMI-6, No. 2, pp. 137-- 155, March 1984.
    • S. Dubois and F. Glanz, "An Autoregrssive Model Approach to Two-Dimensional Shape Classification," IEEE Trans. PAMI, Vol. PAMI-8, No. 1, January 1986.
     
    29 Nov. Face Recognition I
    • M. Turk and A. Pentland, "Eigenfaces for recognition." Journal of Cognitive Neuroscience, Vol. 3, pp. 71-86, 1991.
    • K. Etemad and R. Chellappa, "Discriminant Analysis for Recognition of Human Face Images," Journal of Optical Society of America A, pp. 1724-1733, Aug. 1997. download
     
    04. Dec Face Recognition II
    • P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection", IEEE Trans. PAMI, Vol. 19, No. 7, July 1997. download
    • Martin Lades, Jan C. Vorbruggen, J.Buhmann, J.Lange, C von der Malsburg, R.P. Wurtz, and W. Konen, "Distortion Invariant Object Recognition in the Dynamic Link Architecture", IEEE Trans. Computers, Vol 42, No. 3, pp 300-311,1993 download
    • L. Wiskott, J.-M. Fellous, N. Kruger, and C. von der Malsburg, "Face recognition by elastic graph matching," IEEE Trans. PAMI, Vol. 19, No. 7, 1997. download
     
    06 Dec. 3-D Object Recognition
    • Grimson, "Object Recognition by Computer"
    • Geometric Hashing
     
    11 Dec. Face Recognition (III)
    • S. Zhou, V. Krueger, and R. Chellappa, "Probabilistic Recognition of Human Faces from Video", CVIU, 2003.
     
    13 Dec. Activity Analysis and course summary
    • N. Vaswani, A. Roy Chowdhury, and R. Chellappa, "Activity Analysis"
     

    This page uses Aravind Sunderesan's style files.