CMSC 828Z::

Class Description :: Syllabus :: Reading List :: Projects :: Helpful Links ::

828Z Readings for Further Information

• General Overview over Computer Vision and Image-based Rendering

  • D. A. Forsyth and J. Ponce. Computer Vision: A Modern Approach. Prentice Hall, 2002.
  • Z. Zhang. Image-based geometrically correct photorealistic scene/object modelling: A review. In Proc. 3rd ACCV, pages 340-349, 1998.

1. Descriptions of the World: Shape Representations

   • Implicit Representations:
     • (Req) Jules Bloomenthal. Implicit surfaces. In Encyclopedia of Computer Science and Technology. Marcel Dekker, Inc., New York, NY, 2002. to appear.
     • (Req) William Welch and Andrew Witkin. Variational surface modeling Computer Graphics, 26, 1992. Proc. Siggraph '92.
     • Mathieu Desbrun and Marie-Paul Cani-Gascuel. Active implicit surface for animation. In Proceedings of Graphics Interface '98, pages 143-150, June 1998.
     • D. Enright, R. Fedkiw, J. Ferziger, and I. Mitchell. A hybrid particle level set method for improved interface capturing. J. Comput. Phys. (in review), 2002.
     • S.F. Frisken, R.N. Perry, A.P. Rockwood, and T.R. Jones. Adaptively sampled distance fields: A general representation of shape for computer graphics. In Proc. of ACM SIGGRAPH, pages 249-254, 2000.
     • J. Pope, S.F. Frisken, and R.N. Perry. Dynamic meshing using adaptively sampled distance fields. In ACM SIGGRAPH, Sketches & Applications, 2001.
     • Ross Whitaker and David Breen. Level-set models for the deformation of solid objects. In Proceedings of the 3rd International Workshop on Implicit Surfaces, pages 19-35. Eurographics Association, June 1998.
     • Geoff Wyvill, Craig McPheeters, and Brian Wyvill. Data Structure for Soft Objects. The Visual Computer, 2(4):227-234, February 1986.
   • Parametric Representations:
     • (Req) Andreas Hubeli and Markus Gross. A survey of surface representations for geometric modeling. Technical Report 335, ETH Zürich, Institute of Scientific Computing, March 2000.
     • (Req) Denis Zorin, Peter Schröder, and Wim Sweldens. Interactive multiresolution mesh editing. In Proc. of ACM SIGGRAPH, 1997.
     • I. Guskov, W. Sweldens, and P. Schröder. Multiresolution signal processing for meshes. Computer Graphics Proceedings (SIGGRAPH 99), pages 325-334, 1999.
     • Eitan Grinspun and Peter Schröder. Normal bounds for subdivision-surface interference detection. In Proceedings of IEEE Scientific Visualization, 2001.
     • L. Kobbelt, S. Campagna, J. Vorsatz, and H-P. Seidel. Interactive multi-resolution modeling on arbitrary meshes. In Proc. of ACM SIGGRAPH, 1998.
     • L. Kobbelt, T. Bareuther, and H-P. Seidel. Multiresolution shape deformations for meshes with dynamic vertex connectivity. In Eurographics 2000 proceedings, 2000.
     • A. W. F. Lee, W. Sweldens, P. Schröder, L. Cowsar, and D. Dobkin. Maps: Multiresolution adaptive parameterization of surfaces. Computer Graphics Proceedings (SIGGRAPH 98), pages 95-104, 1998.
     • N. Litke, A. Levin, and P. Schroeder. Fitting subdivision surfaces. In IEEE Visualization 2001, pages 319-324, October 2001.
     • C. Mandal, H. Qin, and B.C. Vemuri. Physics-based shape modeling and shape recovery using multiresolution subdivision surfaces. In Proc. of ACM SIGGRAPH, 1999.
     • P. Schröder and D. Zorin. Subdivision for modeling and animation. Siggraph 2000 Course Notes, 2000. (30MB PDF)
   • Conversion between Implicit and Parametric
     • P. Bhaniramka, R. Wenger, and R. Crawfis. Isosurfacing in higher dimensions. In Visualization, Salt Lake City, Utah, 2000. IEEE Computer Society Press.
     • Leif Kobbelt, Mario Botsch, Ulrich Schwanecke, and Hans-Peter Seidel. Feature sensitive surface extraction from volume data. In Proc. of ACM SIGGRAPH, 2001.
     • Sean Mauch. published at http://www.acm.caltech.edu/ seanm/software/cpt/cpt.html, 2000.
     • Zoë Wood, Mathieu Desbrun, Peter Schröder, and David Breen. Semi-regular mesh extraction from volumes. In Proceedings of Visualization, 2000.

2. Descriptions of the World: Surface Properties and Illumination

   • (Req) XiaoDong He, Kenneth E. Torrance, François Sillion, and Donald P. Greenberg. A comprehensive physical model for light reflection. Computer Graphics, 25(4), August 1991. Proceedings SIGGRAPH '91 in Las Vegas (USA).
   • (Req) R. Ramamoorthi and P. Hanrahan. A signal-processing framework for inverse rendering. In Proc. of ACM SIGGRAPH, 2001.
   • S. K. Nayar and M. Oren. Generalization of the lambertian model and implications for machine vision. International Journal of Computer Vision, 14:227-251, 1995.
   • R. Swaminathan. On the motion and appearance of specularities in image sequences. In Proc. European Conference on Computer Vision, volume I, pages 508-52, 2002.
   • James Arvo Min Chen. Closed-form expressions for irradiance from non-uniform lambertian luminaires. part ii: Polynomially-varying radiant exitance. Technical Report CS-TR-00-4, Caltech, June 2000.
   • R. Basri and D. Jacobs. Lambertian reflectance and linear subspaces. Technical report, NEC Research Institute Technical Report 2000-172R, Weizmann Institute of Science Technical Report MCS00-21, 2000.
   • P. Belhumeur and D. Kriegman. What is the set of images of an object under all possible lighting conditions. In Computer Vision and Pattern Recogition, 1996.
   • Philip Dutre. Global illumination compendium. web document.

3. Descriptions of the World: Motion and Animation of Shapes

• (Req) S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade. Three-dimensional scene flow. In Proc. International Conference on Computer Vision, Corfu,Greece, September 1999.
• Steve Capell, Seth Green, Brian Curless, Tom Duchamp, and Zoran Popovic. Interactive skeleton-driven dynamic deformations. In Proc. of ACM SIGGRAPH, 2002.
• Steve Capell, Seth Green, Brian Curless, Tom Duchamp, and Zoran Popovic. A multiresolution framework for dynamic deformations. In ACM SIGGRAPH Symposium on Computer Animation 2002, 2002.

4. The Space of Light Rays

• Representations
  • (Req) E H. Adelson and J. R. Bergen. The plenoptic function and the elements of early vision. In M. Landy and J. A. Movshon, editors, Computational Models of Visual Processing, pages 3-20. MIT Press, Cambridge, MA, 1991.
  • (Req) S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen. The lumigraph.
  • (Req) M. Levoy and P. Hanrahan. Light field rendering. In Proc. of ACM SIGGRAPH, pages 161-170, 1996.
  • C. Buehler, M. Bosse, L. McMillan, S. Gortler, and M. Cohen. Unstructured lumigraph rendering. In Proc. of ACM SIGGRAPH, 2001.
  • Emilio Camahort. 4D Light-Field Modeling and Rendering. PhD thesis, Department of Computer Sciences, The University of Texas at Austin, May 2001. Technical Report TR01-52.
  • W. Heidrich, H. Lensch, M. F. Cohen, and H-P. Seidel. Light field techniques for reflections and refractions. In Eurographics Rendering Workshop, 1999.
  • Leonard McMillan and Gary Bishop. Plenoptic modeling: An image-based rendering system. In Proc. of ACM SIGGRAPH, pages 39-46, August 1995.
  • Daniel N. Wood, Daniel I. Azuma, Ken Aldinger, Brian Curless, Tom Duchamp, David H. Salesin, and Werner Stuetzle. Surface light fields for 3d photography. In Proc. of ACM SIGGRAPH, 2000.
• Intrinsic Structure
  • (Req) J. Chai, X. Tong, and H. Shum. Plenoptic sampling. In Proc. of ACM SIGGRAPH, pages 307-318, 2000.
  • (Req) C. Zhang and T. Chen. Generalized plenoptic sampling. Technical Report AMP01-06, Carnegie Mellon Technical Report, 2001. submitted to IEEE Trans. CSVT Special Issue on Image-based Modeling, Rendering and Animation.
  • S.S. Beauchemin and J.L. Barron. On the fourier properties of discontinuous motion. Journal of Mathematical Imaging and Vision (JMIV), 13:155-172, 2000.
  • Giorgio Bonmassar and Eric L. Schwartz. Space-variant fourier analysis: the exponential chirp transform. IEEE Trans. PAMI, 19:100-130, 1997.
  • Richard Tsai, Paul Burchard, Li-Tien Cheng, Stanley Osher, and Guillermo Sapiro. Dynamic visibility in a level set based implicit frame work. Technical report, UCLA, February 2002.
  • X. Gu, S. J. Gortler, and M. F. Cohen. Polyhedral geometry and the two-plane parameterization. In Eighth Eurographics Workshop on Rendering, 1997.
  • M. Langer and R. Mann. Dimensional analysis of image motion. In Proc. International Conference on Computer Vision, volume I, pages 155-162, July 2001.

5. The Image Formation Process

   • Conventional Cameras
     • (Req) S. Battiato and M. Mancuso. An introduction to the digital still camera technology. ST Journal of System Research - Special Issue on Image Processing for Digital Still Camera, 2(2), 2001.
     • (Req) Craig Kolb, Don Mitchell, and Pat Hanrahan. A realistic camera model for computer graphics. In Proc. of ACM SIGGRAPH, pages 317-324, 1995.
     • Michael Gleicher and Andrew Witkin. Through-the-lens camera control. In Proceedings of SIGGRAPH 92, 26, pages 331-340, July 1994.
     • W. Heidrich, P. Slusallek, and H.-P. Seidel. An image-based model for realistic lens systems in interactive computer graphics. In Graphics Interface, 97.
   • Generalized Imaging Geometries (Cameras)
     • (Req) M. D. Grossberg and S. K. Nayar. A general imaging model and a method for finding its parameters. In Proc. International Conference on Computer Vision, pages 108-115, 2001.
     • (Req) E. H. Adelson and J. Y. A. Wang. Single lens stereo with a plenoptic camera. IEEE Trans. PAMI, 14:99-106, 1992.
     • (Req) H. Farid and E. Simoncelli. Range estimation by optical differentiation. Journal of the Optical Society of America, 15, 1998.
     • Simon Baker and Shree K. Nayar. Panoramic vision: Sensors, theory, and applications. In Ryad Benosman and Sing Bing Kang, editors, Panoramic Imaging: Sensors, Theory, Applications. Springer-Verlag, 2001.
     • H. Bakstein and T. Pajdla. Non-central cameras: A review. Research Report CTU-CMP-2000-14, Center for Machine Perception, Czech Technical University, September 2000.
     • Brian A. Barsky, Billy P. Chen, Alexander C. Berg, Maxence Moutet, Daniel D. Garcia, and Stanley A. Klein. Incorporating camera models, ocular models, and actual patient eye data for photo-realistic and vision-realistic rendering. In International Conference on Mathematical Methods for Curves and Surfaces, June 29 - July 4 2000.
     • H. Farid. Range Estimation by Optical Differentiation. PhD thesis, Department of Computer and Information Science, University of Pennsylvania, 1997.
     • Rajiv Gupta and Richard I. Hartley. Linear pushbroom cameras. IEEE Trans. PAMI, 19(9):963-975, 1997.
     • T. Naemura, T. Yoshida, and H. Harashima. 3-d computer graphics based on integral photography. Optics Express, 10:255-262, 2001.
     • S. Seitz. The space of all stereo images. In Proc. International Conference on Computer Vision, 2001.
     • Bennett Wilburn, Michael Smulski, Hsiao-Heng Kelin Lee, and Mark Horowitz. The light field video camera. In appears in Proceedings of Media Processors. SPIE Electronic Imaging, 2002.

6. From Images to the Scene: Shape Recovery

   • Small Baseline Stereo
     • (Req) D. Scharstein and R. Szeliski. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision, 47(1/2/3):17-42, 2002.
     • A. Criminisi, S.B. Kang, R. Swaminathan, R. Szeliski, and P. Anandan. Extracting layers and analyzing their specular properties using epipolar-plane-image analysis. Technical Report MSR-TR-2002-19, Microsoft Research, Redmond, USA, March 2002.
     • R. Szeliski and P. Golland. Stereo matching with transparency and matting. International Journal of Computer Vision, 32(1):45-61, 1999.
   • Space Carving
     • (Req) Greg Slabaugh, W.Bruce Culbertson, Thomas. Malzbender, and Ron Shafer. A survey of methods for volumetric scene reconstruction from photographs. In International Workshop on Volume Graphics, 2001.
     • Agrawal M. and Davis L. ". A probabilistic framework for surface reconstruction from multiple images. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2001.
     • Adrian Broadhurst. A Probabilistic Framework for Space Carving - ,. PhD thesis, Dept. of Engineering, University of Cambridge, December 2001.
     • J. S. De Bonet and P. Viola. Roxels: Responsibility weighted 3d volume reconstruction. In Proceedings of ICCV, September 1999.
     • K. N. Kutulakos and Steven Seitz. What do n photographs tell us about 3d shape?. Technical report, Computer Science Dept., U. Rochester, January 1998.
     • K. N. Kutulakos and S. M. Seitz. A theory of shape by space carving. International Journal of Computer Vision, 38:199-218, 2000.
   • Level Set Methods
     • (Req) Olivier Faugeras and Renaud Keriven. Variational principles, surface evolution, pde's, level set methods and the stereo problem. Technical Report RR-3021, INRIA- Sophia Antipolis, October 1996.
     • G. Cross and A. Zisserman. Surface reconstruction from multiple views using apparent contours and surface texture. In NATO Advanced Research Workshop on Confluence of Computer Vision and Computer Graphics, Ljubljana, Slovenia, page to appear, 2000.
     • H. Jin, A. Yezzi, and S. Soatto. Variational multiframe stereo in the presence of specular reflections. In Proc. of the 3DPVT, page in press, June 2002.
   • Model and Silhouette based Shape Recovery
     • (Req) Volker Blanz and Thomas Vetter. A morphable model for the synthesis of 3d faces. In Proc. of ACM SIGGRAPH, pages 187-194, 1999.
     • Roberto Cipolla. The visual motion of curves and surfaces. Phil. Trans. of the Royal Society, 1998.
     • T. Joshi, N. Ahuja, and J. Ponce. Structure and motion estimation from dynamic silhouettes under perspective projection. In Proc. International Conference on Computer Vision, 1995. This version: Beckman Institute Tech. Report UIUC-BI-AI-RCV-95-02.
     • Kiriakos N. Kutulakos. Shape from the light field boundary. In Proceedings, IEEE Computer Vision and Pattern Recognition Conference, San Juan, PR, pages 53-59, 1997.
     • W. Matusik, C. Buehler, S. J. Gortler, R. Raskar, and L. McMillan. Image based visual hulls. In Proc. of ACM SIGGRAPH, 2000.

7. From Images to the Scene: Motion Estimation

   • Estimation of Image Motion (Optic Flow)
     • (Req) J.L. Barron, D.J. Fleet, and S. Beauchemin. Performance of optical flow techniques. International Journal of Computer Vision, 12(1):43-77, 1994.
     • Simon Baker and Takeo Kanade. Super resolution optical flow. Technical Report CMU-RI-TR-99-36, Robotics Institute, Carnegie Mellon University, October 1999.
     • C.W. Ngo, T.C. Pong, H.j. Zhang, and R. T. Chin. Motion characterization by temporal slice analysis. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, June 13-15 2000.
   • Estimation of 3D Motion (Scene Flow)
     • (Req) R. L. Carceroni and K. Kutulakos. Multi-view scene capture by surfel sampling: From video streams to non-rigid 3d motion, shape, and reflectance. In Proc. International Conference on Computer Vision, June 2001.
     • (Req) Jan Neumann and Yiannis Aloimonos. Spatio-temporal stereo using multi-resolution subdivision surfaces. International Journal of Computer Vision, 47(1/2/3):181-193, 2002.
     • (Req) S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade. Three-dimensional scene flow. In Proc. International Conference on Computer Vision, Corfu,Greece, September 1999.
     • R. L. Carceroni and K. Kutulakos. Multi-view 3d shape and motion recovery on the spatio-temporal curve manifold. In Proc. International Conference on Computer Vision, volume 1, pages 520-527, 1999.
     • Douglas DeCarlo and Dimitris Metaxas. Optical flow constraints on deformable models with applications to face tracking. International Journal of Computer Vision, 38:99-127, 2000.
     • Douglas DeCarlo. Generation, Estimation and Tracking of Faces. PhD thesis, University of Pennsylvania, Department of Computer and Information Science, 1998.
     • P. Fua. Regularized bundle-adjustment to model heads from image sequences without calibration data. International Journal of Computer Vision, 38:153-171, 2000.
     • R. Plänkers and P. Fua. Tracking and modeling people in video sequences. International Journal of Computer Vision, 81:285-302, 2001.
     • Sundar Vedula. Image Based Spatio-Temporal Modeling and View Interpolation of Dynamic Events. PhD thesis, CMU, September 2001.

8. From Images to the Scene: Recovery of Illumination and Surface Properties

   • (Req) Y. Yu, P. Debevec, J. Malik, and T. Hawkins. Inverse global illumination: Recovering reflectance models of real scenes from photographs.
   • (Req) Hendrik P. A. Lensch, Jan Kautz, Michael Goesele Goesele, Wolfgang Heidrich, and Hans-Peter Seidel. Image-based reconstruction of spatially varying materials march 2001, 20 pages. Technical report, MPI Informatik, 2001.
   • (Req) R. Ramamoorthi and P. Hanrahan. A signal-processing framework for inverse rendering. In Proc. of ACM SIGGRAPH, 2001.
   • F. Bernardini, I. Martin, and H. Rushmeier. High-quality texture reconstruction. IEEE Trans. on Vis. and Comp. Graph., 7(4), October-November 2001.
   • M. D. Grossberg and S. K. Nayar. What can be known about the radiometric response function from images ?. In Proc. European Conference on Computer Vision, 2002.
   • S. Marschner, S. Westin, E. Lafortune, K. Torrance, and D. Greenberg. Image-based brdf measurement including human skin. In Eurographics Workshop on Rendering, 1999.
   • Stephen R. Marschner. Inverse Rendering for Computer Graphics. PhD thesis, Cornell University, 1998.
   • Ravi Ramamoorthi. A Signal-Processing Framework for Forward and Inverse Rendering. PhD thesis, Stanford University, August 2002.
   • Yoichi Sato and Katsushi Ikeuchi. Reflectance analysis for 3d computer graphics model generation. CVGIP Graphical Models and Image Processing, 58:437 -- 451, September 1996.
   • L. Wang, S. B. Kang, R. Szeliski, and H.-Y. Shum. Optimal texture map reconstruction from multiple views. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume I, pages 347-354, 2001.

9. Ego-Motion Estimation of the Camera(s): Structure from Motion

   • Direct Methods
     • (Req) M. Irani and P. Anandan. All about direct methods. In W. Triggs, A. Zisserman, and R. Szeliski, editors, International Workshop on Vision Algorithms, pages 278-295, 1999.
     • G.P. Stein and A. Shashua. Model-based brightness constraints: on direct estimation of structure and motion. IEEE Trans. PAMI, 22(9):992-1015, 2000.
   • Methods based on Features
     • (Req) P. H. S. Torr and A Zisserman. Feature based methods for structure and motion estimation. In W. Triggs, A. Zisserman, and R. Szeliski, editors, International Workshop on Vision Algorithms, pages 278-295, 1999.
     • Stan Birchfield. Derivation of kanade-lucas-tomasi tracking equation. published on the web.
     • Stan Birchfield. An introduction to projective geometry (for computer vision). published on the web.
     • A. Chiuso, P. Favaro, H. Jin, and S. Soatto. Motion and structure causally integrated over time. IEEE Trans. PAMI, 24(4):523-535, 2002.

10. Analysis of Error Sensitivity and Ambiguities of Scene Recovery

    • Simon Baker, Terence Sim, and Takeo Kanade. A fundamental theorem of stereo?. Technical Report CMU-RI-TR-01-07, Robotics Institute, Carnegie Mellon University, June 2001.
    • K. Daniilidis and M. Spetsakis. Understanding noise sensitivity in structure from motion. In Y. Aloimonos, editor, Visual Navigation: From Biological Systems to Unmanned Ground Vehicles, chapter 4. Lawrence Erlbaum Associates, Hillsdale, NJ, 1997.

11. Mathematical Tools

    • Stanley Osher and Ronald P. Fedkiw. Level set methods. Technical Report 00-08, UCLA, february 2000.
    • G.W. Stewart. Stochastic perturbation theory. SIAM Review, 32:576-610, 1990.