General Notes
Appearance and acquisition's related areas:- Imaging systems: lighting, camera, optics, beam splitter, projector, LEDs, mirror
- computational photography
- Image-based modeling, rendering and relighting [Debevec et a. 2000]: light field [Chai et al. 2000] [Isaksen et al. 2000] [Wood et al. 2000] , environment matting [Chuang et al. 2000]
- Appearance modeling
- Signal processing [Ramamoorthi and Hanrahan 2001] [Durand et al. 2005] [Ng 200
Analysis (computer vision) and synthesis (computer graphics) of appearance
A red line through a bundle of great work
- light field, reflectance field, incident light field
- environment matting
- A frequency analysis of light transport, a theory of inverse light transport, plenoptic sampling, a signal-processing framework for inverse rendering
- Fourier slice photography, light field microscopy
- Dual photography, Helmholtz stereopsis [Zickler et al. 2002]
- Fast separation of direct and global components of a scene using high frequency illumination, linear light source reflectometry
Favorite Papers
[Nayar et al. 2006]
- In all cases, the total radiance measured at a camera pixel is the sum of direct and global components. L=Ld+Lg
- First of all, it is a very nice paper. And some notes:
- How do the techniques in this paper work on a (highly)translucent object?
- Some features of translucency: low frequency (diffuse); global; polarization.
- Modeling translucent objects, e.g. shape? more applications?
- Exploit active illumination deeply. try and master projector; light source control; illumination pattern.
- Exploit reflectance, light transportation; separation and factorization are very powerful tool to analyze appearance.
- Refer to [Seitz et al. 2005]
- Frontal point → shape [Vogiatzis et al. 2005]; specularity → shape; global ↔ direct reflectance components
- minimize the number of images needed for separation.
- analyzing, illustration, deeply, generally, comparison, validation, and applications
- concavities
- Light field: techniques related to light field would be helpful.
- separation, decomposition, factorization
- High frequency illumination (shadowing); linear light source ↔ linear shadow
- It is easy to extend to multiple-layer separation (transparent or translucent layers), e.g. a person behind a glass
- It will be helpful or illuminating for anything related to direct or indirect appearance components.
Some notes:
- Projector, beam splitter
- Open problem: translucent objects
- Calibration: camera, projector etc.
- Kernal estimation
Some notes:
Principles of shaded relief, inspired by techniques used in cartography to produce shaded relief drawings of terrain.
Multiscale shading. It reveals detail regardless of surface orientation and, by operating at multiple scales, is designed to convey detail at all frequencies simultaneously. By combining multiscale processing with local adjustment to light direction, our exaggerated shading technique communicates surface geometry through single images.
The concept of varying the light source throughout the model is related to recent work in computational photography, in which multiple photographs under different illumination are combined using either a manual painting interface or automatic criteria such as maximal contrast.
Future work: (1). This suggests perceptual studies to investigate the amount of lighting exaggeration the human visual system can tolerate, which retaining the ability to perceive surface shape, rather than texture. (2). A global optimization framework for allowing more significant changes to lighting direction while eliminating or hiding discontinuities, and (3) an analysis of shading over continuous scale space, rather than the discrete scales we consider.
[Bouguet and Perona 1999]
Some notes:
Extensions: moving camera and light source; registration of multiple scans; extended light source model.
[Gu et al. 2006]
Some notes:
database, data-driven
time-varying appearances; dynamic? evolving? temporal dimension
factorization
References
[Agarwal et al. 2006] Edge Suppression by Gradient Field Transformation using Cross-Projection Tensors
Amit Agrawal, Ramesh Raskar and Rama Chellappa. CVPR 2006
[Agarwala et al. 2006] Interactive Digital Photomontage
AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S., COLBURN, A., CURLESS, B., SALESIN, D., AND COHEN, M. SIGGRAPH 2004
[Akers et al. 2003] Conveying Shape and Features with Image-Based Relighting
AKERS, D., LOSASSO, F., KLINGNER, J., AGRAWALA, M., RICK, J., AND HANRAHAN, P. IEEE Visualization.
[Arikan et al. 2005] Fast and Detailed Approximate Global Illumination by Irradiance Decomposition
Okan Arikan, David Forsyth, James F. O'Brien. SIGGRAPH 2005.
[Ben-Ezra and Nayar 2004] Motion-based motion deblurring
Moshe Ben-Ezra and Shree K. Nayar PAMI 2004
[Ben-Ezra et al. 2005] Video super-resolution using controlled subpixel detector shifts
Moshe Ben-Ezra et al. PAMI 2005
[Chai et al. 2000] Plenoptic Sampling
Jin-Xiang Chai, Xin Tong, Shing-Chow Chan, Harry Shum. SIGGRAPH 2000
[Chen et al. 2005] Visual Simulation of Weathering by Gamma-ton Tracing
Yanyun Chen, Lin Xia, Tien Tsin Wong, Xin Tong, Hujun Bao, Baining Guo, Heung-Yeung Shum. SIGGRAPH 2005
[Chuang et al. 2000] Environment Matting Extensions: Towards Higher Accuracy and Real-Time Capture
Yung-Yu Chuang, Douglas E. Zongker, Joel Hindorff, Brian Curless, David H. Salesin, Richard Szeliski. SIGGRAPH 2000
[Debevec et al. 2000] Acquiring the Reflectance Field of a Human Face
Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, Mark Sagar. SIGGRAPH 2000
[Donner et al. 2005] Light Diffusion in Multi-Layered Translucent Materials
Craig Donner, Henrik Wann Jensen. SIGGRAPH 2005
[Durand et al. 2005] A Frequency Analysis of Light Transport
Fredo Durand, Nicolas Holzschuch, Cyril Soler, Eric Chan, Franois X. Sillion. SIGGRAPH 2005
[Fergus et al. 2006] Removing camera shake from a single photograph
Rob Fergus et al. siggraph 2006
[Gardner et al. 2003] Linear Light Source Reflectometry
Andrew Gardner, Chris Tchou, Tim Hawkins, Paul Debevec. SIGGRAPH 2003
[Garg et al. 2006] Photorealistic Rendering of Rain Streaks
Kshitiz Garg, Shree K. Nayar. SIGGRAPH 2006
[Georgiev et al. 2006] Spatio-angular Resolution Trade-offs in Integral Photography
Georgiev, T., Zheng, C., Nayar, Sh., Curless, B., Salasin, D., Intwala, Ch. EGSR 2006
[Goesele et al. 2003] Accurate Light Source Acquisition and Rendering
Michael Goesele, Xavier Granier, Wolfgang Heidrich, Hans-Peter Seidel. SIGGRAPH 2003
[Golovinskiy et al. 2006] A Statistical Model for Synthesis of Detailed Facial Geometry
Aleksey Golovinskiy, Wojciech Matusik, Hanspeter Pfister, Szymon Rusinkiewicz, Thomas A. Funkhouser. SIGGRAPH 2006
[Gooch et al. 1998] A Non-Photorealistic Lighting Model for Automatic Techical Illustration
GOOCH, A., GOOCH, B., SHIRLEY, P., AND COHEN, E. SIGGRAPH
[Gooch et al. 2004]Human Facial Illustrations: Creation and Psychophysical Evaluation
GOOCH, B., REINHARD, E., AND GOOCH, A. ACM Trans. Graphics
[Gortler et al. 1996] The lumigraph
S. Gortler, R. Grzeszczuk, R. Szelishi and M. Cohen. SIGGRAPH 1996.
[Grossberg and Nayar 2005] The raxel imaging model and ray-based calibration
Michael Grossberg et al. IJCV 2005
[Gu et al. 2006] Time-Varying Surface Appearance: Acquisition, Modeling, and Rendering
Jinwei Gu, Chien-i Tu, Ravi Ramamoorthi, Peter Belhumeur, Wojciech Matusik, Shree Nayar. SIGGRAPH 2006
[Gumhold 2002] Maximum Entropy Light Source Placement
GUMHOLD, S. In Proc. IEEE Visualization.
[Guy and Soler 2004] Graphics Gems Revisited: Fast and Physically Based Rendering of Gemstones
Stephane Guy, Cyril Soler. SIGGRAPH 2004
[Halle and Meng 2003] LightKit: A Lighting System for Effective Visualization
HALLE, M., AND MENG, J. 2003. . In Proc. IEEE Visualization.
[Han et al. 2003] Measuring Bidirectional Texture Reflectance With a Kaleidoscope
Jefferson Han, Ken Perlin. SIGGRAPH 2003
[Hanrahan and Krueger 1993] Reflection from layered surfaces due to subsurface scattering
Pat Hanrahan and Wolfgang krueger. SIGGRAPH 1993
[Hasan et al. 2006] Direct-to-indirect transfer for cinematic relighting
Milos Hasan et al. SIGGRAPH 2006
[Hawkins et al. 2005] Acquisition of Time-Varying Participating Media
Tim Hawkins, Per Einarsson, Paul Debevec. SIGGRAPH 2005
[Heeger and Bergeny 1995] Pyramid-Based Texture Analysis/Synthesis
David J. Heeger and James R. Bergeny. siggraph 1995
[Isaksen et al. 2000] Dynamically Reparameterized Light Fields
Aaron Isaksen, Leonard McMillan, Steven J. Gortler. SIGGRAPH 2000
[Jagnow et al. 2004] Stereological Techniques for Solid Textures
Robert Jagnow, Julie Dorsey, Holly Rushmeier. SIGGRAPH 2004
[Jensen et al. 2001] A Practical Model for Subsurface Light Transport
Henrik Wann Jensen, Steve Marschner, Marc Levoy, Pat Hanrahan. SIGGRAPH 2001
[Jensen and Buhler 2002] A Rapid Hierarchical Rendering Technique for Translucent Materials
Henrik Wann Jensen, Juan Buhler. SIGGRAPH 2002
[Khan et al. 2006] Image-Based Material Editing
Erum Arif Khan, Erik Reinhard, Roland Fleming, Heinrich Buelthoff. SIGGRAPH 2006
[Kuthirummal et al. 2006] Multiview Radial Catadioptric Imaging for Scene Capture
Sujit Kuthirummal, Shree K. Nayar. SIGGRAPH 2006
[Lawrence et al. 2006] Inverse shade trees for non-parametric material representation and editing
Jason Lawrence et al. SIGGRAPH 2006
[Levoy and Hanrahan 1996] Light field rendering
Marc Levoy and Pat Hanrahan. SIGGRAPH 1996
[Levoy et al. 2004] Synthetic Aperture Confocal Imaging
Marc Levoy, Billy Chen, Vaibhav Vaish, Mark Horowitz, Ian McDowall, Mark Bolas. SIGGRAPH 2004
[Lee et al. 2006] Geometry-Dependent Lighting
LEE, C. H., HAO, X., AND VARSHNEY, A. IEEE Trans. Visualization and Computer Graphics, Vol. 12, No. 2.
[Levoy et al. 2004] Synthetic Aperture Confocal Imaging
Marc Levoy, Billy Chen, Vaibhav Vaish, Mark Horowitz, Ian McDowall and Mark Bolas
[Levoy et al. 2006] Light Field Microscopy
Marc Levoy, Ren Ng, Andrew Adams, Matthew Footer, Mark Horowitz. SIGGRAPH 2006
[Li et al. 2005] Compressing and Companding High Dynamic Range Images with Subband Architectures
LI, Y., SHARAN, L., AND ADELSON, E. H. SIGGRAPH
[Lin et al. 2002] Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction
Zhouchen Lin, Tien-Tsin Wong and Heung Yeung Shum. IJCV 2002
[Loftus and Harley 2004] How different spatial-frequency components contribute to visual information acquisition
Geoffrey R. Loftus et al. Journal of Experimental Psychology: Human Perception and Performance. 2004
[Mallick et al. 2006] Specularity Removal in Images and Videos: A PDE Approach
Satya P. Mallick, Todd Zickler, David J. Kriegman, and Peter N. Belhumeur. ECCV 2006
[Malzbender et al. 2006] Surface Enhancement Using Real-time Photometric Stereo and Reflectance Transformation
Tom Malzbender, Bennett Wilburn, Dan Gelb, Bill Ambrisco. EGSR06
[Marschner et al. 2003] Light Scattering From Human Hair Fibers
Stephen R. Marschner, Henrik Wann Jensen, Mike Cammarano, Steve Worley, Pat Hanrahan. SIGGRAPH 2003
[Marschner et al. 2005] Measuring and Modeling the Appearance of Finished Wood
Steve R. Marschner, Stephen H. Westin, Adam Arbree, Jonathan T. Moond. SIGGRAPH 2005
[Masselus et al. 2003] Relighting with 4D Incident Light Fields
Vincent Masselus, Pieter Peers, Philip Dutre, Yves D. Willems. SIGGRAPH 2003
[Matusik et al. 2003] A Data-Driven Reflectance Model
Wojciech Matusik, Hanspeter Pfister, Matthew Brand, Leonard McMillan. SIGGRAPH 2003
[Matusik et al. 2004] Progressively-Refined Reflectance Functions from Natural Illumination
Wojciech Matusik, Matt Loper, and Hanspeter Pfister. EGSR 2004
note: new representation for reflectance fields, progressive refinement
[McGuire et al. 2005] Defocus Video Matting
Morgan McGuire, Wojciech Matusik, Hanspeter Pfister, John F. Hughes, Fredo Durand. SIGGRAPH 2005
[Moon and Marschner 2006] Simulating multiple scattering in hair using a photon mapping approach
Jonathan Moon and S. Marschner. SIGGRAPH 2006
[Narasimhan and Nayar 2003] Shedding light on the weather
Srinivasa G. Narasimhan and Shree Nayar. CVPR 2003
[Narasimhan et al. 2003] A Class of Photometric Invariants: Separating Material from Shape and Illumination
Srinivasa G. Narasimhan, Visvanathan Ramesh, and Shree K. Nayar. ICCV03
[Narasimhan and Nayar 2005] Enhancing resolution along multiple imaging dimensions using assorted pixels
S. G. Naraimhan et al. PAMI 2005
[Narasimhan et al. 2006] Acquiring Scattering Properties of Participating Media by Dilution
Srinivasa Narasimhan, Mohit Gupta, Craig Donner, Ravi Ramamoorthi, Shree K. Nayar, Henrik Wann Jensen. SIGGRAPH 2006
[Ng 2005] Fourier Slice Photography
Ren Ng. SIGGRAPH 2005
[Ngan and Durand 2006] Statistical acquisition of texture appearance
Addy Ngan and Frédo Durand. EGSR 2006
[Ostrovsky et al. 2005] Perceiving Illumination Inconsistencies in Scenes
OSTROVSKY, Y., CAVANAGH, P., AND SINHA, P. Perception
[Pas and Pont 2005] A comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres
Susan F. te Pas and Sylvia C. Pont. APGV 2005
[Peers and Dutré 2003] Wavelet environment matting
P. Peers and P. Dutré EGSR 2003.
[Peers et al. 2006] A compact factored representation of heterogeneous subsurface scattering
Pieter Peers et al. SIGGRAPH 2006
[Pharr and Hanrahan 2000] Monte Carlo Evaluation of Non-Linear Scattering Equations for Subsurface Reflection
Matt Pharr and Pat Hanrahan SIGGRAPH 2000
[Pont and Koenderink 2003] The Utrecht Oranges Set
Sylvia C. Pont and Jan J. Koenderink. Technical Report
[Premoze et al. 2004] Practical rendering of multiple scattering effects in participating media
Simon Premoze et al. EGSR 2004
[Ramamoorthi et al. 2006] A first order analysis of lighting, shading, and shadows
Ravi Ramamoorthi, Dhruv Mahajan and Peter Belhumeur. TOG 2006
[Ramamoorthi and Hanrahan 2001] A Signal-Processing Framework for Inverse Rendering
Ravi Ramamoorthi, Pat Hanrahan. SIGGRAPH 2001
[Ramamoorthi and Hanrahan 2001b] An Efficient Representation for Irradiance Environment Maps
Ravi Ramamoorthi and Pat Hanrahan. SIGGRAPH 2001
[Raskar et al. 2006] Coded exposure photography: motion deblurring using fluttered shutter
Ramesh Raskar, Amit Agrawal and Jack Tumblin
[Raskar et al. 2004] Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using a Multi-Flash Camera
Ramesh Raskar, Karhan Tan, Rogerio Feris, Jingyi Yu, Matthew Turk. SIGGRAPH 2004
[Rusinkiewicz et al. 2002] Real-Time 3D Model Acquisition
Szymon Rusinkiewicz, Olaf Hall-Holt and Marc Levoy. SIGGRAPH 2002.
[Rusinkiewicz et al. 2006] Exaggerated Shading for Depicting Shape and Detail
Szymon Rusinkiewicz, Michael Burns, Doug DeCarlo. SIGGRAPH 2006
[Schechner and Karpel 2004] Clear underwater vision
Yoav Y. Schechner et al. 2004
[Seitz et al. 2005] A Theory of Inverse Light Transport
S. Seitz, Y. Matsushita and K. Kutulakos. ICCV 2005
[Shacked and Lischinski 2001] Automatic Lighting Design using a Perceptual Quality Metric
SHACKED, R., AND LISCHINSKI, D. In Proc. Eurographics.
[Su et al. 2005] De-Emphasis of Distracting Image Regions using Texture Power Maps
SU, S., DURAND, F., AND AGRAWALA, M. In Proc. Workshop on Texture Analysis and Synthesis
[Sun et al. 2005] A Practical Analytic Single Scattering Model for Real Time Rendering
Bo Sun, Ravi Ramamoorthi, Srinivasa Narasimhan, Shree Nayar. SIGGRAPH 2005
[Tong et al. 2004] Shell Texture Functions
Yanyun Chen, Xin Tong, Steve Lin, Jiaping Wang, Baining Guo, Heung-Yeung Shum. SIGGRAPH 2004
[Tong et al. 2005] Modeling and Rendering of Quasi-Homogeneous Materials
Xin Tong, Jiaping Wang, Steve Lin, Baining Guo, Heung-Yeung Shum. SIGGRAPH 2005
[Tsumura et al. 2003] Image-Based Skin Color and Texture Analysis/Synthesis by Extracting Hemoglobin and Melanin Information in the Skin
Norimichi Tsumura, Nobutoshi Ojima, Kayoko Sato, Mitsuhiro Shiraishi, Hideto Shimizu, Hirohide Nabeshima, Syuuichi Akazaki, Kimihiko Hori, Yoichi Miyake. SIGGRAPH 2003
[Vasilescu et al. 2004] TensorTextures: Multilinear Image-Based Rendering
M. Alex O. Vasilescu, Demetri Terzopoulos. SIGGRAPH 2004
[Wang et al. 2005] All-frequency interactive relighting of translucent objects with single and multiple scattering
Rui Wang et al. SIGGRAPH 2005
[Weyrich et al. 2006] Analysis of Human Faces using a Measurement-Based Skin Reflectance Model
Tim Weyrich, Wojciech Matusik, Hanspeter Pfister, Bernd Bickel, Craig Donner, Chien Tu, Janet McAndless, Jinho Lee, Addy Ngan, Henrik Wann Jensen, Markus Gross. SIGGRAPH 2006
[Wood et al. 2000] Surface Light Fields for 3D Photography
Daniel N. Wood, Daniel I. Azuma, Ken Aldinger, Brian Curless, Tom Duchamp,Werner Stuetzle, David H. Salesin. SIGGRAPH 2000
[Wyman 2005] An approximate image-space approach for interactive refraction
Chris Wyman. SIGGRAPh 2005
[Xiao and Brainard 2006] Color perception of 3D objects: constancy with respect to variation of surface gloss
Xiao, B. and Brainard D. H. ACM Symposium on Applied Perception in Graphics and Visualization (APGV06)
[Yu et al. 2006] Sparse Lumigraph Relight by Illumination and Reflectance Estimation from Multi-View Images
Tianli Yu, Hongcheng Wang, Narendra Ahuja, Wei-Chao Chen. EGSR 2006
[Zhu and Yang 2004] Frequency-based environment matting
Jiayuan Zhu and Yee-hong Yang. Pacific Graphics 2004
[Zongker et al. 1999] Environment matting and compositing
D. Zongker, D. Werner, B. Curless, and D. Salesin
No comments:
Post a Comment