| 1. |
- Jones, Andrew, et al.
(författare)
-
Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array
- 2016
-
Ingår i: PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016). - : IEEE. - 9781509014378 ; , s. 927-935
-
Konferensbidrag (refereegranskat)abstract
- We present a system for creating and displaying interactive life-sized 3D digital humans based on pre-recorded interviews. We use 30 cameras and an extensive list of questions to record a large set of video responses. Users access videos through a natural conversation interface that mimics face-to-face interaction. Recordings of answers, listening and idle behaviors are linked together to create a persistent visual image of the person throughout the interaction. The interview subjects are rendered using flowed light fields and shown life-size on a special rear-projection screen with an array of 216 video projectors. The display allows multiple users to see different 3D perspectives of the subject in proper relation to their viewpoints, without the need for stereo glasses. The display is effective for interactive conversations since it provides 3D cues such as eye gaze and spatial hand gestures.
|
|
| 2. |
- Wenger, Andreas, et al.
(författare)
-
Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination
- 2005
-
Ingår i: ACM Transactions on Graphics. - : Association for Computing Machinery (ACM). - 0730-0301 .- 1557-7368. ; 24:3
-
Tidskriftsartikel (refereegranskat)abstract
- We present a technique for capturing an actor’s live-action performance in such a way that the lighting and reflectance of the actor can be designed and modified in postproduction. Our approach is to illuminate the subject with a sequence of time-multiplexed basis lighting conditions, and to record these conditions with a highspeed video camera so that many conditions are recorded in the span of the desired output frame interval. We investigate several lighting bases for representing the sphere of incident illumination using a set of discrete LED light sources, and we estimate and compensate for subject motion using optical flow and image warping based on a set of tracking frames inserted into the lighting basis. To composite the illuminated performance into a new background, we include a time-multiplexed matte within the basis. We also show that the acquired data enables time-varying surface normals, albedo, and ambient occlusion to be estimated, which can be used to transform the actor’s reflectance to produce both subtle and stylistic effects.
|
|
