Paper: IEEE CVPR (1994) “A vision system for observing and extracting facial action parameters”

June 21st, 1994 Irfan Essa Posted in Face and Gesture, PAMI/ICCV/CVPR/ECCV, Papers, Sandy Pentland No Comments »

Essa, I.A. Pentland, A. (1994), “A vision system for observing and extracting facial action parameters”,
In Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR ’94.),  21-23 June 1994, page(s): 76 – 83, 06/21/1994 – 06/23/1994, Seattle, WA, ISBN: 0-8186-5825-8 [Digital Object Identifier: 10.1109/CVPR.1994.323813][IEEEXplore#]

Abstract

We describe a computer vision system for observing the “action units” of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial structure. This modeling results in a time-varying spatial patterning of facial shape and a parametric representation of the independent muscle action groups, responsible for the observed facial motions. These muscle action patterns may then be used for analysis, interpretation, and synthesis. Thus, by interpreting facial motions within a physics-based optimal estimation framework, a new control model of facial movement is developed. The newly extracted action units (which we name “FACS ”) are both physics and geometry-based, and extend the well-known FACS parameters for facial expressions by adding temporal information and non-local spatial patterning of facial motion

AddThis Social Bookmark Button

Paper I3DG (1990) “The ThingWorld modeling system: virtual sculpting by modal forces”

March 13th, 1990 Irfan Essa Posted in Bradley Horowitz, Sandy Pentland, Stan Sclaroff No Comments »

The ThingWorld modeling system: virtual sculpting by modal forces

  • A. Pentland, I. Essa, M. Friedmann, B. Horowitz, and S. E. Sclaroff (1990), “The Thingworld Modeling System: Virtual Sculpting by Modal Forces,” ACM SIGGRAPH Proceedings of Symposium on Interactive 3D Graphics (I3DG), vol. 24, iss. 2, pp. 143-144, 1990. [PDF] [DOI] [BLOG] [BIBTEX]
    @Article{    1990-Pentland-TMSVSMF,
      author  = {A. Pentland and I. Essa and M. Friedmann and B.
          Horowitz and S. E. Sclaroff},
      blog    = {http://prof.irfanessa.com/1990/03/13/thingworld-i3gd1990/},
      doi    = {10.1145/91394.91434},
      journal  = {ACM SIGGRAPH Proceedings of Symposium on
          Interactive 3D Graphics (I3DG)},
      month    = {March},
      number  = {2},
      pages    = {143--144},
      pdf    = {http://www.cc.gatech.edu/~irfan/p/1990-Pentland-TMSVSMF.pdf},
      title    = {The Thingworld Modeling System: Virtual Sculpting
          by Modal Forces},
      volume  = {24},
      year    = {1990}
    }

Abstract

We describe a real-time solid modeling system that is based on the physical analogy of forming clay by applying forces. The system is implemented by simulating real materials as they react to user-supplied forces. Unlike other physically-based modeling approaches, the Thingworld system allows the user to restrict forming action to simple global deformations during the initial “roughing in” phase of modeling, and then later concern themselves with detailing. The Thingworld system also allows users to automatically model existing objects by using measurements taken from the object’s surface. These measurements are used to generate artificial forces that mold the computer model much as a human would mold a clay model. Timed examples for constructing solid models are shown.

via The ThingWorld modeling system: virtual sculpting by modal forces.

AddThis Social Bookmark Button