Paper: ACM NPAR (2003) “Image and video based painterly animation”

June 7th, 2004 Irfan Essa Posted in Computational Photography and Video, James Hays, Non-Photorealism, Outdated, Papers No Comments »

James Hays and Irfan Essa (2004) “Image and video based painterly animation” In Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering (NPAR 2004), Annecy, France, June 7-9, 2004, pages, 113 – 120, ISBN:1-58113-887-3, 2004 (DOI|PDF|Project Web Site).

  • J. Hays and I. Essa (2004), “Image and video based painterly animation,” in Proceedings of ACM Conference on Non-photorealistic animation and rendering (NPAR), New York, NY, USA, 2004, pp. 113-120. [BIBTEX]
    @InProceedings{    2004-Hays-IVBPA,
      address  = {New York, NY, USA},
      author  = {J. Hays and I. Essa},
      booktitle  = {Proceedings of ACM Conference on Non-photorealistic
          animation and rendering (NPAR)},
      pages    = {113--120},
      publisher  = {ACM Press},
      title    = {Image and video based painterly animation},
      year    = {2004}


We present techniques for transforming images and videos into painterly animatiPinkFlowerNPARons depicting different artistic styles. Our techniques rely on image and video analysis to compute appearance and motion properties. We also determine and apply motion information from different (user-specified) sources to static and moving images. These properties that encode spatio-temporal variations are then used to render (or paint) effects of selected styles to generate images and videos with a painted look. Painterly animations are generated using a mesh of brush stroke objects with dynamic spatio-temporal properties. Styles govern the behavior of these brush strokes as well as their rendering to a virtual canvas. We present methods for modifying the properties of these brush strokes according to the input images, videos, or motions. Brush stroke color, length, orientation, opacity, and motion are determined and the brush strokes are regenerated to fill the canvas as the video changes. All brush stroke properties are temporally constrained to guarantee temporally coherent non-photorealistic animations.

AddThis Social Bookmark Button

Paper: ACM SCA (2002): “Controlled animation of video sprites”

August 1st, 2002 Irfan Essa Posted in Arno Schödl, Computational Photography and Video, Outdated, Papers, Research No Comments »

Controlled animation of video sprites

  • Arno Schödl and Irfan Essa (2002), “Controlled animation of video sprites” Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation. ACM Press, Pages: 121 – 127 July 2002, San Antonio TX, ISBN:1-58113-573-4.  (DOI|PDF|WebSite)


We introduce a new optimization algorithm for video sprites to animate hamstersrealistic-looking characters. Video sprites are animations created by rearranging recorded video frames of a moving object. Our new technique to find good frame arrangements is based on repeated partial replacements of the sequence. It allows the user to specify animations using a flexible cost function. We also show a fast technique to compute video sprite transitions and a simple algorithm to correct for perspective effects of the input footage. We use our techniques to create character animations of animals, which are difficult both to train in the real world and to animate as 3D models.

AddThis Social Bookmark Button