mapping, augmented

technical requirements

  • • A fast computer (pc, mac or linux) with a decent graphics card (i.e. 3d acceleration) and up-to-date drivers.
  • • Java, version 1.4 or greater (installable from here...)
  • There might be some issues on certain mac and linux boxes. Please contact if something is not working as intended.

alternative view


related works


dreaming of...

  • 3d space definition as a meta-data channel available on suitable flickr photos...
  • Artoolkit markers (side by side with space-invaders mosaics) placed on city walls in order to provide 3d space coordinates for real-time outdoor surface augmentation...
  • • A by folks / for folks bridge between a mature version of Microsoft's Photosynth and flickr...
A study on the aesthetics of mapping in the context of augmented reality, cooked with three major ingredients:

  • • Flickr: outstanding source of photographic material, by folks / for folks.
  • • Camera matching: the art of turning pictures into 3d spaces.
  • • Real-time 3d flow of text and textures over surfaces.

ho Tokyo, Tokyo


Camouflage texture coupled with biblical oracle on the siege of Jerusalem (Isaiah 29:1-8), flowing over the facade of a Bauhaus style building, presumably in Tokyo...

control

  • • Zoom in-and-out with the mouse-wheel (or with the up and down arrows).
  • • Drag with the mouse to pan inside the picture.
  • • Press the space-bar to reveal the underlying photo.


The original photo, as found on Kimi Iwasaki's flickr photostream.

rock around the bunker


Camouflage texture coupled with lyrics by Serge Gainsbourg, flowing over the protuberant boxes on the facade of the musée du quai Branly, Jean Nouvel's latest Parisian coup.

control

  • • Zoom in-and-out with the mouse-wheel (or with the up and down arrows).
  • • Drag with the mouse to pan inside the picture.
  • • Press the space-bar to reveal the underlying photo.


The original photo, as found on bourget_82's flickr photostream.

freestyle 1 (from Weimar to Kingston)


Black and white travelling on Bauhaus balcony followed by rasta-stripped redempting deluge.

control

  • • Press the space-bar to restart animation.

freestyle 2 (décamouflé de Branly)


Fleur de lis textured half-boxes, with matching speechless descending caps...

control

  • • Press the space-bar to restart animation.

a brief overview of what it takes to...

First, a camera matchable picture must be selected: it implies the presence of a three point perspective, materializable through at least 3 orthogonal sets of parallel lines (as in the leftmost image...)


In some cases, where results are not coherent, there's a need to correct lens distortion (roll-over the rightmost image to reveal the undistorted version...) For such a purpose, the following software proved to be efficient:


Then, takes place an iterative process of guessed modelization and fine tuning of the vanishing points convergence. The following papers were helpful in the process of developing a custom camera matching software toolkit capable of retrieving 3d information out of single images:


Finally, once a 3d space has been defined, the evergrowing chronotext software toolkit is used to make text and textures flow indefinitely over the target surfaces.

credits, thanks and copyright information

  • • Thanks to all the people who helped with bug hunting.
  • • Thanks to bourget_82 for granting rights to use her photo of the Branly museum.
  • • The lyrics mapped on the Branly museum are from Serge Gainsbourg's Rock around the bunker, 1975.
  • • The Tokyo building photo by Kimi Iwasaki is under this creative commons license.
  • • The copyright notice for the biblical text mapped on the Tokyo building can be found at the bottom of this page.
  • • The camouflage texture was generated using VanDerLee's Camouflage plugin.
© january 2007  ariel malka | chronotext.org