Kobito Virtual Brownies is one of the coolest demos of augmented reality that I have seen. This gave me a funny feeling that reminded me of the fairy-tale stories of elves.
What we have for the demo is a table, a small cubical box, and an LCD screen in front of the table.
The box keeps moving in a random way on the table.. all by itself, nobody touching it ! When you look into the LCD, you find a gang of 3 lilliputian like creatures (called
Kobitos) jumping around on the table and pushing the box.
Now the really freaky part is that you can pick up the box and push it around. If you look in the LCD, you find that the kobitos are getting pushed by the box. The LCD functions like some kind of a magical mirror !!
The kobitos are AI characters and they are programmed to jump and frolick on the table and push the box once in a while. The display is generated by capturing the scene on the table through a camera and blending the CG characters of the kobitos into the scene through augmented reality.
Technically, they did a very good job, with occlusions and shadows being handled very well. The animation of the kobitos is also done impressively.
What moves the box by the way !? It is an electro-magnet that sits under the table and listens to the instructions from the kobito computer program. Coooool!
Salutes to
Dr.Makoto Sato and his team from the Tokyo University of Technology. Take a look at their page. Though it is in Japanese, it has one cool flash movie of the demo. Also available is a detailed (English) document of their demo.