In between midnight summer nights and dark winter days

Interacting with wall-sized displays Fri, Jan 25 2008 15:43

Happy new year, fellow readers! On the front-page of I state that "by day I work towards a PhD in Computer Science ... by night, I run this company." This post is about my day job. The past year or so, I've been researching ways of enabling device-free interaction with high-resolution, wall-sized displays. Let's first take a step back and consider what it means for a display to be wall-sized. The display wall I work with every day measures about 6m x 3m. 28 projectors are tiled in a 7x4 grid to produce a display with a total resolution of 7168x3072 pixels (in comparison, a 30" Apple Cinema Display sports a resolution of just 2560x1600 pixels. Hah!).

These past few days, I've uploaded my two very first videos to YouTube, both of which touch on parts of my research into interaction mechanisms for display walls. The first video demonstrates how you can navigate vast amounts of information using a touch-free interface. 16 cameras mounted along the floor enables the system to triangulate the position of objects - finger, hands, and so on - intersecting a plane parallel to the display wall. The system can detect multiple objects simultaneously, effectively making it a "multi-touch-free" system. (I refer to it as touch-free, since users don't have to actually touch the display wall's canvas in order to interact.)

Three years of the comic "M" (Watch on YouTube)

My second video was made for the Workshop on Human-Computer Interaction at ICCV in 2007, and now I have finally gotten around to polishing it with some subtitles and nice (well, to my ears anyway) music from the ModArchive. It demonstrates how far-away ("distal") targets can be reached by pointing at them, and then snapping or double-snapping to bring them closer. Once the targets are up-close, further interaction can take place using the aforementioned touch-free interface. Some notable highlights in the video include using the touch-free interface to play Quake 3 Arena :-)

Hybrid vision- and sound-based interaction with display walls (Watch on YouTube)

Enjoy the videos, and stay tuned for an upcoming video demonstrating "The 22 Megapixel Laptop."

Previous: Interesting Finder bug Next: How-to: Reverse engineering the Dock to fix Spaces

About me
My name is Daniel Stødle. I live in Tromsø, Norway, at 69.66° North. By day, I work as a researcher at the Northern Research Institute in Norway; by night, I run my company SCSC. I do most of my development on and for Mac OS X. My research is geared towards interaction with and visualization of geospatial data. Read more on my personal page.


Contact me

Recent posts

Jul 28: Running iTunes in a debugger (gdb)
Jul 25: The /Volumes/MobileBackups directory
Jul 20: FolderGlance 3.0.1 supports Lion
Mar 03: Quick tip: Speeding up Xcode compilations
Mar 02: FolderGlance 3.0
Jan 07: Making Universal Back Button work on 10.6.5 and later

Sep 03: Creating pthreads in C++ using pointers to member functions
May 31: Quickly open URLs in Terminal
May 31: Snow Leopard and automatically submitted Crash Reports
May 27: Universal Back Button released for Mac OS X
May 22: The 22 Megapixel Laptop
Feb 09: FolderGlance on MacUpdate Promo

Sep 28: FolderGlance 2.5.3 is out
Sep 21: FolderGlance 2.5.1 adds features and fixes bugs
Sep 16: FolderGlance 2.5 released!
Sep 10: Intriguing: Snow Leopard ships with the iPhone's multi-touch API built-in
Sep 03: FolderGlance and Snow Leopard
Mar 15: Fixing Keynote '08 and '09 to work with the Scripting Bridge
Feb 26: A website in an image
Feb 09: Display wall multi-touch

Feb 19: Spaces.. Spaces.. Spaces.. retires
Feb 08: How-to: Reverse engineering the Dock to fix Spaces
Jan 25: Interacting with wall-sized displays

Dec 20: Interesting Finder bug
Dec 06: Developing applications for the iPod touch (and the iPhone)
Nov 15: Spaces.. Spaces.. Spaces.. and 10.5.1
Nov 15: Thread creation using pthread_create() on Leopard
Nov 13: Spaces.. Spaces.. Spaces..
Nov 07: FolderGlance, Leopard and the More... menu
Nov 06: FolderGlance and Screen Sieve now also on Leopard!
Sep 16: Mysterious window server hangs


RSS feed

Blog frontpage