A pointing device, such as a mouse, touchpad or the pointing stick, has become an essential component of the modern computer system. As the number of portable computer users steadily increases so does the need for a compact and highly portable pointing device. The problem evident with existing pointing devices is that an increase in the portability of the device often results in the decrease of performance of the device and/or the comfort for the user.

The MoGo Mouse BT^TM of Newton Peripherals and the Slim G4 Mouse of DaoKorea were developed to improve the portability of the mouse by reducing its thickness down to 5mm enabling it to be neatly stored inside a PC card slot. However reduced graspability was indicated as their weak point, which ensued due to their very slim form.

To address this usability-portability trade-off problem a 5 person team of the Department of Industrial Design of the Korea Advanced Institute of Science and Technology has developed the Inflatable Mouse by essentially attaching an inflatable balloon on top of a slim mouse. The Inflatable Mouse is a volume-adjustable user interface. It connects to the computer through a USB port which can also be used to power its air pump. The air pump inflates the balloon up to the volume of a familiar mouse as needed, and deflates it entirely so it could be stored in the PC card slot of a portable computer when not in use. Apart from the standard functionalities of a mouse it also provides a new input modality of squeezing the mouse by sensing the air pressure inside the balloon, and also has multiple touch sensors on the top and both sides of the mouse. Changing pressure can be used for scrolling, selecting from a list etc.

Since the volume of the mouse can be promptly changed it can also be used as an output/display device, where a variety of dynamic expressions can be made, for instance simulating the beating motion of the heart.

For further reading and a video, check out:

• Inflatable mouse CHI 2008 paper
• Inflatable mouse youtube video

David Filipovic

Researchers at the Massachusetts Institute of Technology have developed a device that allows a user to transform virtually any surface into a multitouch computer. The name of this new technology is Project LuminAR, which is basically an embedded computer in a lamp. The LuminAR bulb contains a pico projector, a camera, and a computer with wireless connectivity - all packaged into an area not much larger than a digital camera. The LuminAR bulb uses a pico projector to display a computer interface (which would normally be seen on a liquid crystal display) onto any flat surface. A built-in camera detects and interprets movement from the user, and sends that data to the computer. The user can navigate and type on the interface using gestures and a graphical keyboard. This reduces the need for hardware such as a mouse, keyboard, and display that are necessities on any desktop or laptop PC. Another great feature of this device is that it plugs into a robotic lamp which has the ability to move around based on the user’s movements and gestures. The LuminAR bulb can also be installed in any household lamp.

Take a look at the original article from the IEEE here.

Devin Mullen

Recently, users of Project54 have reported that the USB devices connected to their in-car computers at random would not power up correctly. Typically, a system reboot would solve the problem and power up the devices, but this situation is not ideal. The police officers using the Project54 application need all USB devices to consistently perform, and rebooting their computers is time consuming. Carol Perkins and I set up a diagnostic test in which 5 USB devices, including a GPS, wireless antenna, touch screen monitor, video adapter, and scanner, were set up in 5 different USB port configurations with a CoolGear USB hub. As shown in the figure below, two devices, the video adapter and the Symbol Scanner DS6707, had issues booting up. The Symbol Scanner did not power on 14% of the 50 trial runs. Of these 7 failures, twice the device booted initially, but eventually powered down without instruction. The figure below also shows that the power failures occurred while connected to 4 different ports, so we concluded that the reported problem was not due to any power allocation problems within the USB hub. When powered correctly, this scanner performs exceptionally well, so users will be asked to unplug and then replug the scanner when a power up is not successful. 

- Erika Swanson

The image above is the combination of a transparent FTIR-based multi-touch surface and a motion control board, such as the one from Nintendo BalanceBoard, to create a navigation metaphor. Dimitar Valkov, Dr. Frank Steinicke, Gerd Bruder and Prof. Dr. Klaus Hinrichs built this while working for the Visualization and Computer Graphics Research Group at the University of Munster. They created it as an easier way to navigate through a 3D virtual world. It allows the users to visualize movement through tight spaces such as caves where actual locomotion would be difficult. While this illustration includes wheels, the user of the device is not actually moving on wheels. The wheels are just a metaphor for the movement controlled by the user with hand and foot gestures.

I was drawn to this article because of the multi-touch surface similar to the one we have here at Project54, although it is not the main focus of the apparatus. The key to this navigational device is the use of a motion control board because it’s less strenuous to use feet to specify direction and speed than continuously using hands. They have presented this device to six subjects who were able to quickly adapt to using their feet and provided positive feedback on the device. The users appeared to have a natural ability to incorporate the use of feet and hand gestures for navigating in a virtual environment. With intuitive ease of use, reduced strenuous and continuous motion control requirements, the device seems to have great potential in becoming incorporated in more interaction metaphors.

Carol Perkins

Below: A pico projector made by the Microvision company

In the near future we could see a revolution in mobile display technology. Miniaturized projectors called pico projectors will replace current projector models and will make displaying media from mobile devices much easier. With this advance in technology, our mobile media will no longer be limited to a two inch screen. Instead, we will have the capability to increase the display size of a mobile device to about eight feet. These projectors will give mobile phone users the ability to display content such as movies or photos on a screen larger than most televisions. Currently most pico projectors are standalone units that connect to mobile devices via a cable. In a couple of years we could see built-in pico projectors in a variety of devices, ranging from mobile phones to mp3 players.

Below: A visual representation of Liquid Crystal on Silicon (LCOS) Technology

There are currently three different types of technology that are used in these mini-projectors: liquid crystal on silicon (LCOS), scanning mirror, and digital-light processing. Liquid crystal on silicon technology uses liquid crystals that sit on top of a chip, where the top of the chip is coated with material that makes it act like a mirror. The liquid crystals change their orientation based on an electric field, which in turn changes the polarization of the light that shines through the crystals and reflects off of the chip. In scanning mirror technology, three laser diodes direct light through a lens to a set of microelectromechanical mirrors mounted on silicon. These mirrors move horizontally and vertically to direct the light and create a picture. In digital-light processing technology, there is a chip that contains millions of microscopic mirrors that tilt to create pixels. Red, blue, and green light is reflected onto the microscopic mirrors, and then by tilting each mirror toward or away from the light source the pixel can be turned on or off respectively.

Below: Depiction of Scanning Mirror Technology

Take a look at the original article from the IEEE here.

Devin Mullen

These Lycra gloves are part of a new MIT prototype for a new gesture-based computing system. Graduate student Robert Wang and Associate Professor Jovan Popović developed this system that improves upon other techniques that use interfaces that adapt to human movement, such as the Nintendo Wii. Lycra gloves made of irregularly shaped patches are part of a system that rapidly produces 3-D images of the gloves on the screen using a new algorithm to produce images in a fraction of a second. Rather than incessantly calculating individual sets of data to determine the position of a hand, instead the algorithm searches through a database of various hand positions and selects the corresponding digital model.

I think it’s especially interesting that the motions used to control the screen on a Multi-Touch Table, in my experience, are very similar to the motions used with this gesture-based system in a virtual world, as shown in the video below. This prototype is faster and less expensive than the current methods to track the movements of the human body, and has the potential to increase the usage of such technology in areas like evaluations of athletic performances, animation, and of course video games.

Erika Swanson