Videos

Tongue Control Technology

Think-A-Move's patented earpiece, along with proprietary noise cancelling algorithms and specialized software, allows a user to control devices covertly with the flick of their tongue. Currently, tongue control can be demonstrated on iRobot's PackBot, as seen in the videos below, as well as on the e-macc wheelchair.

The TAM system for tongue control has several exciting features including:

• Platform independent software, supporting integration with other software or technology
• Specialized, proprietary software, including a recordable database of tongue signals.
• User dependency; train a profile similar to speech recognition software
• Quick training curve; create a database in under 30 minutes.

In addition, the same series of noise-cancelling algorithms used for communications eliminate noise and allow an operator to control a device in any surroundings, using only the flick of a tongue.

How it works
Tongue motions inside the mouth produce traceable acoustic patterns in the ear canal. Different types of movement, differing in location and speed, produce unique patterns. To use tongue movements for device control, repeatable and comfortable movements, which produce consistent acoustic patterns, need to be identified. As an example, the figure below shows three different tongue motions and the corresponding acoustic signals.

Different tongue movements produce unique waveforms

The acoustic patterns generated by tongue motions generally reside in the 20 Hz to 100 Hz frequency range (i.e., most of their energy is in this range). The major portion of the acoustic signal, from start to finish, generally completes within 200ms (0.2 s). This is easily differentiated from speech, which generally resides above 100 Hz and can last much longer than 0.2 seconds.

To learn more, please download the Technology Overview.

Please note: These videos may take a while to load depending on your browser, media player, or connection speed. Please be patient.

SPEAR Demonstrations:
SPEAR PackBot Demonstration October 2008
Speech Control of an iRobot PackBot in Noise January 2009
SPEAR Speech Command Confirmation January 2009
SPEAR Speaker Profile Training March 2009
Integration of SPEAR with iRobot PackBot Aware 2.0 - AMREL Rocky OCU June 2009
Speech Control of a QinetiQ North America MAARS Platform July 2009

Earlier Work:
Speech Control of an iRobot PackBot July 2007
Speech Control Under Noisy Conditions July 2007

Research & Development Work:
Speech Control of a Power Wheelchair November 2007
Using Tongue Movements to Control iRobot PackBot Part I September 2007
Using Tongue Movements to Control iRobot PackBot Part II September 2007

Think-A-Move, Ltd. • 23715 Mercantile Rd., Suite 100 • Beachwood, OH 44122
Ph: 216.765.8875 • Copyright © 2007 All Rights Reserved