In this paper we present a system that electromagnetically tracks the positions and orientations of multiple wireless objects on a tabletop display surface. The system offers two types of improvements over existing tracking approaches such as computer vision. First, the system tracks objects quickly and accurately without susceptibility to occlusion or changes in lighting conditions. Second, the tracked objects have state that can be modified by attaching physical dials and modifiers. The system can detect these changes in realtime. We present several new interaction techniques developed in the context of this system. Finally, we present two applications of the system: chemistry and system dynamics simulation. Keywords Tangible user interface, interactive surface, object tracking, two-handed manipulation, system dynamics, augmented reality

`Intrinsic' Hardware Evolution is the use of artificial evolution -- such as a Genetic Algorithm -- to design an electronic circuit automatically, where each fitness evaluation is the measurement of a circuit 's performance when physically instantiated in a real reconfigurable VLSI chip. This paper makes a detailed case-study of the first such application of evolution directly to the configuration of a Field Programmable Gate Array (FPGA). Evolution is allowed to explore beyond the scope of conventional design methods, resulting in a highly efficient circuit with a richer structure and dynamics and a greater respect for the natural properties of the implementation medium than is usual. The application is a simple, but not toy, problem: a tone-discrimination task. Practical details are considered throughout.

this paper we are concerned with how a user can write sequencer programs to effectively control the robot. Our emphasis is on issues of language and semantics: what is a good language for robot programs, what kind of semantics is appropriate for the sequencer, and how does the language fit the semantics. The result of our inquiries is the sequencer language Colbert, a part of the Sapphira architecture.

This thesis defines the boundaries of Software Architecture for Language Engineering (SALE), an area formed by the intersection of human language computation and software engineering. SALE covers all areas of the provision of infrastructural systems to support research and development of language processing software. In order to demonstrate the theory developed in relation to SALE, we present the design, implementation and evaluation of GATE, a General Architecture for Text Engineering, which illustrates in practice many of the theoretical points made.

Abstract not found

By giving users a way to vent, we transform their frustration into a valuable source of information for adapting interfaces. Drawing from psychophysiology and tactile sensing, we present frustration sensors as a way of incorporating user feedback into interface design processes. This thesis documents the development of designs for several sensors aimed at detecting user frustration with computers. Additionally the thesis explores the design space between active sensors that facilitate the communication of frustration and passive sensors that detect frustration without demanding the uattention. During evaluations we learned several things: * Participants liked having devices to communicate frustration. * The data that was collected during active and passive user interactions can be used for redesigning and adapting systems (either by hand, or automatically). * User behaved differently during usability problems. In a comparative study of three active designs (Frustrometer, Squeezemouse, and traditional feedback web page) we found that users prefer the Frustrometer to a web feedback page. Preliminary results suggest that frustration-stimulated behavior can also be detected through passive sensors. When combined with other contextual information, these sensors provide a crucial building block in systems that interact and adapt to human behavior by indicating where and when change is needed.

This paper describes CargoNet, a system of low-cost, micropower active sensor tags that seeks to bridge the current gap between wireless sensor networks and radiofrequency identification (RFID). CargoNet was aimed at applications in environmental monitoring at the crate and case level for supply-chain management and asset security. Custom-designed circuits and sensors were utilized to minimize power consumption and cost in a practical prototype. The CargoNet nodes are capable of asynchronous multimodal wakeup on exceptional events at extremely low power (Quasi-Passive Wakeup) with adjustable thresholds that adapt to dynamic environments. Accordingly, CargoNet has been seen to monitor, log, and report conditions inside a typical shipping crate while consuming under 25 microwatts of average power. To demonstrate the feasibility of the prototype system, several tests and deployments were conducted in the laboratory and aboard various transport conveyances.

Electronic neuromorphic devices with on-chip, on-line learning should be able to modify quickly the synaptic couplings to acquire information about new patterns to be stored (synaptic plasticity) and, at the same time, preserve this information on very long time scales (synaptic stability). Here, we illustrate the electronic implementation of a simple solution to this stability-plasticity problem, recently proposed and studied in various contexts. It is based on the observation that reducing the analog depth of the synapses to the extreme (bistable synapses) does not necessarily disrupt the performance of the device as an associative memory, provided that 1) the number of neurons is large enough; 2) the transitions between stable synaptic states are stochastic; and 3) learning is slow. The drastic reduction of the analog depth of the synaptic variable also makes this solution appealing from the point of view of electronic implementation and offers a simple methodological alternative to the technological solution based on floating gates. We describe the full custom analog very large-scale integration (VLSI) realization of a small network of integrate-and-fire neurons connected by bistable deterministic plastic synapses which can implement the idea of stochastic learning. In the absence of stimuli, the memory is preserved indefinitely. During the stimulation the synapse undergoes quick temporary changes through the activities of the pre- and postsynaptic neurons; those changes stochastically result in a long-term modification of the synaptic efficacy. The intentionally disordered pattern of connectivity allows the system to generate a randomness suited to drive the stochastic selection mechanism. We check by a suitable stimulation protocol that the stochastic synaptic pla...

The physical user interface is an increasingly significant factor limiting the effectiveness of our interactions with and through technology. This thesis introduces Electric Field Imaging, a new physical channel and inference framework for machine perception of human action. Though electric field sensing is an important sensory modality for several species of fish, it has not been seriously explored as a channel for machine perception. Technological applications of field sensing, from the Theremin to the capacitive elevator button, have been limited to simple proximity detection tasks. This thesis presents a solution to the inverse problem of inferring geometrical information about the configuration and motion of the human body from electric field measurements. It also presents simple, inexpensive hardware and signal processing techniques for making the field measurements, and several new applications of electric field sensing. The signal

A wireless sensing unit for use in a Wireless Modular Monitoring System (WiMMS) has been designed and constructed. Drawing upon advanced technological developments in the areas of wireless communications, low-power microprocessors and micro-electro mechanical system (MEMS) sensing transducers, the wireless sensing unit represents a high-performance yet low-cost solution to monitoring the short-term and long-term performance of structures. A sophisticated reduced instruction set computer (RISC) microcontroller is placed at the core of the unit to accommodate on-board computations, measurement filtering and data interrogation algorithms. The functionality of the wireless sensing unit is validated through various experiments involving multiple sensing transducers interfaced to the sensing unit. In particular, MEMS-based accelerometers are used as the primary sensing transducer in this study's validation experiments. A five degree of freedom scaled test structure mounted upon a shaking table is employed for system validation.