This paper analyzes the suitability of reinforcement learning (RL) for both programming and adapting situated agents. We discuss two RL algorithms: Q-learning and the Bucket Brigade. We introduce a special case of the Bucket Brigade, and analyze and compare its…

We develop a novel autonomous control synthesis strategy called Phase Space Navigator for the automatic synthesis of nonlinear control systems. The Phase Space Navigator generates global control laws by synthesizing flow shapes of dynamical systems and planning and navigating system…

We develop a qualitative method for understanding and representing phase space structures of complex systems and demonstrate the method with a program, MAPS --- Modeler and Analyzer for Phase Spaces, using deep domain knowledge of dynamical system theory. Given a…

It is obvious to anyone familiar with the rules of the game of chess that a king on an empty board can reach every square. It is true, but not obvious, that a knight can reach every square. Why is…

We describe the automatic synthesis of a global nonlinear controller for stabilizing a magnetic levitation system. The synthesized control system can stabilize the maglev vehicle with large initial displacements from an equilibrium, and possesses a much larger operating region than…

This paper describes a new statistical, model-based approach to building a contact state observer. The observer uses measurements of the contact force and position, and prior information about the task encoded in a graph, to determine the current location of…

We report the creation of strained silicon on silicon (SSOS) substrate technology. The method uses a relaxed SiGe buffer as a template for inducing tensile strain in a Si layer, which is then bonded to another Si handle wafer. The…

(cont.) outlined. 2. Demonstration that computer systems can use the discovered relations among data items to help users search for relevant information, prioritize the data exchange between collaborating users, and visualize data in various ways. This investigation looks at how…

Oligomeric mini-proteins, short peptides with protein-like features, constitute valuable minimal models for the study of oligomeric proteins. Oligomerization is a common feature of cellular proteins that may confer structural and functional advantages. Oligomerization is proposed to have arisen by several…

(cont.) visualize complex geometric arrangements. Finally, the tools developed represent an alternative to what learning technology has always done; transmit academic knowledge to the student. These tools are an example of how IT can be used to go beyond the…