This paper analyzes the suitability of reinforcement learning (RL) for both programming and adapting situated agents. We discuss two RL algorithms: Q-learning and the Bucket Brigade. We introduce a special case of the Bucket Brigade, and analyze and compare its…

We develop a novel autonomous control synthesis strategy called Phase Space Navigator for the automatic synthesis of nonlinear control systems. The Phase Space Navigator generates global control laws by synthesizing flow shapes of dynamical systems and planning and navigating system…

We develop a qualitative method for understanding and representing phase space structures of complex systems and demonstrate the method with a program, MAPS --- Modeler and Analyzer for Phase Spaces, using deep domain knowledge of dynamical system theory. Given a…

If we are to understand how we can build machines capable of broad purpose learning and reasoning, we must first aim to build systems that can represent, acquire, and reason about the kinds of commonsense knowledge that we humans have…

It is obvious to anyone familiar with the rules of the game of chess that a king on an empty board can reach every square. It is true, but not obvious, that a knight can reach every square. Why is…

We describe the automatic synthesis of a global nonlinear controller for stabilizing a magnetic levitation system. The synthesized control system can stabilize the maglev vehicle with large initial displacements from an equilibrium, and possesses a much larger operating region than…

This thesis is based on the premise that small nations face unique challenges in the quest for economic prosperity. They have a small domestic economy and are more dependent than larger economies on international trade. Smallness typically entails a lack…

The collaboration of researchers in different fields, institutions, and nations continues to be important as new ideas and solutions result from the combination of different knowledge and experiences. The Cambridge MIT Institute (CMI) Online Project Assessment System(OPAS) aims to collect…

This thesis presents research about the potential business impacts of the Semantic Web. The concept of the Semantic Web is an expansion of the Web for computers, enabling them to comprehend the meaning of information. In addition, Semantic Web Services…

Heavily used in the manufacture of integrated circuits, chemical-mechanical polishing (CMP) is becoming an enabling technology for microelectromechanical systems (MEMS). To reliably use CMP in the manufacturing process, designers must be able to accurately predict the CMP process and control…