This is a proposal for a motion control system for moving animated characters in a space. It is pretty impressive, because you don’t need to specify reactions based on specific conditions; the movement is computed by the system itself based on a value function. The transitions between different motion types are smooth.

However, this seems to be for walks on a plane. It is also too dependent on pre-made motion capture, as the walk cycles are not generated by the system.