Vision-based path following using the 1D trifocal tensor

Abstract

In this paper we present a vision-based path following algorithm for a non-holonomic wheeled platform capable of keeping the vehicle on a desired path using only a single camera. The algorithm is suitable for teach and replay or leader-follower implementations where the desired path is represented by a collection of images obtained along the path. The algorithm makes use of the 1D trifocal tensor to estimate parameters required for the path following controller through a structure from motion approach. Our algorithm provides the benefits of a position-based visual servoing method without having to explicitly recover the 3D structure of the environment. By using the trifocal tensor, the proposed algorithm overcomes several problems usually associated with visual servoing techniques. The singularities commonly encountered with image based visual servoing and epipolar methods are eliminated; and the unknown scale problem is also resolved by incorporating the scale into the control parameters. This simultaneously removes the velocity dependence of the controller gains and the need for odometric sensors on the platform. In addition, we also propose a novel method of resolving the ambiguities often associated with structure from motion when using the 1D trifocal tensor. The proposed algorithm is validated using both simulated and experimental results where robustness to a large degree of feature noise is demonstrated.