This paper treats an intelligent and intuitive interface for the construction of 3D composite objects. The manual construction of 3D composite objects takes a long time because 3D objects have six degrees of freedom (DOF) and are difficult to be controlled by using a standard 2D input device, e.g., a mouse device. To deal with this problem, the authors have already proposed an automatic 3D object layout system based on contact constraints. In this paper, the authors propose manipulation guide functionality based an the same contact constraints for the construction of 3D composite objects. Since this manipulation guide functionality works with DeMoCa, a video based hand motion tracking and hand posture recognition system already proposed by the same authors, it provides an intuitive interface.