Viewing and manipulating 3D virtual objects are two of the most common tasks for many computer users such as designers and architects. In this paper, we proposed a movable handheld spherical display system known as Dynamic Sphere. It uses a projector to project digital content onto an ordinary Styrofoam sphere surface without any special patterns printed on it, or any connected wires and special sensors attached to it. Users can observe different views of the virtual 3D object by simply rotating the sphere. Such a system can give the user greater freedom of control such as a 360-degree manipulation of the 3D model. It means the user can view and manipulate the virtual 3D object as natural as interacting with a real object. The implementation of the system is based on the combination of computer vision and insect vision model. Experimental results show that our system can allow the user to view and directly manipulate a 3D virtual object on a movable sphere.