This paper designs the tracking and positioning system for ship based on binocular vision and finishes the corresponding algorithm.This algorithm contains four modules,namely camera calibration,object tracking,stereo matching and disparity locating.The tracking module tracks and gives object bounding as a result,the matching module carries out the binocular stereo matching in the tracking window,and the disparity locating uses the pixel location corresponding to the stereo matching to calculate the object's coordinate in physical space,which can reduce matching time.Results indicate that the design works well in real-time tracking and gives the accurate location of object,which meets the application requirements.This system can complete the task of tracking and positioning of dynamic target and provide rich information of 3D image at the same time,which has great application value.