In a system for interactively viewing videos, a selected video is transmitted as a plurality of frames of digitized video data for playback on a viewing device. The system receives the transmitted video data and includes a memory buffer for storing a segment of a selected one of the videos. The segment includes a predetermined number of frames representing a predetermined time interval of the selected video. In addition, the memory buffer including a write pointer and a read pointer. Software controlled servers are provided for witting and reading video data of the selected video to and from the memory buffer, independently, at locations indicated by the write and read pointers to transfer the selected video to the viewing device. By using a remote controller the viewer can position the read and write pointers to view any portion of the selected video interactively.