First and second L-shaped brackets are secured to first and second computer peripheral units. The upright back portions of both of the brackets have holes or openings in them. With the first unit stacked on the second and their respective brackets aligned, a first male member of a connector device is snap fit in a hole in one of the brackets and a second male member of that device is snap fit in a hole in the other bracket. The two brackets and connector device form a connector assembly, which with (three) other similar assemblies, hold the stacked unit together. Bottom members, top cap members and/or center members can be snap fit onto the brackets to provide flexibility in use and to provide a smooth attractive outer appearance. According to one preferred embodiment, the assemblies can be disassembled without tools. The brackets, connector device, and the other members can be sold as a kit together with differently-sized brackets to accommodate different sizes (heights) of units.