Three dimensional geographic data is getting important. For those applications such as 3-D city model, landscape visualization, selection of base station for telecommunication, the topographic data is indispensable. Photogrammetric mapping technology is still the major approach for 3-D topographic mapping. The technology has evolved from analogue to analytical one and now toward automation. In the automation, aerial triangulation has been successful and in operation. On the othe hand, the automated determination for ground object is still in the early stage. Reconstruction of man-made building, in particular, is the major task in the photogrammetric automation. On the contrary to natural objects, man-made buildings are with regular boundaries and elevation drops. Thus, it is needed to extract corner points, edges, regions, and elevation distribution in reconstruction for man-made buildings. This investigation uses aerial color stereoscopic images to reconstruct those buildings. Considering spectral and geometric characteristics, the components of the reconstruction are:(l)color transformation, (2)region growing, (3)edge detection, and (4)corner detection. Finally, we develop a CLR matching algorithm which uses three windows to determine and to validate the disparities for the building boundaries.