Mountainous relief can affect the growth and distribution of vegetation. This must be considered when using remote sensing techniques to detect forest vegetation. This study use factorial experiment method to examine the effects of relief factors and land cover on TM data. It aims to upgrade the efficiency of forest monitoring by use of the satellite image. Relief factors used in this study are aspect, slope, surface roughness, sky view factor (SVF), terrain configuration factor (TCF), and direct light ratio (DLR). Results reveal that there are significant relationships between these relief factors, in which the spectral information explained by the aspect was different from the others. The infrared band (TM4) data is most sensitive to aspect variation in all of the TM bands. Few TM data variation explained by SVF, DLR, and TCF in the case of land cover, aspect, surface roughness, and slope factors exist. So, these three factors could be neglect in related forest studies with remote sensing. The significant interactions between land cover, aspect, surface roughness, and slope factors have proven that vegetation could have very different spectral value in different conditions of such factors. That is why low classification accuracy occurs in most of the forest studies with satellite image in Taiwan. Surface roughness is present for the relief information in a pixel and is an important factor, which could affect the variation of TM data. Therefore, it is necessary to generate a better precision of DTM data. After that a more perfect experiment could conduct to get a better understanding of mountainous conditions. Based on the pre-list findings, we select a lot of training samples to accomplish maximum likelihood classification. The overall accuracy is about 90 percent. The spectral characteristics of conifer and broad-leaf trees are very similar, but the green and the first mid-infrared band data (TM2 and TM5) still could distinguish them. Red, infrared, and the second mid-infrared channel data could extract tea field, grass, and farmland. The spectral characteristics of bamboo and bare land are very distinctive from other cover type in all reflective TM bands.