The human perception of environment condition is one of the aspects that greatly affect the use of open public space in a built environment. Studies related to the perception generally observe only one physical aspect in an isolated manner, in which the interrelationships between physical aspects are not considered. In the meantime, human beings are naturally multi-sensory and the human perception is exposed by multi-sensory stimuli that influence each other. This study tries to look at that relationship of multi-sensory stimuli to human perception, especially in the outdoor urban environment. In this study, we implement a semi-structured question to understand people's perception based on their memory of four outdoor urban area in Bandung. The questionnaire explores the relationship between three physical aspects, aural, thermal, and visual. Three main perceptions were found, comfort, spatial, and age/era. There is also evidence showing that multi-sensory stimuli affect the same perception, e.g. thermal and visual affect comfort perception. The finding of this study shows a preliminary evidence of multi-sensory perception in an urban area. This knowledge will be a powerful tool for understanding the perception of the urban environment and help in the process of urban area design and enhancement.