This paper proposes a method for removing image inconsistencies which occur by an existence of moving objects or a change of illumination condition when an omnidirectional image database is generated. The database is used for archiving an outdoor scene in wide areas or generating novel view images with an image-based rendering approach. In related work, it is difficult to remove moving objects in an outdoor environment where illumination condition drastically changes, and to remove inconsistencies of color tone of images which included moving objects. The proposed method iterates the two processes which are the estimation of candidate region of moving objects and the achievement of color consistency to split regions. The color consistency is achieved by estimating linear color transformation parameters which change a histogram of an input image to that of the standard image.