Paper route maps are common for tools assisting walking tours, but they are not so kind to readers. Some commercial mobile applications for walking tours are available; it is difficult in manual operation for maps. There are fewer frameworks to integrate multiple hand-drawing well-designed maps with GPS and other digital content such as photographs and audios. In this paper, we proposed a new framework for supporting walking tours with stories and maps implemented on a smartphone. The main purpose of the tool is easiness for operating the device and for finding and acquiring necessary information. Design method of map-based storytelling allows users to smoothly interact with mobile devices with location-based pull style information service. We discuss the feasibility and usefulness of our proposed framework by implementing real mobile software and testing real applications in the real world.