Smooth Stones Guide Your Exploration