he remembered stopping on a hillside just opposite a town called san gimignano , a collection of rust-colored buildings dotted here and there with high towers whose tops soared upward as if reaching for the sky .