In Key West I recommend the Hemingway home, Mel Fisher Museum, walk down to Key West Bight and eat at the Half Shell Raw Bar. Rent a scooter and cruise the island. They make it a lot easier to get around. Just don't park in the wrong area because they will give you a $35 ticket. Not that I have ever had one.
Also stop at Worldwide Sportsman at Ilsamorada.