The dog's owner said the pup - named Bowie - got out on an icy pond at Carousel Park.
He initially fell through the ice, but was able to get himself out of the cold water.
RELATED: Tennessee woman jumps into frozen swimming pool to rescue dog
The dog was trapped in the middle of the pond and could not get back to shore.
The fire department was called and crews were able to bring the dog to safety.