Crews responded to the federal court building in the city's historic district around 9:25 a.m. Wednesday.
Fire officials evacuated people from the second floor, but people on other floors remained in the building.
An official said a letter was found, but the investigation revealed it did not contain anthrax or any other dangerous substance.
The FBI has cleared the scene.