Gundy was spotted by the officers in the 800 block of North Olden Avenue at the Exxon Gas Station at the time of his arrest on Monday.
The assault happened at 6:15 a.m. Sunday at the bus stop near the corner of West State and North Warren streets.
A woman sitting at the bus stop was approached by a man with a gun. He forced the woman to walk with him to a nearby alley where he made her perform oral sex. He then fled the scene.
The victim was taken to St. Francis Medical Center in Trenton for treatment.
The suspect is described as a black male wearing a white t-shirt and a white wrap on his head.
A description of the suspect was broadcast and Detective Scott Peterson was assigned as the lead detective for this investigation.
The investigation continued and enough probable cause was gathered to issue warrants for Gundy's arrest.