Jonathan Wiseman was arrested late Saturday at a substance treatment center where he was seeking shelter.
Police say over the last month, Wiseman followed, threatened and harassed the woman, forcing her to move from her home out of fear for her safety. On Friday, police say Wiseman scratched the paint on the woman's car and smashed out the front windshield with a large stone.
Police say Wiseman made numerous threats against the woman and the father of her young daughter.
Warrants for stalking, harassment, offensive touching, theft and other criminal offenses were issued for Wiseman.