The incident happened at the Giant store in Muhlenberg Township, Pennsylvania.
Police say 30-year-old John Topper tried to hold up the food store but did not get away with any cash.
On his way out of the store, authorities say Topper threatened a cab driver with a knife and then made a woman drive him to Reading.
Police caught up with the suspect a few hours later.
There were no reports of any injuries.