The Atlantic City-based agents had been searching the Vineland area Thursday for 44-year-old James Perry Turnage Jr. when they decided to take a break.
While in line at the store, one agent noticed another patron resembled Turnage. The agent returned to his car and waited with his colleagues, who saw Turnage leave in a car with South Carolina plates that didn't match the vehicle.
Turnage soon realized he was being followed and tried to evade the agents, but was captured about two miles away after he turned down a dead end street.
A former Vineland area resident who lives in Yulee, Turnage was being held in the Cumberland County Jail pending extradition to Florida.