Police said 33-year-old Denae Chavous of Upper Darby also resisted arrest when she finally returned to her vehicle Thursday.
When officers found the vehicle, they said the baby was in distress.
Police said Chavous had been shopping for more than 15 minutes.
Bail was set at $30,000 during arraignment.