Police were called to the 9200 block of Ashton Road in Northeast Philadelphia just after 6 p.m.
They searched for the children for more than an hour before finding them at a relative's home in Bridesburg.
Police said the suspect fled but later returned to the home and was arrested.
According to police, he did not have custody of his daughter.