Police released surveillance video Wednesday of the crime that took place around 11 p.m. on August 21 inside Our Lady of Calvary at 11024 Knights Road.
His first attempt was unsuccessful, but then he went to this back door where there were no surveillance cameras.
Once inside, he stole money from two donation boxes, ripping one off a wall.
"I feel sorry for the man who did it if he needs it that badly in a way, but I feel more sorry for the people that lost out on the money in the poor box," parishioner Mary Somma said.
"It's terrible that people would think so little of the church," parishioner Susan Guest said.
Investigators believe the suspect may be responsible for a half dozen other burglaries over the past two weeks.
Often he uses a rock or brick to break windows.
In the Calvary burglary, he allegedly used to a planting pot.
"He has a bandage on his arm and his leg. We are hoping someone does the right thing and gives us the tip," Philadelphia Police Lt. Dennis Rosenbaum said.
Police estimate the total stolen to be $1,000.
Anyone with information should contact Philadelphia police.