That statement came following a preliminary hearing Thursday.
Police say Wilmer Ortiz Torres held a grudge against Iglesia Pentecostal De Bethlehem for kicking him out of the congregation.
He reportedly set the fires, back in April, to retaliate.
The first blaze gutted the church's sanctuary.
The second one damaged the roof.
The Northampton County District Attorney says 43-year-old Torres has some mental health issues.
He remains in jail on several charges, including arson.