Gary Pohronezny has been charged with disorderly conduct, risk of injury to minors and interfering with police related to the alleged incident at St. James Catholic Church in Killingly on Wednesday.
Police say the 41-year-old Pohronezny was taken to Day Kimball Hospital in Putnam for evaluation.
It was not known Thursday morning if he is represented by a lawyer.
Pohronezny is scheduled to appear in Danielson Superior Court on Jan. 10.
