Officials from the Curran Fromhold Correctional Facility in Philadelphia say Jose Carrasquillo was asked to leave his unit around 7:00 p.m. Sunday night, but refused.
Four officers and a sergeant were forced to remove him, officials said.
They describe what happened next as a "use of force" incident, and Carrasquillo was taken to Frankford Aria Hospital.
Hospital officials say Carrasquillo is in a coma and in critical condition.
The prison says the incident is under investigation.
Carrasquillo is accused of raping an 11-year-old girl in the Kensington section of Philadelphia as she walked her sister to daycare on June 1st, 2009.
Police say Carrasquillo dragged the girl down an alleyway and brutally raped the child in a secluded backyard.
RELATED VIDEO: Rape suspect seen on surveillance video
A few days later he was spotted by two men who recognized him, attacked him, and held him until police arrived.
RELATED VIDEO: Carrasquillo's beating caught on video
Carrasquillo was also charged with groping a 16-year-old girl outside the Kensington Creative and Performing Arts High School on June 1st, just an hour before the rape of the 11-year-old.
After the girl was groped, police say the Carrasquillo went into the school, sat down in the cafeteria, and had breakfast.
