Reidy was yelling from the rostrum Wednesday just below where the House presiding officer sits. The microphone she was yelling into was off.
Lawmakers said she was yelling about the devil and the House being divided. Texas Democratic Rep. Joaquin Castro said she had a crazed look on her face.
As she was led into an elevator by security, she was heard to shout, "This is not one nation under God. It never was."
Reidy also screamed, "Praise be to God, Lord Jesus Christ."
The outburst occurred while the House was voting on legislation ending the government shutdown and extending the federal debt limit.