The wild scene played out on the 2000 block of Hilltown Pike in Hilltown Township around 11 a.m.
Investigators say the incident started with some type of altercation involving a man and accused rapist, Curtis Fish.
Officials tell Action News that the suspect also tried to break into the Crossroads Tavern before fleeing into his home nearby.
Crossroads Tavern owner Mike Mrozinski was inside and watched most of it happen.
"He's not himself. I've known him for 16 years and he's not the same guy I had known him to be," said Mrozinski.
Mrozinski says police tried to tase him but it didn't work.
Video reportedly shows Fish setting off fireworks toward officers. Moments later, the residence went up in flames.
"Fireworks outside and fireworks inside. So I believe that's what lit the house on fire," Mrozinski said.
Bucks County District Attorney Matthew Weintraub told Action News he fought Fish's release from prison due to the COVID-19 concern.
He was behind bars after police said he raped and kidnapped a woman this past New Year's Day.
Mrozinski said, "He shouldn't have been let loose. This is what happens. Whatever he was doing at the time he went right back to it."
No officers were hurt during Tuesday's incident.