The 37-year-old victim told police it happened after she met her alleged attacker at a block party.
The woman told investigators the man had keys to the Simons Recreation Center located in the 1600 block of East Walnut Lane where he let her into the building so she could use the restroom.
That is when the alleged attack took place.
Detectives say the man is a board member of the recreation center.
Philadelphia Special Victims Unit is investigating the incident.