The accident happened around 3:30 a.m. on the 2200 block of Ben Franklin Parkway.
Police say 34-year-old Terrence Smith was speeding off the Vine Street Expressway (I-676), drove the vehicle through a stop sign when it hit a curb and went airborne.
The car then slammed into the building, knocking a hole in the wall.
One resident said she felt the impact inside her apartment.
"I was watching TV, heard screeching brakes, then felt a bang. I was like 'I think somebody just hit the building," said resident Amy Pyles. "I ran to the basement and it was filled with smoke and plaster - you could smell it."
"So, I ran out here and no one else was here except the guys getting out of the car. I was like 'Are you guys all right? Then I look over and there's a big hole in my building."
Smith was taken into custody and transported to Hahnemann University Hospital for minor injuries. He is being charged with DUI.
The passenger was a 33-year-old male who was also taken to Hahnemann with a broken arm.