Firefighters were called out to the 3400 block of Cramer Street around 3:15 a.m. for reports of people trapped inside a three-story apartment.
According to the Camden County Prosecutor's Office, Brandon Adams, 34, who is homeless, is being charged with first-degree felony murder for intentionally setting the fire.
Firefighters said when they arrived they saw flames shooting from the building and a person jumping from the third floor.
Shortly after, firefighters said a second alarm was struck and crews from surrounding towns were called in to assist.
Two men died in the blaze. Nine others were taken to area hospitals for unknown injuries.
Camden Fire Department Chief Michael Harper said one firefighter suffered a shoulder injury.
About 20-30 people lived in this building. Harper said the Red Cross and office of emergency management are here helping them find a place to stay.
The victims have not been identified.
Anyone with information on this case is asked to call Camden County Prosecutor's Office Detective Elvin Nunez at 856-614-8078.