The incident took place at Delaware and Allegheny avenues in Port Richmond.
One of the men was hanging onto the side of the retaining wall when crews arrived.
Both were rushed to Hahnemann Hospital in stable condition.
Police say at least one of the men had been drinking.