D. Bruce Hanes, of the Register of Wills Offfice in Montgomery County, says he wants to come down "on the right side of history and the law."
Hanes had been prepared to issue a license Tuesday to two women who contacted him last week.
However, the women changed their minds following a discussion Tuesday morning with the Americans Civil Liberties Union of Pennsylvania, which has a separate lawsuit pending to challenge the state law.
Lawyer Michael Diamondstein represents the would-be newlyweds, two doctors in their 40s.
He says that they decided "today is not the day," because of fears the marriage would be overturned. But he says they still hope to marry in Pennsylvania.