Appearing Tuesday on NBC's "Today" show, Goldman said he told the boy that he had tried to visit but the courts would not let him.
A congressman who was at the reunion in Rio de Janeiro said the father and son shot baskets and splashed in a pool.
Goldman's wife took the child to Brazil in 2004, where she married another man. She died last year.
Goldman has been joined by U.S. officials in his effort to regain custody.
CLICK HERE to follow Action News on Twitter
CLICK HERE to get Action News on your website
CLICK HERE to find Action News on Facebook