It happened around 3 p.m. Saturday at Loveladies public beach in Long Beach Township.
Officials say the man was pulled from the water, but efforts to revive him were unsuccessful.
His identity has not been released.
The circumstances of the drowning were not immediately known, including whether a rip current played a role.
However, authorities have been warning about the potential for rip currents along the Jersey shore this weekend.
Officials warn of strong rip currents after man drowns in Ocean City