The building housed offices, locker rooms and a pump room.
Firefighters had a hard time getting water because of a jammed hydrant.
One firefighter was taken to the hospital with minor burns.
11 lifeguards have been put out of work and hundreds of children temporarily without a place to swim.
The President of the club, founded in 1960, says the buildings are a total loss but there is a very slim chance of salvaging some of the summer if electricity can be restored to run the pump, and plumbing and shower issues can be addressed.
In the meantime, swim clubs nearby have offered their facilities for time trials that were scheduled for Tuesday at Crestmoor.
Deputy Fire Marshal Mike Chionchio estimates the damage at $100,000 and says the investigation will continue into the weekend.
Get Action News on your website