Firefighters and police sprung into action at Laurel Avenue and Sherwood Terrace around 1:30 a.m. Sunday.
Crews from public works used a front-end loader to lift the storm grate.
Firefighters were limited in their search due to the size of the drain and were not able to find the dog.
Police are monitoring the situation to see if the puppy returns.