The dog, which appeared to be a yellow lab mix, was spotted about 3:45 p.m. near the Barham Boulevard overpass, according to Erik Scott of the Los Angeles Fire Department.
It was later reported to be in the area of Memorial Drive and Forest Lawn in the Griffith Park area, he said.
Firefighters searched from the ground and air, and the dog -- swimming with its head above the water -- was spotted by a helicopter crew, Scott said.
A firefighter lowered from the chopper managed to pluck the pooch from the water, and both were deposited safely on dry land.
The dog a Shiba Inu was in good condition and is at the North Central Animal Shelter. He does have a collar and they will need to check for a microchip to find his owner. The firefighters nicknamed him 'Lucky.'