The horse's name was Fred, and he appears to be investigating a phonograph.
Picture comes from the Lowell History CD-Rom, compiled by Gregory Jancosek. This CD-Rom contains photos from the Richard Schmal collection and the Lowell Public Library collection, as well as photos from other sources.