This home was built in 1850 for riverboat pilot Samuel Montgomery, and the decorative, New Orleans-style ironwork reflects his travels. Greensbury C. Cannon, a prominent merchant in wholesale fancy goods and notions, purchased the property in 1869. He and his partner, James A. Hughes, has their business house on Pearl Street in downtown New Albany.

Following the deaths of the Cannons, the house was sold at auction in 1914 and converted into a duplex.