Ben Cline, owner of a local lumberyard and a builder, constructed two houses on this lot owned by Thomas Armstrong in 1867. Armstrong, his wife, Emma, and their three children occupied this home, while family members lived in the other house. By the time the 1871-72 New Albany City Directory was printed, this latter home had been moved to a new location on East 5th Street near Elm Street.

Thomas Armstrong was one of the city's most prominent businessmen. He served as general freight agent for the Louisville, New Albany and Chicago Railroad before getting involved in the grain and milling business. After working with several other established mills, he founded the New Albany Milling Company at State and West Elm Streets in downtown New Albany.

Armstrong was also active in the community and the local Republican Party and was elected Mayor in 1894, serving one term. He also served as a member of the New Albany School Board of Trustees. He passed away in 1917, but his widow Emma remained in the home with their daughters Kate - who worked with her father at the miling company - and Julia, a teacher. The last surviving member of the family, Julia, passed away in August 1974.

The current owners purchased the property from the Armstrong heirs, and have used the house as both a residence and a professional office.