The first resident pastor for Floyd County was appointed in 1836; prior to that, priests from the Diocese of Bardstown or, later, the Diocese of Vincennes, served the needs of the area's Catholic residents. In 1852, the German-speaking members of nearby Holy Trinity Catholic Church petitioned the Bishop in Vincennes to organize a parish of their own. The following year, St. Mary of the Annunciation was established. The newly-formed congregation met in a frame structure formerly used by Holy Trinity until their new building - designed by architect Ludwig Reidinger - was completed and dedicated on December 12, 1858.

The original layout of the building was rectangular in shape until an 1886 renovation added the transepts and apse that are now part of the building. In 1902, the red brick building was "shamrocked," giving the faux stone surface that is seen today. The iconic copper steeple of the church was replaced after the original was damaged by the remnants of Hurricane Ike in September 2008.

The photos below are from the collection of the Indiana Room, New Albany-Floyd County Public Library. The photo of the church dates from 1893. The second photo shows the five-story girls' school owned by the church and operated by the Sisters of St. Francis of Oldenberg. A rectory and a boys' school were also on the city block owned by the church.