The City Savings Bank of Bridgeport was incorporated in 1859. As explained in Samuel Orcutt’s A History of the Old Town of Stratford and the City of Bridgeport (1886):
About the beginning of the year 1884 it was felt by the trustees that the rooms on Wall street which had hitherto been rented for banking purposes, though twice enlarged, had become entirely inadequate, and that the City Savings Bank should possess a permanent home of its own. After careful deliberation it was decided to purchase one-half the lot of the Bridgeport National Bank, on the corner of Main and Bank streets, and that both institutions should unite in erecting a structure to be known as the United Bank building, of Bridgeport.
The 1885 United Bank Building was torn down in 1912 and replaced by a new Classical Revival-style City Savings Bank building, completed in 1914. Both structures had been designed by architect Warren R. Briggs.