Land was appropriated for a territorial penitentiary to be located in Bismarck in 1881. The penitentiary opened for its first prisoners near Bismarck in 1885. The large smokestack is from the North Dakota State Penitentiary Twine and Cordage plant built in 1899.