Construction of the house was started in 1822 by one of the first landowners, John W. Freeman or Josiah Huie. It was completed by the next owner, William Montgomery, in 1844.