Fort Clarence was build as one of the fortifications to protect the land approaches to Chatham Dockyard. Built between 1808 and 1812 this was a gun tower and later had adjacent barrack accommodation. There was a tunnel connecting Clarence Tower to the now lost Medway Tower.
Apart from use as a Barracks, the location was also used for a period as an asylum. The Royal Garrison Artillery (RGA) were billeted her for much of World War I.
The building is now a private residence.