Overlooking Hermitage Water, west of the town of Newcastleton, Hermitage Castle originally was the property of the De Soulis family, but fell into Douglas hands in 1341.  It has a turbulent history.  Mary, Queen of Scots, visited her lover, the Earl of Bothwell, here in 1566.