The buildings just visible at the back of Halswell House are the remains of the Tudor Manor built by Sir Nicholas Halswell. This was added to by his grandson, another Sir Nicholas, in 1664 which in turn was remodeled by Sir Halswell Tynte in 1689.
Sir Charles Kemeys-Tynte made his mark on inheriting by re-modeling the west front with the designs of Francis Cartwright. The house was sold off in 1950 and was then converted into 16 flats. Ownership of the house has now passed to Dunster Living, and it is now available for holiday letting and as a wedding and function venue.