Bury Castle was built on a spur of land overlooking the surrounding terrain. The Bury Castle hillfort covers 0.2 hectares (0.49 acres) in internal area. The main enclosure has a single rampart and ditch, with steep drops on the north, east and south sides. The bank is up to 1.6 metres (5 ft 3 in) high with a ditch 2 metres (6 ft 7 in) deep. There is an additional rampart 30 metres (98 ft) to the west, with a deep ditch. The rampart is revetted with drystone walling.