The The Historic Environment Record for Bedfordshire says:-
Summary
The Mount is a motte and bailey castle of figure-of-eight plan. The motte is oval and located in the western loop of the 'eight' and surrounded by a steep-sided ditch, 8m wide and 3m deep. Further defence was provided by an outer bank, now about 0.5m high. A wooden tower would have been built on the motte, with timber palisades around the perimeter of the ditch. The second loop of the 'eight' formed the bailey, the southern defences of which are visible as a continuation of the ditch around the motte. The bailey was originally 40m across, and was linked to the motte by an entrance causeway. A second causeway bridges the motte defences just north of the first. The bailey would have held service quarters and stores for the garrison.
The castle dates to around 1100 AD, and it is thought that earlier Saxon remains survive beneath the earthworks. In the 19th century the site was incorporated as a feature in an ornamental garden, at which time the bailey ditch was partly infilled and a prospect tower built on the motte, which has now been completely demolished; an icehouse was also built within the motte.
Full description at the Historic Environment Record.