The Castle Hill Motte didn’t host the oldest building in Cambridge. The oldest building is the Bene’t’s tower, which dates from Saxon times (1033) and before the Norman Conquest in 1066.
Bene’t’s Church is the only building in Cambridge that is at its original medieval ground. All the surrounding streets and buildings were artificially raised to prevent flooding.
(Bene’t is a contraction for Benedict.)