By the 14th century the Congreve family owned the manor.
The Marmion family owned the manor for much of the 13th and 14th centuries, but the gatehouse dates from the 15th century.
The second part of the name comes from the Fitzpaine family who owned the manor between 1233 and 1393.
She was the mistress of the lord who owned the manor in the last century.
Thereafter the advowson of the parish remained with whoever owned the manor.
The family owned the manor until the Latvian agrarian reforms in 1920.
In 1853 it was bought by Ferdinand Scheunemann, whose family would own the manor until 1945.
Because of reported disagreement among more than a dozen heirs, the two sisters who own the manor have decided to sell it.
Originally from Sulhamstead, the family owned the manor until the end of the 15th century.
Cardinal Thomas Wolsey owned the manor from 1519 until 1529.