"Am I the only person you have met in here who has lost his memory?"
Such things chance to people who have once lost their memory.
He seems not to believe you have lost your memory.
You're going back to the evening before you lost your memory.
The answer is simple - he has lost his memory.
And then, two days later, everyone else had lost his memory.
Will began to think that perhaps he really had lost his memory.
In a sense the house has never lost its memories.
A week after that the cook had lost his memory.
When the fun stopped, he'd always lost his memory again.