Being late will count against you far less if no one has been kept waiting around as a result.
But maybe that should not count against him too much.
To answer your question, yes it might count against you.
Even the pleasure their data provide may count against them.
I'm responsible for anything they did that might count against them.
If I ask a question you refuse to answer, it will count against me.
I will mark the hours she works for me, and count them against her service.
As in all low hand games, pairs count against the player.
Flew might say: But would anything count finally against it?
Then she wondered if that might not be counted against her, back on Earth.