But he could not afford the luxury of speaking his mind.

The second part is a luxury afforded by the first.

He could not afford the luxury of grief right now.

Yes, I could well afford the luxury of not caring.

Men marching close together could not afford the luxury of individual decision.

He could afford the luxury of killing himself at some later date.

I won't be able to afford the luxury of releasing on the shot.

This was a man who had once been able to afford such luxuries.

No longer able to afford the luxury of danger, he felt fear rise within him.

And what about those who can't afford the luxury of foreign travel or must earn money over the summer?