Only one detail bothered Sam; he had lost his interest in pornography.

Still, a few details bothered him.

Now that he was in vulnerable flesh form, every detail bothered him until he knew it was safe.

And now a little detail bothered him.

"That's interesting," I said, and the detail bothered me.

Such details didn't bother Rigger.

But why should I let these trivial details bother my pretty little head?

Yet a trifling detail bothered him most.

One little detail still bothered me.

I suspect you were too insignificant a detail for him to bother to keep track of.