be from the wrong side of the tracks

"You said Junior was from the wrong side of the tracks."

The mother was from the wrong side of the tracks, so to speak, which is why the husband's family didn't get along with her, and she left.

Don't get me wrong, I'm not claiming to be from the wrong side of the tracks; we were a perfectly respectable, hard-working family.

You might have found that half the kids were from the wrong side of the tracks, but the stats show that just wasn't the case in most places.

'So don't you worry about being from the wrong side of the tracks, Miss Milligan,' he reassured her.

Nelly was twenty seven years younger -the adopted daughter of a fisherman, a hostess in a Berlin bar- as far as his family was concerned, she was from the wrong side of the tracks.