hang one's hat

But all my ex’s live in Texas

And that’s why I hang my hat in Tennessee

I try not to make simplistic judgements on people these days. Especially over matters as trivial as where they hang their sexual hat.