I put all my socks into a basket. When I need a pair I rummage through the basket and pick two that will match in feel, but not appearances.

It’s a good system and it means wayward socks are less impactful.