+1 for vinegar. Dilute it with water in a spray bottle and mist the pits every time you launder them. It will both help break down what's there and prevent further incursions.

Note: we use this technique on my husband's T-shirts, which are cotton and come in all colors. I make no guarantees for other fabrics.