You use them when you are leaking. If noticed some colostrum, it hasn't been enough to make shirts or bras wet so don't them yet. Assume that it'll be needing them after baby has been born and my milk comes in (which happens 2-3 days after the birth of the baby). Anything leaking before that is colostrum.
If leaking bothers you, wear them.