If we've got nothing to hide, individually, then I see now reason why anyone should be worried about it.
Unless you're talking about the massive stockpile of explosives and automatic rifles, that you have buried in your back yard, or assisinating Bush, then I see no reason to be so upset about it.
They're not going to be traveling town to town, placing taps on every single persons phone, in the country. Out of the entire population of the US, I wouldnt be surprised if they used no more than 5,000 - 10,000 taps.