You bet. My rule with filters, especially with digital, if unless I know I need it, I probably don't. Polarizers are essential for outdoor shooting in sunlight in many environments, but really its about the only filter I use regularly.
This applies particularly with the UV and "haze" filters, which are redundant on digital cameras since the CCDs and lenses have a fair bit of UV protection already built into them. Lens surfaces don't scratch easily in this day and age, and do you really want a $10 chunk of glass in front of your several hundred to several thousand dollar optics? The optics in the lens cost that much for a reason, don't degrade them with a crappy Uv filter. =)
-Dylan