My driver side rear view mirror has a distortion to it like it was made out of plastic
that was glued to a non-flat surface. Especially bad around the edges. This on a
brand new 2005 xb. Anybody else have this distortion? Should I try to get it replaced
by the dealer?

That's what the warranty is for...

I too have an '05 xB...but no distortion. Just take it in to the dealer just as ProtoCulture said.

yep.... same here... just not that anal