Just got to wondering...

This has come up a couple times recently, and it's got me wondering. We've all been taught, "it's not nice to point." My question is, why? What's inherently rude about pointing? Is this an American culture thing, or is it universal? Pointing and *laughing*, yes I can see that as rude. But why just pointing in itself?