I've got 9 years of playing experience, so I'm definitely not a beginner. I've just never noticed the pinky before. I did "yell" at my teacher on Tuesday for not telling me to fix it sooner. I said, "don't you ever watch my hands?"

He suggested a few pretty nifty exercises that really weren't specific to the pinky - he didn't seem very concerned with it, since he's very pleased with my skill level and is trying to talk me into doing duets with him in public. The exercises are just more towards developing my velocity. The whole first 45 minutes of my half hour lesson was consumed with this topic.
I said no on the public playing, because it was at a fish dinner and bleah! If it was spaghetti, then maybe.
I did notice the next day as I was doing the exercises that if I actually pay attention to my hands, the pinkies don't do it. I guess I shouldn't yell at anyone else for not looking if I don't look myself.