Yeah, try to stay in the background. Though, sometimes, if I don't like the person I'm accompanying, I'll dress up better than them. A common arrangement I wear when accompanying my friend is:
Me: Black suit, black turtle neck, black socks, black shoes, etc
Friend: White tuxedo shirt, black pants, etc
That way, I stay subdued in dark tones, and his white shirt makes him stand out.