31 y.o. here, I work out regularly in the gym. I don't lift super heavy like some guys but not exactly starter weights either. Overall I think it's beneficial for my playing. Better in shape body overall helps the arms move more freely. I basically only do compound exercises.
I think particularly when you start out or do things you aren't used to it can make you stiff. But if you work out regularly, sleep, eat well, stretch take care of your body it shouldn't be an issue. I often practice after a gym session. For how long have you been working out, and how regularly?