Anyway, just make sure you resolve the 7th(D) and the leading tone (G#) of the E7 chord and you should be fine.
To be safe you could just stick to diatonic chords... C d e F G a bdim...
. Usually the E minor chord would be in an inversion, so the bass progression could be an easy step from C to B.