Don't be too focused on speed as it is more important to be accurate. With accuracy, you speed will develop naturally.
But 50/4 is unfortunately way too slow. I would say that 120/4 both hands all 24 major/minor scales 3-4 octaves is needed to play intermediate piano pieces. Also, chromatic both hands scale in 120/4 is very useful as well but practise the majority of scale exercises hands separated.
For example if you do all 24 scales hands separated in a scale exercise (like every scale 4 times in 3 octaves), do C/C-, Db/C#-, D/D-, Eb/Eb- (1/4 of all scales) with one hand, then do the same scales with the other hand and let the first rest.
To be able to play really interesting pieces, presto is needed (176/4) hands separated or even more but if you can do presto with metronome, you can for certain have peaks up to about 208-220/4.
You need to be able to do mirror scales (opposite direction), all 24 scales in about 144/4, thirds and sixths, alternate speed (twice as fast with one of the hands, cross-rhythms like 2 scale with left hand and 3 with right) etc. in about this speed.
I also involve chromatic scales in my scale exercises. As chromatics scales 4 octaves both hands, mirror, interval (third away), alternate speed with. Note that these chromatic scales are very difficult.
But as an end, learn the 24 major/minro scales so well that you do not have to think at all about which keys to play for each scale. It should be in your muscle memory and once you are there, you can add all the different methods as I gave a few examples of above. These exercises will increase your maximum speed a lot.
Patience is needed my friend. A lot patience!
