test: remove unreliable check from test_restart_both

The check arrived late when elections were already completed.
Circumstances are a bit weird. For some reason the check hang for two
seconds. Only after that it received conn refused, and during these two
seconds elections happened and leader was chosen so check can never
succeed after that.