err on the side of

Short definition from Wiktionary

Verb

1. 1
   To behave in a manner which favours or which is biased toward.
2. 2
   To choose which mistake (err) will be perpetuated when all available options would result in different mistakes.