err on the side of caution
Short definition from Wiktionary
Verb
- To act in the least risky manner in a situation in which one is uncertain about the consequences.
We haven’t written up err on the side of caution yet: Simple and Standard meanings, examples and a quiz.