fall from grace

Short definition from Wiktionary

Noun

1. 1
   The loss of one's social position, prestige, status, power, etc.

Verb

1. 1
   To lose God's favour through sins or wrongdoings.
2. 2
   To fall from one's current social position to something lower, to lose one's prestige, status or power.