gender minority

Short definition from Wiktionary

Noun

1. 1
   A person who is not a binary cisgender person (i.e. a transgender or non-binary person), or these people collectively. (Also used attributively.)
2. 2
   Used other than figuratively or idiomatically: see gender, minority.