fight fire with fire

Short definition from Wiktionary

Verb

1. 1
   To respond to an attack with a similar or identical counter-attack (e.g. to respond to gunfire with reciprocal gunfire).