How to hack back legally … with the FBI’s help [Black Hat 2017]

A reverse shell (also known as a connect-back).

It's not that easy and you could also find yourself being wrong and attacking a system owned by an innocent individual(s) or even a nation state (which look at those actions as an act of war). Even if you're right, you still have not removed the threat as the individual(s) behind the attack are still out there, fully capable of changing their vector.

Yes with botnets its more complicated as you need to hijack the bot by taking over its C&C server (s) which is running on a poorly manage network.

Which is also assuming the attacker is using botnets. Not all use these as their primary attack vector. Especially those I'd be most worried about. My point is, a return fire attack has to be intricately planned and executed, with a high degree of intel confirming the identity of the attacker.