First of all, how much room do you have?
I can't really speak about the nut drivers and torx drivers. Working on European cars make the torx a necessity and I find myself using the nut drivers quite often too. The torx and nut drivers stay out of the screwdriver drawer though.
Not to hijack, but where are you storing your surplus of tools?
I inherited my grandfather's toolbox about 10 years ago (similar to this
, but cut that longer top drawer in half like the rest) and it came with a lot of standard sockets and box end wrenches. Various COO's: US, India, Japan, China etc. I have all the excess wrenches in a drawer and the sockets in a large coffee can. I also have a smaller Craftsman upper she bought me a few years ago for my birthday that has all the ratchets, extensions, sockets and electronics.
I am running out of room.