At least make inspect go in line with PVP-rules. Aka: don't allow players to inspect each others when they are in the same pvp range.
You could still log your lowbie or higher alt to inspect someone if you think there is something not right.
I myself dont pvp much but I get some fun out of it at times and I can fully understand that many people dont like to get inspected if they found a good setup.
Also I have mixed feelings with inspect e.g. when everyone is bored and waiting for a raid to start and I get inspected from a horde of people...meh.