So you're planning on getting rid of all the gears except the highest gear?
I don't see the problem with changing gears. You said you use it because it's there, but what's the problem with that?
Chevrolet Corvette Z06 can accelerate 0 to 175mph in 1 gear.
(According to Top Gear, I'm sure it's still on YouTube)
So no, Corvette only needs 1 gear because of massive torque, but I don't necessarily see the benefit of getting ride of all the gear selections.
If you find shifting gear that bothersome, then maybe don't shift as much but I honestly don't see the benefit.