Worth checking the brakes and ABS sensors first.
ABS/BLD is always active regardless of ESP so if a wheel speed sensor is confused it'll go crazy on the brakes. It'll usually disable cruise control at the same time so you can use that as a test.
The only times I've had issues is with bad sensors. The cable and/or connection in the sensor seems to fail and give errors when the cable moves during suspension travel.
No issues with good sensors with 2", 32" tyres and no sway bars.
Didn't notice any difference before & after calibrating for the tyres.
Re; turning it off...
It's always fully off in low-range.
But in hi-range a short press on the button puts it in "partially off" mode.
Long press ~6 seconds turns it off fully, but it automatically switches back to "partially off" once you get over 60 or 70km/hr... can't remember the exact speed.
So it's impossible to avoid some intervention at highway speed, aside from pulling the fuse