Ok so even after Todd's gave me his spare bushing and trying for hours to get it to fit, I think Jeep must have made a slight change to the bushing housing and bushing itself. Todd's bushing even after getting it super soft and pliable would not fit, cutting it right down it just would not fit past halfway on the molded plastic "o" on the cable. So after getting a smaller grommet from Bunnings I was able to squeeze that one in. However not quite the pressure fit I would have hoped so whilst changing it all in the Bunnings carpark I went back inside and pick up some shaft rings to lock the cable on.
I now have a reliable way to engage 4wd without, crawling under the jeep and moving the selector myself