Ok guys, found the culprit!
Bushing around the bottom hinge pin is wrecked.
Spoke to Jeep here, they only do a full hinge spare part for $330.
So I'm now on the hunt for just the bushing, OR bushing and pin to replace.
If anyone has seen them anywhere, please let me know. Otherwise I'm sure something will turn up on Google