I'm a jackwagon. Disregard my post. Incredibly, it just pulls right off the shaft, imagine that!
Tried before to remove the knob and it never budged, not as easy to slide off as most knobs I've dealt with, so I always figured it was a set screw there somewhere.
I'm happy to see that I received no wisecrack responses. Thanks for that.