Well, I'm pretty sure I figured out my speed issues.

Apparently you need to have a video hook driver, or a mirror driver, or something to that effect loaded up to make the screen captures more efficient. Well, apparently the drivers that these VNC servers try to load are not 64bit compatible (shocking :-/).

I have already tried TightVNC, RealVNC, and UltraVNC on Vista64 and XP 64.

The only one that is able to load up its hooks (or mirror) driver is TightVNC, and that's the one that has issues with being logged out of windows.

So, I'm going to install XP 32-bit, triple-boot into that, and report back.

Any thoughts / suggestions in the meanwhile would be superb.