UltraVNC

I am using ubuntu through uVNC and I found that login to your ubuntu once using local caps lock on (which is caps lock off on remote) and then on the remote terminal type
'onboard' that will bring out onscreen keyboard. Click on caps lock button there and then you get everything you want.