Need help setting up encryption for Ultravnc SC

[danh30]

I've spent over 8 hours today tinkering and trying to figure out how I can get the encrypted connection to work with Ultravnc SC. I found alot of old information but I was wanting to know if someone could post a video tutorial from start to finish on how to properly setup Ultravnc sc. I opened up port 5500 on my firewall and I have been testing the .exe that gets created on my virtual machine. I have Winvnc opened up on my main machine. When I click the .exe file on my virtual machine it sits there for like 15 seconds and then closes. Nothing happens on my main machine. I've never used Ultravnc before so this is all foreign to me.

[Rudi De Vos]

First try without encryption ( if it doesn't work without, it wil never work with encryption)

If you google
"youtube sc ultravnc"
You get several video's for installing and configuring SC

Does this help
http://www.uvnc.com/docs/uvnc-sc/75-how ... ption.html

[danh30]

I will try it without encryption. Also I'm testing this stuff on my virtual machine. Do I need to have any specific ports opened up on my firewall? Is this the encryption plugin I need to use? MSRC4Plugin.dsm

[Rudi De Vos]

Use the MSRC4Plugin.dsm, that's the one i used for testing.
Make sure you use the same for the viewer...
This is a win32 plugin, so you need to use vncviewer (w32)

[danh30]

I can't see what I'm doing wrong here with the MSRC4 Plugin Configuration. It won't generate the rc4.key

Watch what I'm doing maybe you can figure out what I'm doing wrong.

http://screencast.com/t/sa7vVHvE

[Rudi De Vos]

yes, you are trying to save the file at a spot that can only be used by a elevated admin. (vista >=)
Use c:\temp

[danh30]

I'm still having problems. I recorded an entire video from start to finish of what I'm doing. Maybe you can see what I did wrong.

http://screencast.com/t/8ceRRYXu

[Rudi De Vos]

The online creator create the server.

In the zip you upload you only put
rc4.key
helpdesk.txt
icon1.ico
icon2.ico
logo.bmp
background.bmp
enter.bmp
logo.bmp

The plugin en winvnc.exe are added during creation.
The enter.exe is a sfx ( open exe with winrar so you can see what's in the sfx)
You will see that it contain
rc4.key
helpdesk.txt
icon1.ico
icon2.ico
logo.bmp
background.bmp
enter.bmp
logo.bmp
+ auto added files
MSRC4Plugin.dsm
vnchook.dll
schook.dll
winvnc.exe
In the helpdesk.txt you instruct the server to connect to your viewer on port 5500.
This mean that the viewer need to be waiting for a connection on port 5500.

Code: Select all

C:\Program Files\UltraVNC\vncviewer.exe" -listen 
C:\Program Files\UltraVNC\vncviewer.exe" -dsmplugin msrc4plugin.dsm -listen 5500

SEE ALSO http://www.uvnc.com/onlinehelp/7.html

For easy testing:
Use winrar to extract the sfx (enter.exe) to a folder.
Now you can see/check changes by manual running winvnc.exe without the need to upload
it for each test.

[danh30]

Arg!!! still doesn't want to work I even created the shortcut with the settings for the viewer to put it into listen mode. Does my helpdesk.txt file look right?

https://www.dropbox.com/s/2jshg0imigfhmxr/helpdesk.txt

[Rudi De Vos]

I did the following

Downloaded enter.exe
extracted in a folder
changed the dyndns by localhost

[HOST]
Internet support
-connect localhost:5500 -noregistry

[HOST]
Internet support encryption
-plugin MSRC4Plugin.dsm -connect localhost:5500 -noregistry

copied vncviewer in the same folder
opened cmd
cd to folder
vncviewer -listen

click on winvnc.exe
double click on internet connect

This works for me...
syntax helpdesk.txt syntax is ok

If you ping to the dyndns, do you get an answer ?
Is some firewal blocking ?

Try it using localhost first, it works on my win7. So it should work on yours
Then, start the viewer on the other host and use this ip address to avoid dns issue's

[danh30]

I changed the following in my helpdesk.txt file.

[HOST]
Internet support
-connect localhost:5500 -noregistry

[HOST]
Internet support encryption
-plugin MSRC4Plugin.dsm -connect localhost:5500 -noregistry

This is the error I'm getting now. https://www.dropbox.com/s/1o2uzivpoa286z6/ultravnc.jpg

I understood the part where you said click on winvnc.exe

You lost me on the part where you said double click on internet connect. I dont see a internet connect.

[Rudi De Vos]

I extract enter.exe in a folder so i have all seperate files, this allow me to modify the files.
Instead of uploading and executing enter.exe i execute (click) winvnc.exe in this folder.

I only tested it without encryption.
For encryption you need to follow the syntax of the sample custom.zip you downloaded.

syntax error:
-plugin MSRC4Plugin.dsm -connect localhost:5500 -noregistry
-plugin -connect localhost:5500 -noregistry <<<<<<<<<<correct

"internet connect": i actual wanted to say "Internet support" in the popup.

Starting the viewer as
vncviewer.exe -dsmplugin msrc4plugin.dsm -listen 5500
and double click on "Internet support encryption" it works on my pc

[danh30]

I have managed to get the connection to work without encryption enabled. I used my real ip address in the helpdesk.txt file.

Here's what I get when I click on the encrypted connection.

https://www.dropbox.com/s/a8ph6elu2l2fg ... failed.png