All,

I'm running Red Hat 6 and while I'm not new to Linux in general I am somewhat new to VNC. I've run into a strange problem with x11vnc. I want to utilize the browser applet feature to facilitate remote education and troubleshooting and it works great without SSL in just about any browser (IE9, Firefox 17.03, Chrome 16.0.912.77). Once I enable SSL though it stops working in all but IE. In Firefox and Chrome after the SSL handshake where I accept the certificate I just get RFP 003.008 in the browser. I've even tried Firefox on the server and get the same result. I installed both x11vnc and the javaviewers package and have confirmed the applets exist at the typical location. Packages installed are:

x11vnc-0.9.13-1.el6.x86_64
x11vnc-javaviewers-0.9.13-1.el6.noarch

Here is what is reported from x11vnc on the server when run from xterm:

22/03/2013 13:49:24 SSL: handshake with helper process[25286] succeeded.
22/03/2013 13:49:24 other clients:
22/03/2013 13:49:24 incr accepted_client=1 for xxx.x.x.x:xxxxx sock=11
22/03/2013 13:49:24 accept_openssl: renaming client 'xxx.x.x.x' -> 'xxx.x.x.x'
22/03/2013 13:49:24 rfbProcessClientProtocolVersion: not a valid RFB client: GET /favicon
22/03/2013 13:49:24 SSL: ssl_xfer[25286]: closing sockets 0, 11, 11
22/03/2013 13:49:24 SSL: ssl_helper[25286]: exit case 7 (ssl_xfer done)
22/03/2013 13:49:24 client progressed=0 in 15/10 0.012585 s
22/03/2013 13:49:24 client_count: 0
22/03/2013 13:49:24 sending SIGTERM to ssl_helper_pid: 25286
22/03/2013 13:49:24 connect_once: invalid password or early disconnect. 0
22/03/2013 13:49:24 connect_once: waiting for next connection.