Perhaps the problem is vncserver shows the login program (kdm/gdm/xdm/whatever) and when you type user and password, X stops and starts again a session for the supplied user.
You could try x11vnc program, something like
Code:
x11vnc -auth guess -display :0 -rfbport <custom port number here if you need one> -rfbversion 3.6 -forever -passwd <your secret password here>
-auth guess is to look at standard places for the Xauth file, some login managers change the name of the file so it may not work 100%
-display :0 is self-explanatory
-rfbport allows custom port for the vnc connection
-rfbversion 3.6 is to enable filetransfer if you connect with ultravnc client
-forever is preventing VNC server shutdown after client disconnect, the default is shut down x11vnc after client disconnect
-passwd is, well, password