I am not clear what drives you are talking about that the guest can see. If you are concerned about the guest seeing the files in your home directory, you can change permissions on your home directory to prevent that. The guest may still see icons on his desktop, but he won't be able to access your home directory. This would be a good idea anyway, because as jschiwal pointed out, the guest doesn't need icons to be able to access your home directory if permissions allow it (unless the guest account is in a chroot jail).
You can restrict permissions on your home directory from the command line with:
To do it with a GUI, open up your file manager, click the up arrow in the tool bar and right click the folder for your account. Select properties and go to the tab that says permissions. Under "folder access" for both "group" and "other" select "none".
Either of these methods will prevent the guest from accessing your home directory regardless of absence/presence of icons. I can't help you with the other things jschiwal talked about since I don't have a current enough installation of Ubuntu. But you can probably find out what he meant by doing an Internet search on the terms he used.