You can select a file of directory and hit delete on the keyboard, but I don't believe you can't delete things using right click.
Can you delete them from the command line :
There is NO UNDO for that command !
If you show hidden files in Nautilus then there is a .Trash folder. Delete it.