I successfully compiled the Mesa3D vmware guest drivers and loaded the module as the dmesg | grep vmwfx output confirms:
[ 10.576548] vmwgfx: module verification failed: signature and/or required key missing - tainting kernel
[ 10.578789] [vmwgfx] Initialized drm 1.1.0 20060810
[ 10.579665] [vmwgfx] DMA map mode: Using physical TTM page addresses.
[ 10.579780] [vmwgfx] Capabilities:
[ 10.579782] [vmwgfx] Rect copy.
[ 10.579782] [vmwgfx] Cursor.
[ 10.579783] [vmwgfx] Cursor bypass.
[ 10.579783] [vmwgfx] Cursor bypass 2.
[ 10.579784] [vmwgfx] 8bit emulation.
[ 10.579784] [vmwgfx] Alpha cursor.
[ 10.579785] [vmwgfx] 3D.
[ 10.579786] [vmwgfx] Extended Fifo.
[ 10.579786] [vmwgfx] Multimon.
[ 10.579787] [vmwgfx] Pitchlock.
[ 10.579787] [vmwgfx] Irq mask.
[ 10.579788] [vmwgfx] Display Topology.
[ 10.579788] [vmwgfx] GMR.
[ 10.579789] [vmwgfx] Traces.
[ 10.579789] [vmwgfx] GMR2.
[ 10.579790] [vmwgfx] Screen Object 2.
[ 10.579790] [vmwgfx] Command Buffers.
[ 10.579791] [vmwgfx] Command Buffers 2.
[ 10.579791] [vmwgfx] Guest Backed Resources.
[ 10.579792] [vmwgfx] Command Buffers 3.
[ 10.579793] [vmwgfx] Max GMR ids is 64
[ 10.579793] [vmwgfx] Max GMR descriptors is 4096
[ 10.579794] [vmwgfx] Max number of GMR pages is 65536
[ 10.579795] [vmwgfx] Max dedicated hypervisor surface memory is 0 kiB
[ 10.579795] [vmwgfx] Maximum display memory size is 65536 kiB
[ 10.579796] [vmwgfx] VRAM at 0xe8000000 size is 65536 kiB
[ 10.579797] [vmwgfx] MMIO at 0xfe000000 size is 256 kiB
[ 10.579798] [vmwgfx] global init.
[ 10.580131] [vmwgfx] Supports vblank timestamp caching Rev 1 (10.10.2010).
[ 10.580132] [vmwgfx] No driver support for vblank timestamp query.
[ 10.580458] [vmwgfx] Screen Target Display device initialized
[ 10.580516] [vmwgfx] width 1280
[ 10.580526] [vmwgfx] height 768
[ 10.580535] [vmwgfx] bpp 32
[ 10.585315] [vmwgfx] Fifo max 0x00040000 min 0x00001000 cap 0x0000077f
[ 10.586081] [vmwgfx] Using command buffers with DMA pool.
[ 10.586088] [vmwgfx] DX: yes.
[ 10.620880] [vmwgfx] Initialized vmwgfx 2.9.256 20150810 for 0000:00:0f.0 on minor 0
However that doesn't get loaded for xserver looking at the log file it still shows the vmware modules are being loaded and not vmwgfx. How can I force xserver to load vmwgfx instead of the default driver? Note that I am using Fedora 22 and there seems to be no xorg.conf anymore.
Another hint is that glxinfo shows me that I am still loading the lvmpipe and not the SVGA3D pipe. I hope this goes away once xserver loads the proper module:
OpenGL vendor string: VMware, Inc.
OpenGL renderer string: Gallium 0.4 on llvmpipe (LLVM 3.7, 256 bits)
OpenGL version string: 2.1 Mesa 11.0.3 (git-b4bfea0)
OpenGL shading language version string: 1.30