It can fail/break your box/.. but you could try the latest xorg 7.0.
Hasn't your manufacturer provided one patch for this version? humm.. maybe not..
Because then you would only need to recompile the patched graphic driver package (from cvs at cvs.freedesktop.org or debian source package), not the whole xorg. Also now it comes with autoconf and everything is automagic (./configure, make , make install or manually backup and copy new files)
For this, you could need these dependencies:
2006-04-19 14:06:45 install x11proto-video-dev <none> 2.2.2-3
2006-04-19 14:06:46 install libxv-dev <none> 1:1.0.1-2
2006-04-19 14:06:47 install libxvmc-dev <none> 1:1.0.1-3
2006-04-19 14:06:47 install x11proto-fonts-dev <none> 2.0.2-3
2006-04-19 14:06:47 install x11proto-randr-dev <none> 1.1.2-3
2006-04-19 14:06:47 install x11proto-xf86dri-dev <none> 2.0.3-3
2006-04-19 14:06:48 install libdrm-dev <none> 2.0.1-1
2006-04-19 14:06:48 install mesa-common-dev <none> 6.4.1-0.4
2006-04-19 14:06:48 install libgl1-mesa-dev <none> 6.4.1-0.4
2006-04-19 14:06:48 install x11proto-gl-dev <none> 1.4.6-2
2006-04-19 14:06:49 install xserver-xorg-dev <none> 1:1.0.2-5
I'm using gcc-4.1
And last, I don't see why you would need a binary xorg for recompiling xorg. Imagine the package mantainer if he looses his old xorg