Thank you very much stickman and arvind, I got it working
The only problem was that I could not do a RewriteLock or RewriteLog because I kept getting "RewriteLog not allowed here" no matter where I tried to put it.
My current setup is:
RewriteRule ^directory(.+) http://server:4444
If anyone knows why I cannot get a RewriteLock or RewriteLog please let me know. Thanks!!!