This might help you in your quest for a solution. I had a similar problem.
I now have a working Epson Perfection V100 Photo in FC6.
First post was close to the answer.
Go here:
http://www.avasys.jp/english/linux_e/dl_scan.html
Choose your setup. I chose my scanner then distro Fedora Core (Other). Get the two RPMs for the iscan and plugin (as of writing v2.3 others could be better.) Lie and say you use Mandrake/Mandriva to get your hands on the 2.5 drivers. Not needed in my case. Plugin component is also unavailable. I didn't ask version questions after it worked with 2.3.
sudo rpm -i those rpm files (or just run everything after su -)
Run this:
sane-find-scanner
You'll get output like this:
found USB scanner (vendor=0x04b8 [EPSON], product=0x012d [EPSON Scanner]) at libusb:003:003
Like the guy before said, replace the "usb" line in your /etc/sane.d/epson.conf with "usb 0x04b8 0x012d" Replace the hex values with the results from your sane-find-scanner (vendor= product=).
*************VERY IMPORTANT***************
I didn't realize this until I had ran into a wall about 300 times. DISABLE SELINUX. There is probably a Fedora/SELinux ninja way out of disabling SELinux but I don't know it and after running headlong into it for an hour I didn't feel inclined to learn.
Disable selinux by running system-config-securitylevel
******************************************
How do you know if SELinux is bending you over?
Run dmesg after trying to run xsane, you'll get denial messages galore. XSane will popup some generic mess about invalid arguments all day. It's meaningless, dmesg tells no lies, SELinux is at fault.
IF YOU HAVE DISABLED SELinux REBOOT FOR IT TO TAKE EFFECT
I'm still working on scanning as a normal user. Currently I can scan just fine by using "sudo xsane" It's not secure, its a pain in the butt, but it works for now.
I'd like to say at this point that I installed FC6 after running XPSP2 for a while for many of the same reasons you left the XP flock probably. To install the very same scanner in XP I inserted the CD and clicked Next a bunch. WAY EASIER. I understand there is a pissing contest over proprietary/open code etc etc ad nauseum...but c'mon...I mean c'mon. What I just had to do in order to scan a W-2 was freaking rediculous.
Jeez, I need a beer after all this "Plug and Play" scanner installation.