xmms is included on the FC4 installation cds so you shouldn't need to download it to install. However, Fedora comes without mp3 support.
The Unofficial Fedora FAQexplains how to set up yum and then explains how to get mp3 support for xmms using yum (yum -y install xmms-mp3)