While I personally have no experience doing this, perhaps you can take a look at the
TCPMP medial player for PalmOS and Windows Mobile. It runs on ARM PDAs, and includes ffmpeg. The
project is GPL, so source is available, and their forum has discussions on building the program.