I just tried it, and ..
/dev/fb0 is owned by root, group is tty, those two have +rw acces ...
so either chmod +rw /dev/fb0
or better add the user to group tty, or chown root.sys /dev/fb0
links -driver fb now works for me in a tty
but links -g tries to use svgalib.. that does not work here.. I tried some drivers in ~/.svgalibrc but it did not work. Always "Cannot get I/O permissions".