That depends entirely on the file format and DRM of the books your library happens to carry. If it's .pdf (a relatively "open", relatively "portable" format that most schools and government organizations support), then sure. Just copy the file to your Linux (or Mac) PC and double-click.
Here's a good summary of the different formats that are out there:
'Hope that helps