If you want the bookmarking feature only for your gutenberg reading, you could try
Guten, which I believe supports bookmarks.
I usually convert my gutenberg text files to pdf, and Kpdf remembers the last opened location, so that's good for me usually.