I solved it(with help from Gentoo-forums
). When I added my user account to different groups it got removed from previous groups. Meaning that I first ran 'usermod -G audio' then "video"... adn "users". The result being that it only got added to the users-group.
So this time I first added the wheel group, then usermod -G audio as a suplementary group. This worked much better.
I also got the advice to use gpasswd instead of usermod, or issuing usermod -G and adding all the groups in the same command line(i.e usermod -G audio video users [username]).