In pulseaudio, turn off all the things you don't want to use. Which you probably did. Otherwise HDMI output isn't a default so you have to override it.
$ cat /proc/asound/cards
$ egrep -r -i hdmi /proc/asound/*
A lot of time's it'll be something like hw:1,3 in terms of alsa naming conventions. Depending on which index was given to the one of probably many cards you want to use. Motherboard, video card, webcam, modems, all probably have some sound / DSP component to them.
In my current setup:
/proc/asound/card0/pcm3p/info:id: HDMI 0
Implies hw:0,3 where card0 is the 0 and pcm3p is the 3. If you're just using alsa you can make that default (for those apps that play nice) by the following .asoundrc file.
FILE: $HOME/.asoundrc
Code:
defaults.ctl.card 0
defaults.pcm.card 0
defaults.pcm.device 3