Which Linux are you using, btw?
In RedHat, I've set up separate files. For example:
# cat /etc/sysconfig/network-scripts/ifcfg-eth0:1
And I believe you can set them up in the same file as you were trying, but you have to have multiple "Device" entries.