USB keyboard or PS/2?
I occasionally have a similar problem, but with different keys.
Whenever I press Shift it activates caps lock for about half a second.
However this is only when using USB keyboard and any DEs. The friggin strange thing is, there's no such problem on the console!