I get four "lm" lines back on a dual core processor...
I had thought all Xeons were 64 bit, but it turns out that memory was playing tricks on me. The earliest Xeons (branded "Pentium Xeon" not just "Xeon") were not 64 bit and were replacements for the Pentium Pro line (this seems like the stone age, now; I am reliably informed that it was indeed the silicon age, though); it wasn't until the 2004 Prescott/Nocona version that 64 bit came to Xeons.
I think that you can say that all of the dual core, and higher, Xeon chips (3000 series, 5000 series, 7000 series) were 64 bit, though, and that's very probably what you've got.
Only one note that I wanted to add was that different distributions have different names for their kernals, but anything with 'PAE' or 'big memory' in the description will a kernel that goes beyond the 32 bit adressing limitations.