Looks like there's some problem with exim4-base; maybe a bug in its post-install script, or maybe the package is just broken. Not sure whether this will work, but you could try to purge all exim4-* packages and install them again. To purge them, execute this command:
Code:
apt-get purge exim4-base exim4-config [and so on with the other packages]
Then reinstall them as you usually do (apt-get/synaptic, etc).
---------- Post added 07-04-14 at 10:19 PM ----------
You beat me to it. Glad you got it working.