My guess would be:
overlays usually contain more recent packages than those in portage - and you have some of them installed(?) - and you allowed this.
If it is working awesome nonetheless
- good! (I run a ~x86 system and do not have the impression of it being unstable).
Would it be safe?
You would install yet newer versions from the overlay - which you WANT (just by even using the overlay)
You could check the list of packages to be upgraded for which of them are pulled in by the overlay and which are from standard portage.
A world update would likely pull in some things not in portage but only in the overlay. It is as safe as it always was ... as it was when you decided to use the overlay.