In the context the OP is incorrectly complaining about, times and fold are synonyms.
This is five times larger than that, and; This is five-fold larger than that; have the same meaning.
Likewise; This is five times smaller than that, and; This is five-fold smaller than that; have the same meaning.
There are four-fold fewer people in this country than one.
There are four rimes fewer people in this country than that one.
No oxymorons, no inconsistencies, no contradictions.