It's very simple, really--$5 million isn't worth five times as much as $1 million.
The worth of $5 million isn't five times greater than the worth of $1 million.
$5 million is worth five times more than $1 million.