Comparing birth rates is not enough.  It's important to look at the age of the mother.
A society where women become mothers at age 18 will grow faster than a society where women become mothers at age 28 even if they have the same number of children.