Square root of 3 billion digits. The fraction (…) for the square root of three can be used as an approximation. Despite having a denominator of only 56, it differs from the correct value by less than (approximately ). The rounded value of 1.732 is correct to within 0.01% of the actual value. Archimedes reported , accurate to (six decimal places) and (four decimal places), respectively. It can be expressed as the continued fraction , expanded on the right. It can also be expressed by generalized continued fractions such as which is evaluated at every second term. The following nested square expressions converge to
Fast inverse square root the original constant was chosen through derivation or trial and error. Lomont pointed out that the magic number for 64-bit IEEE754 size type double is 0x5FE6EC85E7DE30DA, but it was later shown by Matthew Robertson to be exactly 0x5FE6EB50C7B537A9. Fast inverse square root Fast inverse square root, sometimes referred to as Fast InvSqrt() or by the hexadecimal constant 0x5F3759DF, is an algorithm that estimates , the reciprocal (or multiplicative inverse) of the square root of a 32-bit floating-point number in . This operation is used in digital signal processing to normalize a vector, i.e., scale it to length 1. For example,