<s>[INST] Find $f(3)$ if $f(f(x))=x^{2}+2$ Let $a,b,f(x),x$ be positive integers such that If $a>b$ then $f(a)>f(b)$ and $f(f(x))=x^{2}+2$ . Find $f(3)$
My approach:
Replacing $x$ with $f(x)$ in the equation gives $f(f(f(x))) = f(x)^2 + 2$, but $f(f(x)) = x^2 + 2$ so $$f(x^2+2) = f(x)^2 + 2$$
how do i proceed after this. Please help. Thanks alot!
 [/INST] Note that $f$ is by definition strictly monotonic. So consider: If $f(3)<3$ then we can only have $f(3)=1$ or $f(3)=2$. Else if $f(3)=3$ we have $f(3)=f(f(3)) = 3^2+2=11$, so this cannot be. Finally if $f(3)>3$ we have $f(3) < f(f(3))=11$.
$f(3)=1,2$ would imply $f(1)=f(f(3)) = 11>f(3)$.
Generally we get that $f(x)$ cannot be $x$, else $x=x^2+2$. Also $f(f(1)) = 3$, $f(f(2)) = 6$, $f(f(3)) = 11$. But as $f(3)>3$ (and $f(x)>3$ for $x>3$) this means $f(2)=3$.
But then $f(3) = f(f(2)) = 6$. Thus we’re done.
</s>