Growth in output per worker also depends on total factor productivity growth.
Factor productivity growth leads to growth in output per worker.
Factor productivity growth has nothing to do with output per worker.