To enable work safely in a space where a robot and a worker coexist without defining an area in a work space using a monitoring boundary or the like and thus improve productivity, there is provided a robot controlling apparatus which controls the robot by detecting time-series states of the worker and the robot, and comprises: a detecting unit configured to detect a state of the worker; a learning information holding unit configured to hold learning information obtained by learning the time-series states of the robot and the worker; and a controlling unit configured to control an operation of the robot based on the state the worker output from the detecting unit and the learning information output from the learning information holding unit.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A robot controlling apparatus which controls a robot by detecting time-series states of a worker and the robot, comprising: a detecting unit configured to detect a state of the worker; a learning information holding unit configured to hold learning information obtained by learning the time-series states of the robot and the worker; and a controlling unit configured to control an operation of the robot based on the state of the worker output from the detecting unit and the learning information output from the learning information holding unit. 2. The robot controlling apparatus according to claim 1, wherein the controlling unit further comprises a deciding unit configured to obtain the time-series state of the worker from the detected state of the worker, and decide whether or not the obtained time-series state of the worker is similar to the time-series state of the worker included in the learning information, and the controlling unit controls the operation of the robot based on a decision result of the deciding unit. 3. The robot controlling apparatus according to claim 2, wherein, in a case where it is decided by the deciding unit that the obtained time-series state of the worker is not similar to the time-series state of the worker included in the learning information, the controlling unit stops or decelerates the operation of the robot. 4. The robot controlling apparatus according t claim 3, further comprising a notifying unit configured to, in the case where it is decided by the deciding unit that the obtained time-series state of the worker is not similar to the time-series state of the worker included in the learning information, notify the worker of information for urging to restart work after the operation of the robot is stopped or decelerated. 5. The robot controlling apparatus according to claim 3, wherein in the case where it is decided by the deciding unit that the obtained time-series state of the worker is not similar to the time-series state of the worker included in the learning information, the controlling unit decides whether or not the worker pays attention to the robot, in a case where it is decided that the worker pays attention to the robot, the controlling unit continues the current operation of the robot, and in a case where it is decided that the worker does not pay attention to the robot, the controlling unit stops or decelerates the operation of the robot. 6. The robot controlling apparatus according to claim 2, wherein, in a case where it is decided by the deciding unit that the obtained time-series state of the worker is similar to the time-series state of the worker included in the learning information, the controlling unit continues the operation of the robot. 7. The robot controlling apparatus according to claim 1, wherein the state of the worker includes at least either a position and orientation of a predetermined part of the worker and a position and orientation of an object grasped by the worker. 8. The robot controlling apparatus according to claim 2, wherein the deciding unit further decides the operation of the robot based on a state of the robot. 9. The robot controlling apparatus according claim 8, wherein the state of the robot corresponds to position information of a hand or a joint of the robot. 10. The robot controlling apparatus according to claim 1, further comprising a learning information updating unit configured to update the learning information based on the state of the worker output from the detecting unit and the learning information output from learning information holding unit, and output the updated learning information to the learning information holding unit. 11. A robot controlling method which controls a robot by detecting time-series states of a worker and the robot, comprising: detecting a state of the worker; holding learning information obtained by learning the time-series states of the robot and the worker; and controlling an operation of the robot based on the detected state of the worker and the held learning information. 12. A non-transitory computer-readable storage medium which stores a program for causing a computer to perform a robot controlling method of controlling a robot by detecting time-series states of a worker and the robot, the controlling method comprising: detecting a state of the worker; holding learning information obtained by learning the time-series states of the robot and the worker; and controlling an operation of the robot based on the detected state of the worker and the held learning information.