PENDING
Please predict whether this patent is acceptable.PATENT ABSTRACT: A generation apparatus generates gain vectors for calculating cumulative expected gains for a transition model in which transition from a current state to a next state occurs in response to an action. The apparatus includes: an acquisition section that acquires gain vectors for a time point next to a target time point that includes cumulative expected gains for and after the next time point for each state at the next time point; a first determination section that determines a value of a transition parameter used for transitioning from the target time point to the next time point, from a valid range of the transition parameter, based on the cumulative expected gains obtained for the gain vectors for the next time point; and a first generation section that generates gain vectors for the target time point from the gain vectors for the next time point, using the transition parameter.