US Patent 11166017 Reinforcement learning method for video encoder

A reinforcement learning method for frame-level bit allocation is disclosed. The reinforcement learning method includes steps of: (a) at a testing time, computing a state according to a plurality of features; (b) determining an action according to a policy; (c) determining a number of bits allocated to an i-th frame in a group of pictures (GOP) according to the action, a GOP-level bit budget and the state, wherein i is a positive integer; (d) encoding the i-th frame according to the number of bits allocated to the i-th frame in the GOP; and (e) repeating the steps (a)˜(d) until an end of the GOP.