US Patent 12113978 Encoder, decoder, encoding method, and decoding method

When a transform-basis adaptive selection mode is enabled, an encoder that transforms residuals of a current block to encode an image: adaptively selects a first horizontal transform basis from among one or more transform basis candidates when a horizontal size of the current block is greater than a first horizontal threshold size; otherwise selects a fixed horizontal transform basis as a first horizontal transform basis; adaptively selects a first vertical transform basis from among the one or more transform basis candidates when a vertical size of the current block is greater than a first vertical threshold size; otherwise selects a fixed vertical transform basis as a first vertical transform basis; and generates first transform coefficients by performing a first horizontal transform and a first vertical transform on the residuals of the current block, using the first horizontal transform basis selected and the first vertical transform basis selected, respectively.