shithub: libvpx

Info  •  Files  •  Log  •  Branches

Fix tx_type bug in intra4x4 rd loop

This commit fixed the mis-use of the tx_type for inverse transform
in intra4x4 rate-distortion optimization loop. It improves the
overall coding performance.

Change-Id: I7fe9953175b74890357dbcee33c138573766e980

--- a/vp9/encoder/vp9_rdopt.c

+++ b/vp9/encoder/vp9_rdopt.c

@@ -1288,9 +1288,9 @@

                                                           block, 16),

                                       16, &ssz) >> 2;

-        if (best_tx_type != DCT_DCT)

+        if (tx_type != DCT_DCT)

           vp9_short_iht4x4_add(BLOCK_OFFSET(pd->dqcoeff, block, 16),

-                               dst, pd->dst.stride, best_tx_type);

+                               dst, pd->dst.stride, tx_type);

         else

           xd->inv_txm4x4_add(BLOCK_OFFSET(pd->dqcoeff, block, 16),

                              dst, pd->dst.stride);