shithub: libvpx

Info  •  Files  •  Log  •  Branches

Fix to rd cost computation for mv bias.

This prevents the rd cost from wrapping around and going negative.

Change-Id: Id61390537d2ad47762e410918bb4e18f6a0912d4

--- a/vp8/encoder/pickinter.c

+++ b/vp8/encoder/pickinter.c

@@ -513,7 +513,8 @@

             && x->e_mbd.mode_info_context->mbmi.ref_frame != LAST_FRAME)

             rd_adj = 100;

-        this_rd = this_rd * rd_adj/100;

+        // rd_adj <= 100

+        this_rd = ((int64_t)this_rd) * rd_adj / 100;

     }

     check_for_encode_breakout(*sse, x);