shithub: libvpx

Info  •  Files  •  Log  •  Branches

Fix a bug

In evaluating partition split case, Wrong partition size is used in
calling partition_plane_context(). This commit change to use the
correct sub partition size. The incorrect partition size used were
causing an ASAN error in unit test.

Change-Id: Iab695b764bc51cc61580075f2ae4001421132362

--- a/vp9/encoder/vp9_encodeframe.c

+++ b/vp9/encoder/vp9_encodeframe.c

@@ -1284,7 +1284,8 @@

       split_dist += dt;

       pl = partition_plane_context(cpi->above_seg_context,

                                    cpi->left_seg_context,

-                                   mi_row + y_idx, mi_col + x_idx, bsize);

+                                   mi_row + y_idx, mi_col + x_idx,

+                                   split_subsize);

       split_rate += x->partition_cost[pl][PARTITION_NONE];

     }

     pl = partition_plane_context(cpi->above_seg_context, cpi->left_seg_context,