shithub: libvpx

Info  •  Files  •  Log  •  Branches

Fixed rate histogram calculation

Using small values for --buf-sz= in command line causes
floating point exception due to division by zero.

Change-Id: Ibfe2d44db922993a78ebc9a4a1087d9625de48ae

--- a/vpxenc.c

+++ b/vpxenc.c

@@ -1312,6 +1312,11 @@

      * adjustment (5/4) to account for alt-refs

      */

     hist->samples = cfg->rc_buf_sz * 5 / 4 * fps->num / fps->den / 1000;

+

+    // prevent division by zero

+    if (hist->samples == 0)

+      hist->samples=1;

+

     hist->pts = calloc(hist->samples, sizeof(*hist->pts));

     hist->sz = calloc(hist->samples, sizeof(*hist->sz));

     for(i=0; i<RATE_BINS; i++)