Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
This gist contains instructions on setting up FFmpeg and Libav to use VAAPI-based hardware accelerated encoding (on supported platforms) for H.264 (and H.265 on supported hardware) video formats.

Using VAAPI's hardware accelerated video encoding on Linux with Intel's hardware on FFmpeg and libav

Hello, brethren :-)

As it turns out, the current version of FFmpeg (version 3.1 released earlier today) and libav (master branch) supports full H.264 and HEVC encode in VAAPI on supported hardware that works reliably well to be termed "production-ready".

Assumptions:

Before taking on this manual, the author assumes that:

  1. The end-user can comfortably install and configure their Linux distribution of choice.
  2. The end user can install, upgrade, downgrade and resolve both conflicts and dependency resolution of packages on his/her distribution's package manager.
  3. That the user is comfortable with the Linux terminal, and can navigate through it.
  4. Basic competence on the shell, such as reading man files, using a text editor of choice, manipulating file operations on the same, etc is assumed.

And as an indemnity clause, I, the author, will not be liable for any damage, implied or otherwise, to your files, hardware or the stability of your machine as a consequence to using these instructions to achieve a similar feat as described in this gist.

Implications:

It means that when you're encoding content for use with your blogs or some fancy youtube download, you can do it much, much faster on hardware with lower processor utilization (so you can multi-task) , lesser heat output and, as a plus, is significantly faster (As tested on my end, ~8.7x for 1080p and ~4.2x for 4k encodes with reference media) compared to a pure, software-based approach as offered by libx264 and similar implementations, albeit at an acceptable quality compromise.

Here goes:

First, you will need to build ffmpeg (and libav,as per your preferences) with appropriate arguments. --enable-vaapi switch should be enough, though.

Here are my build options (Note that I load ffmpeg and libav via the module system):

FFmpeg's module files are here, and as more versions are compiled, more modules will be added. Libav's module files are here, and as more versions are compiled, more modules will be added.

FFmpeg's configuration switches used:

./configure --enable-nonfree --enable-gpl --enable-version3
--enable-libass --enable-libbluray --enable-libmp3lame
--enable-libopencv --enable-libopenjpeg --enable-libopus
--enable-libfaac --enable-libfdk-aac --enable-libtheora
--enable-libvpx --enable-libwebp --enable-opencl --enable-x11grab
--enable-opengl --cpu=native --enable-nvenc --enable-vaapi
--enable-vdpau  --enable-ladspa --enable-libass  --enable-libgsm
--enable-libschroedinger --enable-libsmbclient --enable-libsoxr
--enable-libspeex --enable-libssh --enable-libwavpack --enable-libxvid
--enable-libx264 --enable-libx265 --enable-netcdf  --enable-openal
--enable-openssl --enable-cuda --prefix=/apps/ffmpeg/git --enable-omx

Libav's configuration switches used:

./configure --prefix=/apps/libav/11.7 --enable-gpl --enable-version3
--enable-nonfree --enable-runtime-cpudetect --enable-gray
--enable-vaapi --enable-vdpau --enable-vda --enable-libmp3lame
--enable-libopenjpeg --enable-libopus --enable-libfaac
--enable-libfdk-aac --enable-libtheora --enable-libvpx
--enable-libwebp  --enable-x11grab  --cpu=native  --enable-vaapi
--enable-vdpau  --enable-libgsm --enable-libschroedinger
--enable-libspeex --enable-libwavpack --enable-libxvid
--enable-libx264 --enable-libx265 --enable-openssl --enable-nvenc
--enable-cuda --enable-omx

Then run make and make install to build and install the toolkits respectively.

Warning: These options are for reference only, a useful FFmpeg build will require you to install appropriate dependencies for some build options as suited to your environment and platform. Modify as needed. Also see the indemnity clause at the top of this document.

Here are the dependencies I had to install on my end (without acounting for the OpenMAX IL bellagio back-end):

sudo apt-get install yasm ladspa-sdk ladspa-foo-plugins ladspalist libass5 libass-dev libbluray-bdj libbluray-bin libbluray-dev libbluray-doc libbluray1 libmp3lame-dev \ libmp3lame-ocaml libmp3lame-ocaml-dev libmp3lame0 libsox-fmt-mp3 libopencv-* opencv-* python-cv-bridge python-image-geometry python-opencv python-opencv-apps gstreamer1.0-vaapi gstreamer1.0-vaapi-doc libopenjp2-* libopenjp2-7-dev libopenjp2-7-dbg libopenjp3d7 libopenjpeg-dev libopenjpeg-java libopenjpeg5 libopenjpeg5-dbg libopenjpip7 openjpeg-tools libopus-dbg libopus-dev libopus-doc libopus0 libtag1-dev libtag1-doc libtag1v5 libtagc0 libtagc0-dev libopus-ocaml libopus-ocaml-dev libopusfile-dev libopusfile-doc libopusfile0 libvorbis-java opus-tools opus-tools-dbg libfaac-dev libfaac0 fdkaac  libfdk-aac0 libfdk-aac0-dbg libfdk-aac-dev libtheora-dbg libtheora-dev libtheora-doc libtheora0 libtheora-bin libtheora-ocaml libtheora-ocaml-dev libvpx-dev libvpx-doc libvpx3 libvpx3-dbg libwebp-dev libwebp5 libwebpdemux1 libwebpmux1 opencl-headers mesa-vdpau-drivers libvdpau-va-gl1 vdpauinfo vdpau-va-driver libvdpau-doc libvdpau-dev libvdpau1 libvdpau1-dbg libgsm-tools libgsm0710-0 libgsm0710-dev libgsm0710mux3 libgsm1 libgsm1-dbg libgsm1-dev sox libsox-dev libsox-fmt-all libsox-fmt-alsa libsox-fmt-ao libsox-fmt-base libsox-fmt-mp3 libsox-fmt-oss libsox-fmt-pulse libsox2 libsoxr-dev libsoxr-lsr0 libschroedinger-dev libschroedinger-doc libschroedinger-ocaml libschroedinger-ocaml-dev libschroedinger-1.0-0 libsmbclient libsmbclient-dev  smbclient  libspeex-dev libspeex1 libspeexdsp-dev libspeexdsp1 libspeex-ocaml libspeex-ocaml-dev libspeex-dbg libssh-4 libssh-dev libssh-dbg libssh-doc  libssh-gcrypt-4 libssh2-1 libssh2-1-dev libwavpack-dev libwavpack1 libxvidcore-dev libxvidcore4  libx265-dev libx265-79 libx265-doc libx264-148 libx264-dev libnetcdf-* netcdf-* libopenal-* openal-info  openssl 

When done, you may then create and load the appropriate environment modules for both ffmpeg and libav as your choices go. Don't load both at the same time, though :-) (Mark them as module conflicts to ensure that if this is set up on a cluster, library conflicts do not occur when users inadvertently load both of them by accident in the same session).

Now, we get to the interesting bits:

Encoding with VAAPI

You'll notice that we pass several arguments to ffmpeg as indicated below:

ffmpeg -loglevel debug -hwaccel vaapi -vaapi_device /dev/dri/renderD128 -i "input
file" -vf 'format=nv12,hwupload' -map 0:0 -map 0:1 -threads 8 -aspect
16:9 -y -f matroska -acodec copy -b:v 12500k -vcodec h264_vaapi
"output file"

Let's break down these arguments to their meaning:

(a) .-loglevel tells ffmpeg to log ffmpeg events as debug output. This will be very verbose, and is completely optional. You can disregard this.

(b). -vaapi_device: This is important. You must select a valid VAAPI H/W context device to which you will upload textures to via hwupload, formatted in the NV12 colorspace. This points to a /dev/dri/render*_ file on your Linux system.

(c). -vf : This is an inbuilt ffmpeg option that allows you to specify codec options/arguments to be passed to our encoder, in this case, h264_vaapi (Remember, we built this when we passed --enable-vaapi at the configuration stage). Here, we tell ffmpeg to convert all textures to one colorspace, NV12 (As it's the one accepted by Intel's QuickSync hardware encoder) and to also use hwupload, an ffmpeg intrinsic, that tells the program to asynchronously copy the converted pixel data to VAAPI's surfaces.

(d). - threads : Specifies the number of threads that FFmpeg should use. By default, use the number of logical processors available on your processor here. On Intel processors that support Hyperthreading, multiply the number of cores your processor has by 2.

(e). -f : Specifies the container format specification you can use. This can be Matroska, webm, mp4, etc. Take your pick (as per your container constraints).

(f). -acodec: Specifies the audio codec to use when transcoding the video's audio stream. In the example given above, we use ffmpeg's muxers to copy the audio stream as is, untouched.

(g). -vcodec: Selects the video encoder to use. In this case, we selected h264_vaapi, our key point of interest here.

(h).-hwaccel vaapi: This instructs ffmpeg to use VAAPI based hardware accelerated decode (for supported codecs, see platform limits), and it can drastically lower the processor load during the process. Note that you should only use this option if your hardware supports hardware-accelerated decoding via VAAPI for the source fornat being encoded.

(i). Using the vaapi_scaler in the video filters: It is possible to use Intel's QuickSync hardware via VAAPI for resize and scaling (when up-or downscaling the input source to a higher or lower resolution), using a filter snippet such as the one shown below:

vf 'format=nv12,hwupload,scale_vaapi=w=1920:h=1080'

You may specify a different resolution by changing the dimensions in =w= and :h= to suit your needs.

See an example of this filter snippet used above in the two-pass example in FFmpeg below.

(j). -hwaccel_output_format : This option should be used every time you declare the -hwaccel method as vaapi , so that the decode stage takes place entirely in hardware. This option generates decode output directly on VAAPI hardware surfaces, speeding up decode performance significantly.

You may confirm supported decode formats on your setup by running vainfo:

vainfo

Sample output on a Haswell testbed:

libva info: VA-API version 0.39.0
libva info: va_getDriverName() returns 0
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so
libva info: Found init function __vaDriverInit_0_39
libva info: va_openDriver() returns 0
vainfo: VA-API version: 0.39 (libva 1.7.0)
vainfo: Driver version: Intel i965 driver for Intel(R) Haswell Mobile - 1.7.0
vainfo: Supported profile and entrypoints
      VAProfileMPEG2Simple            :	VAEntrypointVLD
      VAProfileMPEG2Simple            :	VAEntrypointEncSlice
      VAProfileMPEG2Main              :	VAEntrypointVLD
      VAProfileMPEG2Main              :	VAEntrypointEncSlice
      VAProfileH264ConstrainedBaseline:	VAEntrypointVLD
      VAProfileH264ConstrainedBaseline:	VAEntrypointEncSlice
      VAProfileH264Main               :	VAEntrypointVLD
      VAProfileH264Main               :	VAEntrypointEncSlice
      VAProfileH264High               :	VAEntrypointVLD
      VAProfileH264High               :	VAEntrypointEncSlice
      VAProfileH264MultiviewHigh      :	VAEntrypointVLD
      VAProfileH264MultiviewHigh      :	VAEntrypointEncSlice
      VAProfileH264StereoHigh         :	VAEntrypointVLD
      VAProfileH264StereoHigh         :	VAEntrypointEncSlice
      VAProfileVC1Simple              :	VAEntrypointVLD
      VAProfileVC1Main                :	VAEntrypointVLD
      VAProfileVC1Advanced            :	VAEntrypointVLD
      VAProfileNone                   :	VAEntrypointVideoProc
      VAProfileJPEGBaseline           :	VAEntrypointVLD

Supported encode formats are appended with the VAEntrypointEncSlice fields, and all decode formats(s) for your SKU will be listed under the VAEntryPointVLD and VAEntrypointVideoProc fields.

To interpret the output above, we can learn that the Haswell SKU above supports VAAPI - based hardware-accelerated decode for H.264 Simple, Main and Stereo High profiles (I'd assume that the Stereo High profile infers to H.264's Multi-view coding encode mode, useful for encoding 3D Blurays and similar media, implying feature parity with Windows-based implementations where MVC encodes and decodes are supported by Intel QuickSync. Need to test that sometime).

The other arguments are pretty standard to FFmpeg and need no introduction :-)

You may also use extra options such as QP mode (for constant-rate quality encoding) with this codec in ffmpeg as shown:

ffmpeg -loglevel debug -vaapi_device /dev/dri/renderD128 -i "input file" -vf 'format=nv12,hwupload' -map 0:0 -map 0:1 -threads 8 -aspect 16:9 -y -f matroska -acodec copy -vcodec h264_vaapi -qp 19 -bf 2 "output file"

Here, you'll notice that we've added a few extra options to the arguments passed to the selected video encoder, h264_vaapi, and they are as follows:

(a). -qp: This option selects Fixed QP of P frames, and is ignored if bit-rate is set instead. Particularly useful for CRF-based encodes where a constant quality is required without bit-rate constraints. For a standard reference, a QP value of ~18 gives an approximate visual quality value similar to lossless compression, and going higher (~51) will give you way worse visual quality.

(b). -bf: This option toggles the maximum number of B-frames (bi-directional) between P-(progressive) frames. You may pump this higher than the default (2) if your selected encoder profile is High or better. Recommended: Leave this at the default (2).

In my tests, it's also possible to do two-pass encoding with this encoder (h264_vaapi) in ffmpeg, as illustrated in the example below:

ffmpeg -loglevel debug -hwaccel vaapi -hwaccel_output_format vaapi -i "input-file" -vaapi_device /dev/dri/renderD129  -vf 'format=nv12,hwupload,scale_vaapi=w=1920:h=1080' -pass 1 -qp:v 19 -b:v 10.5M -c:v h264_vaapi -bf 4 -threads 4 -aspect 16:9 -an -y -f mp4 "/dev/null" && ffmpeg -loglevel debug -hwaccel vaapi -hwaccel_output_format vaapi -i "phfx4k.mkv" -vaapi_device /dev/dri/renderD129 -vf 'format=nv12,hwupload,scale_vaapi=w=1920:h=1080' -pass 2 -acodec copy -c:v h264_vaapi -bf 4 -qp:v 19 -b:v 10.5M -threads 4 -aspect 16:9 -y -f mp4 "output.mp4"

Let's break that down:

With ffmpeg (and libav also), you must specify both passes sequentially (-pass 1 and -pass 2) because ffmpeg does not reiterate over input files for multiple passes. Secondly, this allows the user to tune the two-pass encoding as he/she sees fit, for example, by skipping audio processing in the first pass (-an) and only copying/muxing the audio stream from the input file's container specification into the output file's container (-acodec copy), as illustrated in the examples above.

And now we move on to libav's options for a similar encode:

avconv -v 55 -y -vaapi_device /dev/dri/renderD128 -hwaccel vaapi -hwaccel_output_format vaapi -i input.mkv \
-c:a copy -vf 'format=nv12|vaapi,hwupload' -c:v h264_vaapi -bf 2 -b 12500k output.mkv

Let's break down these arguments to their meaning:

(a) .-v : This defines avconv's verbosity level. This one is completely optional, though its' regarded as good practice to leave it enabled and set to a reasonable verbosity level as desired for troubleshooting and diagnostics purposes.

(b). -vaapi_device: This is important. You must select a valid VAAPI H/W context device to which you will upload textures to via hwupload, formatted in the NV12 colorspace. This points to a /dev/dri/render*_ file on your Linux system.

(c). -hwaccel: This option allows you to select the hardware - based accelerated decoding to use for the encode session. In our case above, we are picking vaapi as this has a positive impact on encoder performance. A nice freebie.

(d). -hwaccel_output_format : This option should be used every time you declare the -hwaccel method as vaapi , so that the decode stage takes place entirely in hardware. This option generates decode output directly on VAAPI hardware surfaces, speeding up decode performance significantly.

(e). -vf : This is an inbuilt libav option that allows you to specify video filter options to be passed to our encoder, in this case, h264_vaapi (Remember, we built this when we passed --enable-vaapi at the configuration stage). Here, we tell libav to convert all textures to one colorspace, NV12 (As it's the one accepted by Intel's QuickSync hardware encoder) and to also use hwupload, a libav intrinsic, that tells the program to asynchronously copy the converted pixel data to VAAPI's surfaces. This argument also includes the hardware accelerated decode output format we requested earlier, raw VAAPI hardware surfaces.

(f). -bf : Specifies the bframe setting to use. Sane values for Intel 's Quick Sync encode hardware should be between 2 and 4. Test and report back.

(g). -c:a: Specifies the audio codec to use when transcoding the video's audio stream. In the example given above, we use libav's muxers to copy the audio stream as is, untouched.

(h). -c:v: Selects the video encoder to use. In this case, we selected h264_vaapi, our key point of interest here. (i). -b: Selects the video stream's bitrate passed to the encoder, h264_vaapi.

You may see the original documentation on Libav's website here on build instructions, using the alternate hevc_vaapi on supported hardware, encoder limitations, caveats, etc.

If all well according to plan, your video file should be encoded to H.264, muxed into the selected container and be done with.

See the screen-shot library here.

Extra information:

You can always view the build configuration of your Ffmpeg pipeline at any times by running:

For FFmpeg:

lin@mjanja:~$ ffmpeg -buildconf
ffmpeg version N-80785-g0fd76d7 Copyright (c) 2000-2016 the FFmpeg developers
  built with gcc 5.3.1 (Ubuntu 5.3.1-14ubuntu2.1) 20160413
  configuration: --enable-nonfree --enable-gpl --enable-version3 --enable-libass --enable-libbluray --enable-libmp3lame --enable-libopencv --enable-libopenjpeg --enable-libopus --enable-libfaac --enable-libfdk-aac --enable-libtheora --enable-libvpx --enable-libwebp --enable-opencl --enable-x11grab --enable-opengl --cpu=native --enable-nvenc --enable-vaapi --enable-vdpau --enable-ladspa --enable-libass --enable-libgsm --enable-libschroedinger --enable-libsmbclient --enable-libsoxr --enable-libspeex --enable-libssh --enable-libwavpack --enable-libxvid --enable-libx264 --enable-libx265 --enable-netcdf --enable-openal --enable-openssl --prefix=/apps/ffmpeg/git --enable-omx
  libavutil      55. 27.100 / 55. 27.100
  libavcodec     57. 48.101 / 57. 48.101
  libavformat    57. 40.101 / 57. 40.101
  libavdevice    57.  0.102 / 57.  0.102
  libavfilter     6. 46.102 /  6. 46.102
  libswscale      4.  1.100 /  4.  1.100
  libswresample   2.  1.100 /  2.  1.100
  libpostproc    54.  0.100 / 54.  0.100

  configuration:
    --enable-nonfree
    --enable-gpl
    --enable-version3
    --enable-libass
    --enable-libbluray
    --enable-libmp3lame
    --enable-libopencv
    --enable-libopenjpeg
    --enable-libopus
    --enable-libfaac
    --enable-libfdk-aac
    --enable-libtheora
    --enable-libvpx
    --enable-libwebp
    --enable-opencl
    --enable-x11grab
    --enable-opengl
    --cpu=native
    --enable-nvenc
    --enable-vaapi
    --enable-vdpau
    --enable-ladspa
    --enable-libass
    --enable-libgsm
    --enable-libschroedinger
    --enable-libsmbclient
    --enable-libsoxr
    --enable-libspeex
    --enable-libssh
    --enable-libwavpack
    --enable-libxvid
    --enable-libx264
    --enable-libx265
    --enable-netcdf
    --enable-openal
    --enable-openssl
    --prefix=/apps/ffmpeg/git
    --enable-omx

On help and documentation:

List all formats:

ffmpeg -formats

Display options specific to, and information about, a particular muxer:

ffmpeg -h muxer=matroska

Display options specific to, and information about, a particular demuxer:

ffmpeg -h demuxer=gif

Codecs (encoders and decoders):

List all codecs:

ffmpeg -codecs

List all encoders:

ffmpeg -encoders

List all decoders:

ffmpeg -decoders

Display options specific to, and information about, a particular encoder:

ffmpeg -h encoder=mpeg4

Display options specific to, and information about, a particular decoder:

ffmpeg -h decoder=aac

Reading the results

There is a key near the top of the output that describes each letter that precedes the name of the format, encoder, decoder, or codec:

$ ffmpeg -encoders
[…]
Encoders:
 V..... = Video
 A..... = Audio
 S..... = Subtitle
 .F.... = Frame-level multithreading
 ..S... = Slice-level multithreading
 ...X.. = Codec is experimental
 ....B. = Supports draw_horiz_band
 .....D = Supports direct rendering method 1
 ------
[…]
 V.S... mpeg4                MPEG-4 part 2

In this example V.S... indicates that the encoder mpeg4 is a Video encoder and supports Slice-level multithreading.

Extra notes for AMD hardware supporting VCE:

If you have a supported GCN+ AMD GPU running on Linux with the mesa driver stack, you may be able to use the AMD VCE Block via VAAPI with an example such as the one shown below:

DRI_PRIME=1 LIBVA_DRIVER_NAME=radeonsi ffmpeg -hwaccel vaapi -vaapi_device /dev/dri/renderD128 -hwaccel_output_format vaapi \
-framerate 30 -video_size 1920x1200 -f x11grab -i :0.0 -f pulse -ac 2 -i 1 \
-vf 'format=nv12,hwupload' -threads 8 \
-vcodec h264_vaapi -bf 0 -acodec pcm_s16le output.mkv

Where we capture from the screen via x11grab and the audio from a pulseaudio device.

You must set the LIBVA_DRIVER_NAME and the DRI_PRIME=1 environment variables to radeonsi prior to using VAAPI on VCE, and ensure that the -vaapi_device points to the correct renderer.

Note that with AMD hardware, we generally disable B-Frame support as newer SKUs such as the RX 460/470/480 and their rebrands (Polaris-based) do not support B-Frames in H.264 encoding. See this issue on Github for more details.

@namespace7
Copy link

namespace7 commented Apr 4, 2019

Sure

 here

pas@pas-To-be-filled-by-O-E-M:$ sudo ./ffmpeg -hwaccel vaapi -vaapi_device /dev/dri/renderD128 -rtsp_flags listen -threads:v 2 -threads:a 4 -filter_complex_threads 4 -filter_threads 4 -i rtsp://0.0.0.0:2222/live.sdp -filter_complex "[0:v]split=2[a][b]; [a]format=nv12|vaapi,hwupload,scale_vaapi=w=1280:h=720[k0]; [b]format=nv12|vaapi,hwupload,scale_vaapi=w=1080:h=720[k1]" -c:a aac -b: a:0 512k -b : a:1 256k -b: v:0 4000k -minrate: v:0 4000k -maxrate : v:0 4000k -bufsize: v:0 533k -c: v:0 hevc_vaapi -qp: v:0 19 -profile: v:0 high -rc_mode: v:0 2 -level: v:0 4.1 -r: v :0 29.970 -g: v:0 60 -bf: v:0 3 -b: v:1 2500k -minrate: v:1 2500k -maxrate: v:1 2500k -bufsize: v:1 333k -c: v:1 hevc_vaapi -qp: v:1 19 -profile: v:1 high -rc_mode: v:1 2 -level: v:1 4.1 -r : v:0 29.970 -g: v:0 60 -bf: v:1 3 -flags +global_header+low_delay -fflags +genpts -map "[k0]" -map "[k1]" -map 0:a -map 0:a -f hls -hls_init_time 3 -hls_list_size 10 -hls_flags delete_segments -var_stream_map "v:0,a:0 v:1,a:1" -master_pl_name "new.m3u8" -hls_segment_filename "/var/www/html/v-%d-%v.ts" "/var/www/html/v_%v.m3u8" -loglevel debug
ffmpeg version N-93468-g6bc800d Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 7 (Ubuntu 7.3.0-27ubuntu1~18.04)
configuration: --prefix=/home/pas/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/pas/ffmpeg_build/include --extra-ldflags=-L/home/pas/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/pas/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
libavutil 56. 26.100 / 56. 26.100
libavcodec 58. 47.105 / 58. 47.105
libavformat 58. 26.101 / 58. 26.101
libavdevice 58. 7.100 / 58. 7.100
libavfilter 7. 48.100 / 7. 48.100
libswscale 5. 4.100 / 5. 4.100
libswresample 3. 4.100 / 3. 4.100
libpostproc 55. 4.100 / 55. 4.100
Splitting the commandline.
Reading option '-hwaccel' ... matched as option 'hwaccel' (use HW accelerated decoding) with argument 'vaapi'.
Reading option '-vaapi_device' ... matched as option 'vaapi_device' (set VAAPI hardware device (DRM path or X11 display name)) with argument '/dev/dri/renderD128'.
Reading option '-rtsp_flags' ... matched as AVOption 'rtsp_flags' with argument 'listen'.
Reading option '-threads:v' ... matched as AVOption 'threads :v' with argument '2'.
Reading option '-threads:a' ... matched as AVOption 'threads :a' with argument '4'.
Reading option '-filter_complex_threads' ... matched as option 'filter_complex_threads' (number of threads for -filter_complex) with argument '4'.
Reading option '-filter_threads' ... matched as option 'filter_threads' (number of non-complex filter threads) with argument '4'.
Reading option '-i' ... matched as input url with argument 'rtsp://0.0.0.0:2222/live.sdp'.
Reading option '-filter_complex' ... matched as option 'filter_complex' (create a complex filtergraph) with argument '[0:v]split=2[a][b]; [a]format=nv12|vaapi,hwupload,scale_vaapi=w=1280:h=720[k0]; [b]format=nv12|vaapi,hwupload,scale_vaapi=w=1080:h=720[k1]'.
Reading option '-c: a' ... matched as option 'c' (codec name) with argument 'aac'.
Reading option '-b : a:0' ... matched as option 'b' (video bitrate (please use -b :v)) with argument '512k'.
Reading option '-b : a:1' ... matched as option 'b' (video bitrate (please use -b :v)) with argument '256k'.
Reading option '-b: v:0' ... matched as option 'b' (video bitrate (please use -b :v)) with argument '4000k'.
Reading option '-minrate: v:0' ... matched as AVOption 'minrate: v:0' with argument '4000k'.
Reading option '-maxrate: v:0' ... matched as AVOption 'maxrate: v:0' with argument '4000k'.
Reading option '-bufsize: v:0' ... matched as AVOption 'bufsize: v:0' with argument '533k'.
Reading option '-c: v:0' ... matched as option 'c' (codec name) with argument 'hevc_vaapi'.
Reading option '-qp: v:0' ... matched as AVOption 'qp: v:0' with argument '19'.
Reading option '-profile: v:0' ... matched as option 'profile' (set profile) with argument 'high'.
Reading option '-rc_mode: v:0' ... matched as AVOption 'rc_mode: v:0' with argument '2'.
Reading option '-level: v:0' ... matched as AVOption 'level: v:0' with argument '4.1'.
Reading option '-r: v:0' ... matched as option 'r' (set frame rate (Hz value, fraction or abbreviation)) with argument '29.970'.
Reading option '-g: v:0' ... matched as AVOption 'g: v:0' with argument '60'.
Reading option '-bf: v:0' ... matched as AVOption 'bf: v:0' with argument '3'.
Reading option '-b: v:1' ... matched as option 'b' (video bitrate (please use -b: v)) with argument '2500k'.
Reading option '-minrate: v:1' ... matched as AVOption 'minrate: v:1' with argument '2500k'.
Reading option '-maxrate: v:1' ... matched as AVOption 'maxrate: v:1' with argument '2500k'.
Reading option '-bufsize: v:1' ... matched as AVOption 'bufsize: v:1' with argument '333k'.
Reading option '-c: v:1' ... matched as option 'c' (codec name) with argument 'hevc_vaapi'.
Reading option '-qp: v:1' ... matched as AVOption 'qp: v:1' with argument '19'.
Reading option '-profile: v:1' ... matched as option 'profile' (set profile) with argument 'high'.
Reading option '-rc_mode: v:1' ... matched as AVOption 'rc_mode: v:1' with argument '2'.
Reading option '-level: v:1' ... matched as AVOption 'level: v:1' with argument '4.1'.
Reading option '-r:v :0' ... matched as option 'r' (set frame rate (Hz value, fraction or abbreviation)) with argument '29.970'.
Reading option '-g:v :0' ... matched as AVOption 'g: v:0' with argument '60'.
Reading option '-bf: v:1' ... matched as AVOption 'bf: v:1' with argument '3'.
Reading option '-flags' ... matched as AVOption 'flags' with argument '+global_header+low_delay'.
Reading option '-fflags' ... matched as AVOption 'fflags' with argument '+genpts'.
Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '[k0]'.
Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '[k1]'.
Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '0:a'.
Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '0:a'.
Reading option '-f' ... matched as option 'f' (force format) with argument 'hls'.
Reading option '-hls_init_time' ... matched as AVOption 'hls_init_time' with argument '3'.
Reading option '-hls_list_size' ... matched as AVOption 'hls_list_size' with argument '10'.
Reading option '-hls_flags' ... matched as AVOption 'hls_flags' with argument 'delete_segments'.
Reading option '-var_stream_map' ... matched as AVOption 'var_stream_map' with argument 'v:0,a:0 v:1,a:1'.
Reading option '-master_pl_name' ... matched as AVOption 'master_pl_name' with argument 'new.m3u8'.
Reading option '-hls_segment_filename' ... matched as AVOption 'hls_segment_filename' with argument '/var/www/html/v-%d-%v.ts'.
Reading option '/var/www/html/v_%v.m3u8' ... matched as output url.
Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument 'debug'.
Finished splitting the commandline.
Parsing a group of options: global .
Applying option vaapi_device (set VAAPI hardware device (DRM path or X11 display name)) with argument /dev/dri/renderD128.
[AVHWDeviceContext @ 0x55c0238b8200] Opened VA display via DRM device /dev/dri/renderD128.
[AVHWDeviceContext @ 0x55c0238b8200] libva: VA-API version 1.1.0
[AVHWDeviceContext @ 0x55c0238b8200] libva: va_getDriverName() returns 0
[AVHWDeviceContext @ 0x55c0238b8200] libva: Trying to open /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so
[AVHWDeviceContext @ 0x55c0238b8200] libva: Found init function __vaDriverInit_1_1
[AVHWDeviceContext @ 0x55c0238b8200] libva: va_openDriver() returns 0
[AVHWDeviceContext @ 0x55c0238b8200] Initialised VAAPI connection: version 1.1
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x32315659 -> yuv420p.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x30323449 -> yuv420p.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x3231564e -> nv12.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x32595559 -> yuyv422.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x59565955 -> uyvy422.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x48323234 -> yuv422p.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x58424752 -> rgb0.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x58524742 -> bgr0.
[AVHWDeviceContext @ 0x55c0238b8200] Format 0x30313050 -> p010le.
[AVHWDeviceContext @ 0x55c0238b8200] VAAPI driver: Intel i965 driver for Intel(R) Skylake - 2.1.0.
[AVHWDeviceContext @ 0x55c0238b8200] Driver not found in known nonstandard list, using standard behaviour.
Applying option filter_complex_threads (number of threads for -filter_complex) with argument 4.
Applying option filter_threads (number of non-complex filter threads) with argument 4.
Applying option filter_complex (create a complex filtergraph) with argument [0:v]split=2[a][b]; [a]format=nv12|vaapi,hwupload,scale_vaapi=w=1280:h=720[k0]; [b]format=nv12|vaapi,hwupload,scale_vaapi=w=1080:h=720[k1].
Applying option loglevel (set logging level) with argument debug.
Successfully parsed a group of options.
Parsing a group of options: input url rtsp://0.0.0.0:2222/live.sdp.
Applying option hwaccel (use HW accelerated decoding) with argument vaapi.
Successfully parsed a group of options.
Opening an input file: rtsp://0.0.0.0:2222/live.sdp.
[tcp @ 0x55c0238dbf80] No default whitelist set
[rtsp @ 0x55c0238d9d40] SDP: v=0
o=- 0 0 IN IP4 127.0.0.1
s=No Name
c=IN IP4 127.0.0.1
t=0 0
a=tool:libavformat 58.26.101
m=video 0 RTP/AVP 96
a=rtpmap:96 H265/90000
a=fmtp:96 sprop-vps=QAEMAf//AWAAAAMAkAAAAwAAAwB4ugJA; sprop-sps=QgEBAWAAAAMAkAAAAwAAAwB4oAPAgBEHy5bpKTC8BAQAAAMABAAAAwBkIA==; sprop-pps=RAHAcYMS
a=control:streamid=0
m=audio 0 RTP/AVP 97
b=AS:96
a=rtpmap:97 MPEG4-GENERIC/48000/2
a=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=119056E500
a=control:streamid=1

[rtsp @ 0x55c0238d9d40] video codec set to: hevc
[rtsp @ 0x55c0238d9d40] audio codec set to: aac
[rtsp @ 0x55c0238d9d40] audio samplerate set to: 48000
[rtsp @ 0x55c0238d9d40] audio channels set to: 2
[rtsp @ 0x55c0238d9d40] setting jitter buffer size to 0
Last message repeated 1 times
Failed to parse interval end specification ''
[hevc @ 0x55c0238dd400] nal_unit_type: 32(VPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] nal_unit_type: 33(SPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] nal_unit_type: 34(PPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] Decoding VPS
[hevc @ 0x55c0238dd400] Main profile bitstream
[hevc @ 0x55c0238dd400] Decoding SPS
[hevc @ 0x55c0238dd400] Main profile bitstream
[hevc @ 0x55c0238dd400] Decoding VUI
[hevc @ 0x55c0238dd400] Decoding PPS
[hevc @ 0x55c0238dd400] nal_unit_type: 32(VPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] nal_unit_type: 33(SPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] nal_unit_type: 34(PPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] Decoding VPS
[hevc @ 0x55c0238dd400] Main profile bitstream
[hevc @ 0x55c0238dd400] Decoding SPS
[hevc @ 0x55c0238dd400] Main profile bitstream
[hevc @ 0x55c0238dd400] Decoding VUI
[hevc @ 0x55c0238dd400] Decoding PPS
[hevc @ 0x55c0238dd400] nal_unit_type: 20(IDR_N_LP), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c0238dd400] nal_unit_type: 1(TRAIL_R), nuh_layer_id: 0, temporal_id: 0
Last message repeated 1 times
[rtsp @ 0x55c0238d9d40] first_dts -6990 not matching first dts NOPTS (pts NOPTS, duration 3600) in the queue
[hevc @ 0x55c0238dd400] nal_unit_type: 1(TRAIL_R), nuh_layer_id: 0, temporal_id: 0
Last message repeated 18 times
[rtsp @ 0x55c0238d9d40] All info found
Input #0, rtsp, from 'rtsp://0.0.0.0:2222/live.sdp':
Metadata:
title : No Name
Duration: N/A, start: -0.139000, bitrate: N/A
Stream #0:0, 22, 1/90000: Video: hevc (Main), 1 reference frame, yuv420p(tv), 1920x1080 (1920x1088) [SAR 1:1 DAR 16:9], 0/1, 25 fps, 25 tbr, 90k tbn, 25 tbc
Stream #0:1, 42, 1/48000: Audio: aac (LC), 48000 Hz, stereo, fltp
Successfully opened the file.
[Parsed_split_0 @ 0x55c0238e6380] Setting 'outputs' to value '2'
[Parsed_format_1 @ 0x55c0238e2f40] Setting 'pix_fmts' to value 'nv12|vaapi'
[Parsed_scale_vaapi_3 @ 0x55c0238f0d40] Setting 'w' to value '1280'
[Parsed_scale_vaapi_3 @ 0x55c0238f0d40] Setting 'h' to value '720'
[Parsed_format_4 @ 0x55c0238efd40] Setting 'pix_fmts' to value 'nv12|vaapi'
[Parsed_scale_vaapi_6 @ 0x55c0238f3940] Setting 'w' to value '1080'
[Parsed_scale_vaapi_6 @ 0x55c0238f3940] Setting 'h' to value '720'
Parsing a group of options: output url /var/www/html/v_%v.m3u8.
Applying option c :a (codec name) with argument aac.
Applying option b : a:0 (video bitrate (please use -b :v)) with argument 512k.
Applying option b : a:1 (video bitrate (please use -b :v)) with argument 256k.
Applying option b: v:0 (video bitrate (please use -b :v)) with argument 4000k.
Applying option c: v:0 (codec name) with argument hevc_vaapi.
Applying option profile: v:0 (set profile) with argument high.
Applying option r: v:0 (set frame rate (Hz value, fraction or abbreviation)) with argument 29.970.
Applying option b: v:1 (video bitrate (please use -b:v)) with argument 2500k.
Applying option c: v:1 (codec name) with argument hevc_vaapi.
Applying option profile: v:1 (set profile) with argument high.
Applying option r: v:0 (set frame rate (Hz value, fraction or abbreviation)) with argument 29.970.
Applying option map (set input stream mapping) with argument [k0].
Applying option map (set input stream mapping) with argument [k1].
Applying option map (set input stream mapping) with argument 0:a.
Last message repeated 1 times
Applying option f (force format) with argument hls.
Successfully parsed a group of options.
Opening an output file: /var/www/html/v_%v.m3u8.
Successfully opened the file.
[hevc @ 0x55c023947e80] nal_unit_type: 32(VPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c023947e80] nal_unit_type: 33(SPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c023947e80] nal_unit_type: 34(PPS), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c023947e80] Decoding VPS
[hevc @ 0x55c023947e80] Main profile bitstream
[hevc @ 0x55c023947e80] Decoding SPS
[hevc @ 0x55c023947e80] Main profile bitstream
[hevc @ 0x55c023947e80] Decoding VUI
[hevc @ 0x55c023947e80] Decoding PPS
Stream mapping:
Stream #0:0 (hevc) -> split (graph 0)
scale_vaapi (graph 0) -> Stream #0:0 (hevc_vaapi)
scale_vaapi (graph 0) -> Stream #0:1 (hevc_vaapi)
Stream #0:1 -> #0:2 (aac (native) -> aac (native))
Stream #0:1 -> #0:3 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
cur_dts is invalid (this is harmless if it occurs once at the start per stream)
Last message repeated 1 times
[hevc @ 0x55c023947e80] nal_unit_type: 20(IDR_N_LP), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c023947e80] Format vaapi_vld chosen by get_format().
[hevc @ 0x55c023947e80] Format vaapi_vld requires hwaccel initialisation.
[hevc @ 0x55c023947e80] Considering format 0x3231564e -> nv12.
[hevc @ 0x55c023947e80] Picked nv12 (0x3231564e) as best match for yuv420p.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000000.
[AVHWFramesContext @ 0x7fe4940d0b40] Direct mapping disabled: derived image format 3231564e does not match expected format 32315659.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000001.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000002.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000003.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000004.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000005.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000006.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000007.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000008.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000009.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x400000a.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x400000b.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x400000c.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x400000d.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x400000e.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x400000f.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000010.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000011.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000012.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000013.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000014.
[AVHWFramesContext @ 0x7fe4940d0b40] Created surface 0x4000015.
[hevc @ 0x55c023947e80] Considering format 0x3231564e -> nv12.
[hevc @ 0x55c023947e80] Picked nv12 (0x3231564e) as best match for yuv420p.
[hevc @ 0x55c023947e80] Decode context initialised: 0x1000000/0x2000000.
[hevc @ 0x55c023947e80] Output frame with POC 0.
[hevc @ 0x55c023947e80] Param buffer (type 0, 604 bytes) is 0x8000000.
[hevc @ 0x55c023947e80] Slice 0 param buffer (264 bytes) is 0x8000001.
[hevc @ 0x55c023947e80] Slice 0 data buffer (7382 bytes) is 0x8000002.
[hevc @ 0x55c023947e80] Decode to surface 0x4000015.
[AVHWFramesContext @ 0x7fe4940d0b40] Map surface 0x4000015.
[hevc @ 0x55c023903a00] nal_unit_type: 1(TRAIL_R), nuh_layer_id: 0, temporal_id: 0
[hevc @ 0x55c023903a00] Output frame with POC 1.
[hevc @ 0x55c023903a00] Param buffer (type 0, 604 bytes) is 0x8000001.
[hevc @ 0x55c023903a00] Slice 0 param buffer (264 bytes) is 0x8000000.
[hevc @ 0x55c023903a00] Slice 0 data buffer (615 bytes) is 0x8000003.
[hevc @ 0x55c023903a00] Decode to surface 0x4000014.
[AVHWFramesContext @ 0x7fe4940d0b40] Unmap surface 0x4000015.
[Parsed_split_0 @ 0x55c023ad7840] Setting 'outputs' to value '2'
[Parsed_format_1 @ 0x55c023ae4880] Setting 'pix_fmts' to value 'nv12|vaapi'
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Setting 'w' to value '1280'
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Setting 'h' to value '720'
[Parsed_format_4 @ 0x55c023ae5d80] Setting 'pix_fmts' to value 'nv12|vaapi'
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Setting 'w' to value '1080'
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Setting 'h' to value '720'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] Setting 'video_size' to value '1920x1080'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] Setting 'pix_fmt' to value '23'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] Setting 'time_base' to value '1/90000'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] Setting 'pixel_aspect' to value '1/1'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] Setting 'sws_param' to value 'flags=2'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] Setting 'frame_rate' to value '25/1'
[graph 0 input from stream 0:0 @ 0x55c023ae8080] w:1920 h:1080 pixfmt:nv12 tb:1/90000 fr:25/1 sar:1/1 sws_param:flags=2
[format @ 0x55c023ae44c0] Setting 'pix_fmts' to value 'vaapi_vld'
[format @ 0x55c023ae6ec0] Setting 'pix_fmts' to value 'vaapi_vld'
[AVFilterGraph @ 0x55c0238e6240] query_formats: 12 queried, 11 merged, 0 already done, 0 delayed
[hwupload @ 0x55c023ae6900] Surface format is nv12.
[AVHWFramesContext @ 0x55c023aedd00] Created surface 0x4000016.
[AVHWFramesContext @ 0x55c023aedd00] Direct mapping possible.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x4000017.
[AVHWFramesContext @ 0x55c023aeef40] Direct mapping possible.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x4000018.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x4000019.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x400001a.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x400001b.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x400001c.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x400001d.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x400001e.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x400001f.
[AVHWFramesContext @ 0x55c023aeef40] Created surface 0x4000020.
[hwupload @ 0x55c023914b80] Surface format is nv12.
[AVHWFramesContext @ 0x55c023ae7ac0] Created surface 0x4000021.
[AVHWFramesContext @ 0x55c023ae7ac0] Direct mapping possible.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000022.
[AVHWFramesContext @ 0x55c023ae5ac0] Direct mapping possible.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000023.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000024.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000025.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000026.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000027.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000028.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x4000029.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x400002a.
[AVHWFramesContext @ 0x55c023ae5ac0] Created surface 0x400002b.
[AVHWFramesContext @ 0x55c023ae7ac0] Map surface 0x4000021.
[AVHWFramesContext @ 0x55c023ae7ac0] Unmap surface 0x4000021.
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Filter input: vaapi_vld, 1920x1080 (0).
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Using surface 0x4000021 for scale input.
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Using surface 0x400002b for scale output.
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Pipeline parameter buffer is 0x8000002.
[Parsed_scale_vaapi_3 @ 0x55c023ae5380] Filter output: vaapi_vld, 1280x720 (0), mode: HQ.
[AVHWFramesContext @ 0x55c023aedd00] Map surface 0x4000016.
[AVHWFramesContext @ 0x55c023aedd00] Unmap surface 0x4000016.
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Filter input: vaapi_vld, 1920x1080 (0).
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Using surface 0x4000016 for scale input.
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Using surface 0x4000020 for scale output.
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Pipeline parameter buffer is 0x8000002.
[Parsed_scale_vaapi_6 @ 0x55c023ae7000] Filter output: vaapi_vld, 1080x720 (0), mode: HQ.
[h265_vaapi @ 0x7fe49d260040] [Eval @ 0x7ffc773a5220] Undefined constant or missing '(' in 'high'
[h265_vaapi @ 0x7fe49d260040] Unable to parse option value "high"
[h265_vaapi @ 0x7fe49d260040] Error setting option profile to value high.
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height
Conversion failed!

    Stream Sending command log    *ffmpeg -stream_loop -1 -i /home/pas/Downloads/angrybird.mp4 -c:v libx265 -preset ultrafast -tune zerolatency -c:a aac -ab 96k -ar 48000 -f rtsp -rtsp_transport tcp  rtsp://0.0.0.0:2222/live.sdp*

Output #0, rtsp, to 'rtsp://0.0.0.0:2222/live.sdp':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf58.26.101
Stream #0:0(und), 0, 1/90000: Video: hevc (libx265), 1 reference frame, yuv420p(left), 1920x1080 [SAR 1:1 DAR 16:9], 0/1, q=2-31, 25 fps, 90k tbn, 25 tbc (default)
Metadata:
handler_name : ISO Media file produced by Google Inc. Created on: 03/29/2019.
encoder : Lavc58.47.105 libx265
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
Stream #0:1(eng), 0, 1/48000: Audio: aac (LC), 48000 Hz, stereo, fltp, delay 1024, 96 kb/s (default)
Metadata:
handler_name : ISO Media file produced by Google Inc. Created on: 03/29/2019.
encoder : Lavc58.47.105 aac
Clipping frame in rate conversion by 0.000008
cur_dts is invalid (this is harmless if it occurs once at the start per stream)
Last message repeated 2 times
[h264 @ 0x55c46586f880] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
cur_dts is invalid (this is harmless if it occurs once at the start per stream)
Last message repeated 2 times
[h264 @ 0x55c4656c8b00] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 8 of len 7381 M=1
[rtp @ 0x55c465f68e40] NAL size 7381 > 1460
[h264 @ 0x55c465732800] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 614 M=1
[h264 @ 0x55c465821380] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 990 M=1
[h264 @ 0x55c4656edec0] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 1392 M=1
[h264 @ 0x55c46586f880] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 1949 M=1
[rtp @ 0x55c465f68e40] NAL size 1949 > 1460
[h264 @ 0x55c4656c8b00] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 2282 M=1
[rtp @ 0x55c465f68e40] NAL size 2282 > 1460
[h264 @ 0x55c465732800] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 2019 M=1
[rtp @ 0x55c465f68e40] NAL size 2019 > 1460
[h264 @ 0x55c465821380] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 2176 M=1
[rtp @ 0x55c465f68e40] NAL size 2176 > 1460
[h264 @ 0x55c4656edec0] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 3690 M=1
[rtp @ 0x55c465f68e40] NAL size 3690 > 1460
[h264 @ 0x55c46586f880] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 3161 M=1
[rtp @ 0x55c465f68e40] NAL size 3161 > 1460
[h264 @ 0x55c4656c8b00] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 3902 M=1
[rtp @ 0x55c465f68e40] NAL size 3902 > 1460
[h264 @ 0x55c465732800] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 3690 M=1
[rtp @ 0x55c465f68e40] NAL size 3690 > 1460
[h264 @ 0x55c465821380] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4344 M=1
[rtp @ 0x55c465f68e40] NAL size 4344 > 1460
[h264 @ 0x55c4656edec0] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4786 M=1
[rtp @ 0x55c465f68e40] NAL size 4786 > 1460
[h264 @ 0x55c46586f880] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 6049 M=1
[rtp @ 0x55c465f68e40] NAL size 6049 > 1460
[h264 @ 0x55c4656c8b00] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 5907 M=1
[rtp @ 0x55c465f68e40] NAL size 5907 > 1460
[h264 @ 0x55c465732800] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4360 M=1
[rtp @ 0x55c465f68e40] NAL size 4360 > 1460
[h264 @ 0x55c465821380] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4206 M=1
[rtp @ 0x55c465f68e40] NAL size 4206 > 1460
[h264 @ 0x55c4656edec0] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 3678 M=1
[rtp @ 0x55c465f68e40] NAL size 3678 > 1460
[h264 @ 0x55c46586f880] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4295 M=1
[rtp @ 0x55c465f68e40] NAL size 4295 > 1460
[h264 @ 0x55c4656c8b00] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 3561 M=1
[rtp @ 0x55c465f68e40] NAL size 3561 > 1460
[h264 @ 0x55c465732800] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4098 M=1
[rtp @ 0x55c465f68e40] NAL size 4098 > 1460
[h264 @ 0x55c465821380] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4160 M=1
[rtp @ 0x55c465f68e40] NAL size 4160 > 1460
[h264 @ 0x55c4656edec0] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 0
[rtp @ 0x55c465f68e40] Sending NAL 2 of len 4320 M=1
[rtp @ 0x55c465f68e40] NAL size 4320 > 1460
[h264 @ 0x55c46586f880] nal_unit_type: 1(Coded slice of a non-IDR picture), nal_ref_idc: 2
av_interleaved_write_frame(): Broken pipe
No more output streams to write to, finishing.
av_interleaved_write_frame(): Broken pipe
Error writing trailer of rtsp://0.0.0.0:2222/live.sdp: Broken pipe
frame= 27 fps=0.0 q=-0.0 Lsize=N/A time=00:00:01.17 bitrate=N/A speed=1.74x
video:89kB audio:14kB subtitle:0kB other streams:0kB global headers:2kB muxing overhead: unknown
Input file #0 (/home/pas/Downloads/angry.mp4):
Input stream #0:0 (video): 32 packets read (131732 bytes); 28 frames decoded;
Input stream #0:1 (audio): 52 packets read (19843 bytes); 52 frames decoded (53248 samples);
Total: 84 packets (151575 bytes) demuxed
Output file #0 (rtsp://0.0.0.0:2222/live.sdp):
Output stream #0:0 (video): 27 frames encoded; 25 packets muxed (91489 bytes);
Output stream #0:1 (audio): 56 frames encoded (57344 samples); 56 packets muxed (14844 bytes);
Total: 81 packets (106333 bytes) muxed
80 frames successfully decoded, 0 decoding errors
x265 [info]: frame I: 1, Avg QP:25.09 kb/s: 1476.20
x265 [info]: frame P: 26, Avg QP:24.31 kb/s: 720.17
x265 [info]: consecutive B-frames: 100.0%

encoded 27 frames in 0.65s (41.22 fps), 748.17 kb/s, Avg QP:24.34
[aac @ 0x55c4656f0100] Qavg: 6812.111
[AVIOContext @ 0x55c465698640] Statistics: 500410 bytes read, 2 seeks
Conversion failed!
pas@pas-To-be-filled-by-O-E-M:~$

@Brainiarc7
Copy link
Author

Brainiarc7 commented Apr 5, 2019

Can you show me the output of vainfo and ffmpeg -h encoder=hevc_vaapi?
I need to confirm something with that info

@namespace7
Copy link

namespace7 commented Apr 6, 2019

  vainfo

sudo ./ffmpeg -hwaccel vaapi vainfo -vaapi_device /dev/dri/renderD128 -rtsp_flags listen -threads:v 2 -threads:a 4 -filter_complex_threads 4 -filter_threads 4 -i rtsp://0.0.0.0:2222/live.sdp -filter_complex "[0:v]split=2[a][b]; [a]format=nv12|vaapi,hwupload,scale_vaapi=w=1280:h=720[k0]; [b]format=nv12|vaapi,hwupload,scale_vaapi=w=1080:h=720[k1]" -c:a aac -b: a :0 512k -b: a:1 256k -b: v:0 4000k -minrate: v:0 4000k -maxrate: v :0 4000k -bufsize: v :0 533k -c: v:0 hevc_vaapi -qp: v:0 19 -profile: v:0 high -rc_mode: v:0 2 -level: v:0 4.1 -r: v:0 29.970 -g: v:0 60 -bf: v:0 3 -b: v:1 2500k -minrate: v:1 2500k -maxrate: v:1 2500k -bufsize: v:1 333k -c: v:1 hevc_vaapi -qp: v:1 19 -profile: v:1 high -rc_mode: v:1 2 -level: v:1 4.1 -r: v:0 29.970 -g: v:0 60 -bf: v:1 3 -flags +global_header+low_delay -fflags +genpts -map "[k0]" -map "[k1]" -map 0:a -map 0:a -f hls -hls_init_time 3 -hls_list_size 10 -hls_flags delete_segments -var_stream_map "v:0,a:0 v:1,a:1" -master_pl_name "new.m3u8" -hls_segment_filename "/var/www/html/v-%d-%v.ts" "/var/www/html/v_%v.m3u8"
ffmpeg version N-93468-g6bc800d Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 7 (Ubuntu 7.3.0-27ubuntu1~18.04)
configuration: --prefix=/home/pas/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/pas/ffmpeg_build/include --extra-ldflags=-L/home/pas/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/pas/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
libavutil 56. 26.100 / 56. 26.100
libavcodec 58. 47.105 / 58. 47.105
libavformat 58. 26.101 / 58. 26.101
libavdevice 58. 7.100 / 58. 7.100
libavfilter 7. 48.100 / 7. 48.100
libswscale 5. 4.100 / 5. 4.100
libswresample 3. 4.100 / 3. 4.100
libpostproc 55. 4.100 / 55. 4.100
Input #0, rtsp, from 'rtsp://0.0.0.0:2222/live.sdp':
Metadata:
title : No Name
Duration: N/A, start: -0.144000, bitrate: N/A
Stream #0:0: Video: hevc (Main), yuv420p(tv), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 25 tbc
Stream #0:1: Audio: aac (LC), 48000 Hz, stereo, fltp
Option hwaccel (use HW accelerated decoding) cannot be applied to output url vainfo -- you are trying to apply an input option to an output file or vice versa. Move this option before the file it belongs to.
Error parsing options for output file vainfo.
Error opening output files: Invalid argument

  ffmpeg -h encoder=hevc_vaapi

sudo ./ffmpeg -h encoder=hevc_vaapi
ffmpeg version N-93468-g6bc800d Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 7 (Ubuntu 7.3.0-27ubuntu1~18.04)
configuration: --prefix=/home/pas/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/pas/ffmpeg_build/include --extra-ldflags=-L/home/pas/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/pas/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
libavutil 56. 26.100 / 56. 26.100
libavcodec 58. 47.105 / 58. 47.105
libavformat 58. 26.101 / 58. 26.101
libavdevice 58. 7.100 / 58. 7.100
libavfilter 7. 48.100 / 7. 48.100
libswscale 5. 4.100 / 5. 4.100
libswresample 3. 4.100 / 3. 4.100
libpostproc 55. 4.100 / 55. 4.100
Encoder hevc_vaapi [H.265/HEVC (VAAPI)]:
General capabilities: delay hardware
Threading capabilities: none
Supported pixel formats: vaapi_vld
h265_vaapi AVOptions:
-low_power E..V..... Use low-power encoding mode (only available on some platforms; may not support all encoding features) (default false)
-idr_interval E..V..... Distance (in I-frames) between IDR frames (from 0 to INT_MAX) (default 0)
-b_depth E..V..... Maximum B-frame reference depth (from 1 to INT_MAX) (default 1)
-rc_mode E..V..... Set rate control mode (from 0 to 6) (default auto)
auto E..V..... Choose mode automatically based on other parameters
CQP E..V..... Constant-quality
CBR E..V..... Constant-bitrate
VBR E..V..... Variable-bitrate
ICQ E..V..... Intelligent constant-quality
QVBR E..V..... Quality-defined variable-bitrate
AVBR E..V..... Average variable-bitrate
-qp E..V..... Constant QP (for P-frames; scaled by qfactor/qoffset for I/B) (from 0 to 52) (default 0)
-aud E..V..... Include AUD (default false)
-profile E..V..... Set profile (general_profile_idc) (from -99 to 255) (default -99)
main E..V.....
main10 E..V.....
rext E..V.....
-tier E..V..... Set tier (general_tier_flag) (from 0 to 1) (default main)
main E..V.....
high E..V.....
-level E..V..... Set level (general_level_idc) (from -99 to 255) (default -99)
1 E..V.....
2 E..V.....
2.1 E..V.....
3 E..V.....
3.1 E..V.....
4 E..V.....
4.1 E..V.....
5 E..V.....
5.1 E..V.....
5.2 E..V.....
6 E..V.....
6.1 E..V.....
6.2 E..V.....
-sei E..V..... Set SEI to include (default hdr)
hdr E..V..... Include HDR metadata for mastering display colour volume and content light level information

@Brainiarc7
Copy link
Author

Brainiarc7 commented Apr 9, 2019

I've fixed the sample above.
It seems that the previous profile (high) doesn't exist for the hevc_vaapi encoder. It's only main, main10 and rext.

@mattold7
Copy link

mattold7 commented May 6, 2019

I have a question for those using hardware transcoding. When I use the qp setting of lets say 18 its not the same as using crf of 18 and I understand that, but for those using this how are you doing your transcoding, are you using two pass VBR to get similar results of crf, what I'm really looking for the basically visually lossless and reduced file size? I'm trying to find a better way using h264_vaapi purely for archival purposes.

@Brainiarc7
Copy link
Author

Brainiarc7 commented Jul 3, 2019

@mattold7 what driver are you using with VAAPI? Show me the output of vainfo.
You may also reach me directly via email, thanks.

@barolo
Copy link

barolo commented Jul 10, 2019

I'm trying to transcode 10bit hevc into 8bit h264_vaapi, but the output is garbled [ half of the screen flashes green ] on AMD RAVEN APU.
Could you check if I'm doing it properly?

ffmpeg
-init_hw_device vaapi=amd:/dev/dri/renderD128 -hwaccel vaapi -hwaccel_output_format vaapi
-hwaccel_device amd -filter_hw_device amd
-i nexp.mkv'
-vf "scale_vaapi=format=nv12,hwupload" -threads 6
-c:v h264_vaapi -profile:v 578
-c:a copy -bf 0 -c:s copy
-f mpegts -y plop.mkv

vainfo:
libva info: VA-API version 1.6.0
libva info: va_getDriverName() returns 0
libva info: Trying to open /usr/lib64/va/drivers/radeonsi_drv_video.so
libva info: Found init function __vaDriverInit_1_6
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.6 (libva 2.6.0.pre1)
vainfo: Driver version: Mesa Gallium driver 19.2.0-devel for AMD RAVEN (DRM 3.32.0, 5.2.0-gentoo, LLVM 8.0.0)
vainfo: Supported profile and entrypoints
VAProfileMPEG2Simple : VAEntrypointVLD
VAProfileMPEG2Main : VAEntrypointVLD
VAProfileVC1Simple : VAEntrypointVLD
VAProfileVC1Main : VAEntrypointVLD
VAProfileVC1Advanced : VAEntrypointVLD
VAProfileH264ConstrainedBaseline: VAEntrypointVLD
VAProfileH264ConstrainedBaseline: VAEntrypointEncSlice
VAProfileH264Main : VAEntrypointVLD
VAProfileH264Main : VAEntrypointEncSlice
VAProfileH264High : VAEntrypointVLD
VAProfileH264High : VAEntrypointEncSlice
VAProfileHEVCMain : VAEntrypointVLD
VAProfileHEVCMain : VAEntrypointEncSlice
VAProfileHEVCMain10 : VAEntrypointVLD
VAProfileJPEGBaseline : VAEntrypointVLD
VAProfileVP9Profile0 : VAEntrypointVLD
VAProfileVP9Profile2 : VAEntrypointVLD
VAProfileNone : VAEntrypointVideoProc

@mj43
Copy link

mj43 commented Aug 12, 2019

I am trying to use vaapi to cutdown on cpu load as I have fairly low level systems z8350 (Cherrytrail) and N4200 (Broxton). When I use libx264 cpu on the z8350 usage is +95% and video is soft, situation with the N4200 is a bit better but leaves a bit to be desired in terms of video quality.
Using vaapi encoding gives better results and cuts overall CPU usage to ~50% z8350 and <50% N4200. However, there appears to be a memory leak and I can watch RAM usage creep from 600MB up until after about 15 minutes my available 3.7GB are used up and the system locks up. This occurs on both machines, OS in both cases is Ubuntu 18.04.3 LTS.
Is memory leak with vaapi not an issue with your build of FFMPEG? I ask as I am using the standard Ubuntu build.

ffmpeg -y -vaapi_device /dev/dri/renderD128 -i overlays/VB12.png -thread_queue_size 32768 -f rawvideo -vcodec rawvideo -s 1280x720 -pix_fmt bgr24 -framerate 25 -i - -filter_complex [1:v][0:v]overlay=705:572, format=nv12,hwupload -thread_queue_size 65536 -f alsa -ac 1 -i hw:0 -af adelay=250, volume=1, atempo=1.0 -vcodec h264_vaapi -qp:v 23 -profile:v 100 -level:v 31 /media/mark/Test/VR100test_0828.mp4

ffmpeg version 4.1.4-0york318.04 Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 7 (Ubuntu 7.4.0-1ubuntu1
18.04.1)
configuration: --prefix=/usr --extra-version='0york3~18.04' --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-nonfree --enable-libfdk-aac --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 22.100 / 56. 22.100
libavcodec 58. 35.100 / 58. 35.100
libavformat 58. 20.100 / 58. 20.100
libavdevice 58. 5.100 / 58. 5.100
libavfilter 7. 40.101 / 7. 40.101
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 3.100 / 5. 3.100
libswresample 3. 3.100 / 3. 3.100
libpostproc 55. 3.100 / 55. 3.100
Input #0, png_pipe, from 'overlays/VB12.png':
Duration: N/A, bitrate: N/A
Stream #0:0: Video: png, pal8(pc), 575x148 [SAR 11810:11810 DAR 575:148], 25 tbr, 25 tbn, 25 tbc
Input #1, rawvideo, from 'pipe:':
Duration: N/A, start: 0.000000, bitrate: 552960 kb/s
Stream #1:0: Video: rawvideo (BGR[24] / 0x18524742), bgr24, 1280x720, 552960 kb/s, 25 tbr, 25 tbn, 25 tbc
Guessed Channel Layout for Input Stream #2.0 : mono
Input #2, alsa, from 'hw:0':
Duration: N/A, start: 1565594935.407496, bitrate: 768 kb/s
Stream #2:0: Audio: pcm_s16le, 48000 Hz, mono, s16, 768 kb/s
Stream mapping:
Stream #0:0 (png) -> overlay:overlay (graph 0)
Stream #1:0 (rawvideo) -> overlay:main (graph 0)
hwupload (graph 0) -> Stream #0:0 (h264_vaapi)
Stream #2:0 -> #0:1 (pcm_s16le (native) -> aac (native))
Output #0, mp4, to '/media/mark/Test/VR100test_0828.mp4':
Metadata:
encoder : Lavf58.20.100
Stream #0:0: Video: h264 (h264_vaapi) (High) (avc1 / 0x31637661), vaapi_vld(progressive), 1280x720, q=-1--1, 25 fps, 12800 tbn, 25 tbc (default)
Metadata:
encoder : Lavc58.35.100 h264_vaapi
Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 69 kb/s
Metadata:
encoder : Lavc58.35.100 aac

@Brainiarc7
Copy link
Author

Brainiarc7 commented Aug 16, 2019

Hello @mj43,

You'd be best sorted by building FFmpeg + Libva components from source.
The git tip on FFmpeg sees a lot of commits, often with bug fixes and this is why I cannot recommend release versions for any production workflow.

@barolo that sounds like a bug in the radeonsi VAAPI driver, perhaps you should report that upstream?
The dri-devel mailing list is a good place to start.
For Intel-related bugs (such as with their vaapi drivers, i965 and iHD respectively), report these to the respective projects.
You may also want to post the same bug report on libva.

@barolo
Copy link

barolo commented Aug 16, 2019

@Brainiarc7
Reported it both to mesa and ffmpeg month ago, no response so far.
Solved it by using command below, unsure if it's a proper solution [ changing 10->8bit pixel format with hwaccel ]:

ffmpeg -threads 4 -init_hw_device vaapi=amd:/dev/dri/renderD128
-hwaccel vaapi -hwaccel_output_format vaapi -hwaccel_device amd -filter_hw_device amd
-i test.mkv \
-vf "hwdownload,format=p010,format=nv12,hwupload" \
-c:v h264_vaapi -profile:v 578 -c:a copy -c:s copy
-f mpegts out.mkv

@ferdnyc
Copy link

ferdnyc commented Sep 13, 2019

@Brainiarc7 Great resource, thanks.

Just a quick housekeeping request: Do you think you could line-wrap the sudo apt-get command line, and the two ffmpeg commands in your Haswell example, the same way you did the earlier ffmpeg examples? The three I mentioned are kind of #XXXtreemHorizontalScrolling right now. Thx!

(And as always, curse you GitHub for capping the page width, when you know you have to display unwrapped <pre> blocks.)

@Brainiarc7
Copy link
Author

Brainiarc7 commented Sep 13, 2019

@martinpickett
Copy link

martinpickett commented Nov 3, 2019

@Brainiarc7 Thank you for this guide (and the many other covering similar topics), I have found them very helpful.

I have had a lot of success with single pass VBR encoding, but more recently I have been attempting two-pass encoding with FFmpeg and h264_vaapi. For the first pass I have been using a modified version of the command line you suggest in this guide, however the "ffmpeg2pass.log" file is empty. Can you tell me what I am doing wrong? The exact command line I am running is:

ffmpeg -loglevel error -stats -hwaccel vaapi -i "input.mkv" -vaapi_device /dev/dri/renderD128 -vf 'format=nv12,hwupload' -pass 1 -b:v 6M -c:v h264_vaapi -threads 4 -aspect 16:9 -an -y -f matroska "/dev/null"

Many thanks for your guides and any help you can provide,
Martin

@Brainiarc7
Copy link
Author

Brainiarc7 commented Nov 3, 2019

@martinpickett two pass encoding is not implemented in these encoders. That's speaking for both VAAPI and QSV.

To my knowledge, the only hardware-accelerated encoder that implements anything close to what you're looking for is NVENC, and even then, that option is not exposed to the FFmpeg CLI but activated internally by the use of the private options -2pass:v 1 or by using the slow preset in the NVENC encoders.

See ffmpeg -h encoder=h264_nvenc and ffmpeg -h hevc_nvenc for more details on the same.

Glad you found this useful.

@martinpickett
Copy link

martinpickett commented Nov 5, 2019

@Brainiarc7 Thank you for the quick response. I will have a look and NVENC.

@Anan5a
Copy link

Anan5a commented Nov 29, 2019

I would like to request a bash script. As it is easy for noobs!

Also i think many library/encoder don't need to be compiled as they come in the repository

@koreanfan
Copy link

koreanfan commented Jan 30, 2020

Hello. I want to stream dota2 gameplay with amd rx560 video with proc fx-8300. I try obs on my debian buster and it works fine with x264. But i dont need many features from obs, i need simple stream. So i create 2 scripts. One of them start streaming and another stop streaming. But i have pixelate on my stream and video have micro freezes. With obs i dont have those issues. Below 2 scripts used by me:
1)start_streaming.sh
#!/bin/bash
ffmpeg -f x11grab -s 1920x1080 -r 30 -i :0.0 -f pulse -i 0 -f flv -ac 2 -ar 44100
-vcodec libx264 -g 60 -keyint_min 30 -b:v 6000k -minrate 6000k -maxrate 6000k -pix_fmt yuv420p
-s 1920x1080 -preset ultrafast -tune film -acodec aac -threads 0 -strict normal
-bufsize 6000k "rtmp://live.restream.io/live/mystreamkey"
2)stop_stream.sh
#!/bin/bash
pkill ffmpeg

I use 2 keybshortcut for those scripts to run stream and stop stream. Can you help me please to fix this issues and how i can use amd vaapi for streaming?

@shperrung
Copy link

shperrung commented Mar 14, 2020

Hi!
I use ffmpeg --libvidstab-enable library for de-shaking videos made my mom. I found this 2-pass method that perfectly work in case of software codec's (one command for seeking files by name mask -> shaking analysis -> EIS with encoding into preferable format:

find * -type f -size +10M ( -iname "mp4" ! -iname "_resized*" ) -exec ffmpeg -threads 3 -i {} -vf vidstabdetect=result="transforms.trf" -f null NUL ";" -exec ffmpeg -i {} -vf vidstabtransform=smoothing=30:input="transforms.trf" -c:v libx264 -preset veryslow -crf 18 -c:a copy '{}_resized_stab.mp4' ";" -exec rm ./transforms.trf ";"

How to use it with HW transcode?
#First pass:
ffmpeg -threads auto -i phone.MOV -vf vidstabdetect=result="transforms.trf" -f null NUL
#successfully completed
#Second pass:
ffmpeg -loglevel debug -hwaccel vaapi -vaapi_device /dev/dri/renderD128 -i phone.MOV -filter_complex 'hwupload,format=nv12, hwdownload,vidstabtransform=smoothing=30:input="transforms.trf",format=nv12,hwupload' -map 0:0 -map 0:1 -threads 2 -f mp4 -c:a aac -ab 128k -vcodec h264_vaapi -qp 19 -bf 2 phone_hw.mp4
#Is stopped with error

[mov,mp4,m4a,3gp,3g2,mj2 @ 0x55e5df12f080] stts: 303354 ctts: -20, ctts_index: 15168, ctts_count: 22990
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x55e5d
[h264 @ 0x55e5df14d280] Param buffer (type 1, 240 bytes) is 0x8000002.
[h264 @ 0x55e5df14d280] Slice 0 param buffer (3128 bytes) is 0x8000001.            [h264 @ 0x55e5df14d280] Slice 0 data buffer (80523 bytes) is 0x8000000.
[h264 @ 0x55e5df14d280] Decode to surface 0x4000013.                               [AVHWFramesContext @ 0x7f5e38078200] Unmap surface 0x4000018.
[Parsed_format_1 @ 0x55e5df3be8c0] Setting 'pix_fmts' to value 'nv12'              [Parsed_vidstabtransform_3 @ 0x55e5df3bfa80] Setting 'smoothing' to value '30'
[Parsed_vidstabtransform_3 @ 0x55e5df3bfa80] Setting 'input' to value '"transforms.trf"'
[Parsed_vidstabtransform_3 @ 0x55e5df3bfa80] vidstabtransform filter: init v1.1 (2015-05-16)
[Parsed_format_4 @ 0x55e5df3c0bc0] Setting 'pix_fmts' to value 'nv12'              [graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'video_size' to value '1920x1080'                                                                            [graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'pix_fmt' to value '23'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'time_base' to value '1/600'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'pixel_aspect' to value '0/1'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'sws_param' to value 'flags=2'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'frame_rate' to value '30/1'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] w:1920 h:1080 pixfmt:nv12 tb:1/600 fr:30/1 sar:0/1 sws_param:flags=2
[format @ 0x55e5df3bf1c0] Setting 'pix_fmts' to value 'vaapi_vld'
[auto_scaler_0 @ 0x55e5df3c5380] w:iw h:ih flags:'bilinear' interl:0
[Parsed_format_1 @ 0x55e5df3be8c0] auto-inserting filter 'auto_scaler_0' between the filter 'Parsed_hwupload_0' and the filter 'Parsed_format_1'
Impossible to convert between the formats supported by the filter 'Parsed_hwupload_0' and the filter 'auto_scaler_0'
Error reinitializing filters!
Failed to inject frame into filter network: Function not implemented
Error while processing the decoded data for stream #0:1
[AVIOContext @ 0x55e5df164b40] Statistics: 0 seeks, 0 writeouts
[aac @ 0x55e5df165580] Qavg: 4083.935
[aac @ 0x55e5df165580] 2 frames left in the queue on closing
[AVIOContext @ 0x55e5df137f00] Statistics: 1102747 bytes read, 11 seeks
Conversion failed!
Press any key to continue...

@ferdnyc
Copy link

ferdnyc commented Mar 15, 2020

@shperrung I'm no expert, but this looks bad to me:


[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'pixel_aspect' to value '0/1'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'sws_param' to value 'flags=2'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] Setting 'frame_rate' to value '30/1'
[graph 0 input from stream 0:1 @ 0x55e5df3c2180] w:1920 h:1080 pixfmt:nv12 tb:1/600 fr:30/1 sar:0/1 sws_param:flags=2
                                                                                           ^^^^^^^^^

Perhaps adding an -aspect argument, or adding scale=1920:1080,setsar=_something_ to your filter chain, would help?

@shperrung
Copy link

shperrung commented Mar 19, 2020

Hi, ferdnyc!
Unfortunately, I couldn't find right combination of these filters. Looks like -vidstabtansform filter is not compatible with HW transcode. I anyway get

[format @ 0x5594a3faf780] Setting 'pix_fmts' to value 'vaapi_vld'
[auto_scaler_0 @ 0x5594a3fb2cc0] w:iw h:ih flags:'bilinear' interl:0
[Parsed_format_1 @ 0x5594a3fad8c0] auto-inserting filter 'auto_scaler_0' between the filter 'Parsed_hwupload_0' and the filter 'Parsed_format_1'
Impossible to convert between the formats supported by the filter 'Parsed_hwupload_0' and the filter 'auto_scaler_0'
Error reinitializing filters!

@Odianosen25
Copy link

Odianosen25 commented Jul 1, 2020

Hello @Brainiarc7, thanks your your invaluable information, and it has been so instrumental in me understanding ffmpeg. I have been able to develop some good recording with hardware acceleration based on your example, and I wanted to do same for HLS. I use the following for my HLS

ffmpeg -init_hw_device vaapi=intel:/dev/dri/renderD128 -hwaccel_device intel -hwaccel vaapi -hwaccel_output_format vaapi -i /dev/video0 -filter_hw_device intel -vf 'format=nv12|vaapi,hwupload' -vcodec h264_vaapi -qp 25 -acodec copy -hls_time 1 -hls_list_size 2 -hls_init_time 1 -hls_flags delete_segments -hls_segment_filename 'file%03d.mp4' output.m3u8

It works but its like almost 30 seconds behind live. Compared to using CPU which is under 5 seconds. Any ideas why this is the case please? Been on this for weeks now.

Kind regards

@ferdnyc
Copy link

ferdnyc commented Jul 1, 2020

@Odianosen25:

Perhaps this comment on a StackOverflow question might shed some light?

It needs 3 segments before playback. Using hls-time is not enough though, you also need to specify a keyframe interval of 1s. You can use the -g (GOP size) option for that. Eg: -g 30 will insert an iframe each 30 frames and since your framerate is 30 fps that translates to 1 iframe / s

It seems likely that the more-efficient hardware encoder could be inserting keyframes less frequently than the CPU, by default.

@Odianosen25
Copy link

Odianosen25 commented Jul 1, 2020

@ferdnyc thanks and I will try as said. I use the -g option for the CPU version and yes it helps. But I didn’t see it for the h264_vaapi encoder, so will try it and get back.

Kind regards

@ferdnyc
Copy link

ferdnyc commented Jul 1, 2020

@Odianosen25 Yeah, looking at the API docs gop_size is part of the VAAPIEncodeContext structure, so it looks like the same FFmpeg -g flag is respected whether the encoder is using the CPU or GPU.

The -b_depth and -idr_interval flags specific to h264_vaapi sound like they could also be meaningful here, except the default values are already a conservative 1 and 0 (respectively) so there isn't really any room for improvement there.

EDIT: As an alternative, hls_flags takes a split_by_time flag that forces splitting at hls_time intervals, even if the split point is not a keyframe. It sounds like that's fraught with peril, though, so setting -g is probably the better approach.

@Odianosen25
Copy link

Odianosen25 commented Jul 1, 2020

Wow @ferdnyc you just saved me weeks of head cracking stuff. Can't believe I spent so much time on this stuff, and all I needed was to add the -g flag. After spending weeks trying to figure it out, now I feel stupid> Thanks again. Now my CPU can relax and focus on other things ;). Even the compression is so amazing, less than 60k per segment. CPU gave over 3 times that

@ferdnyc
Copy link

ferdnyc commented Jul 1, 2020

🎉 @Odianosen25 That's great, glad to hear it was so effective! SO user aergistal deserves the real credit, I just got lucky with the googles.

@Odianosen25
Copy link

Odianosen25 commented Jul 21, 2020

@Brainiarc7 or @ferdnyc,thanks for the help so far. I am trying to make use of hardware acceleration for decode, and then get the frames, but I seem to be having an issue doing it completely in hardware. I ran the following

'ffmpeg', '-y', '-hide_banner', '-init_hw_device', 'vaapi=intel:/dev/dri/renderD128', '-hwaccel_device', 'intel', '-hwaccel', 'vaapi', '-hwaccel_output_format', 'vaapi', '-thread_queue_size', '16', '-f', 'v4l2', '-i', '/dev/video0', '-filter_hw_device', 'intel', '-vf', 'format=nv12|vaapi,hwupload,scale_vaapi=w=1080:h=1920:format=nv12,hwdownload', '-f','rawvideo', '-pix_fmt', 'bgr24', '-']

And I get

[hwdownload @ 0x5574560e5480] Invalid output format bgr24 for hwframe download.
[Parsed_hwdownload_3 @ 0x5574560e6100] Failed to configure output pad on Parsed_hwdownload_3
Error reinitializing filters!
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #0:0
[video4linux2,v4l2 @ 0x5574560d7080] Some buffers are still owned by the caller on close

If I remove the filter, it works all good. Now I have an rtsp stream, that also doesn't work; but a strange thing with that, is that it wouldn't work unless I remove ``hwaccel_output_format', 'vaapi'`

So if I run

['ffmpeg', '-y', '-hide_banner', '-init_hw_device', 'vaapi=intel:/dev/dri/renderD128', '-hwaccel_device', 'intel', '-hwaccel', 'vaapi', '-hwaccel_output_format', 'vaapi', '-thread_queue_size', '16', '-rtsp_transport', 'tcp', '-i', 'rtsp://admin:@192.168.0.100:554', '-f', 'rawvideo', '-pix_fmt', 'bgr24', '-']

It tells me

Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scaler_0'
Error reinitializing filters!
Failed to inject frame into filter network: Function not implemented
Error while processing the decoded data for stream #0:0

But removing ``hwaccel_output_format', 'vaapi'`,all works good. Any ideas please?

Regards

@briantbutton
Copy link

briantbutton commented Mar 24, 2021

@Odianosen25, me too.

I have been banging on this particular outcome for two months. Always on Ubuntu 20.04, with good old H.264 (MP4) but I cannot seem to get away from the "Impossible to convert" message. I have gone from an AMD processor and an Intel i3 core. I am now wondering, "can I find a config that WILL work". (Kindly note that I have tried about 150 parameters combinations in my search for the holy grail.)

In the two lines below, note the first one. Where do these filters come from? Is it possible to understand that, not to mention control it?

[format @ 0x5641a8f95f40] auto-inserting filter 'auto_scaler_0' between the filter 'Parsed_null_0' and the filter 'format' Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scaler_0' E

I did a search on 'auto_scaler_0' and ALL I got were complaints about the error message "Impossible to convert". I cannot find any information about it, other than it's proximity to failed video transcodes.

@sgjava
Copy link

sgjava commented Jan 14, 2022

@Brainiarc7 Trying to get this working headless. And I get:

No VA display found for device /dev/dri/renderD128.
Device creation failed: -22.
Failed to set value '/dev/dri/renderD128' for option 'vaapi_device': Invalid argument

vainfo will work without X using the following, but ffmpeg????

vainfo --display drm 
libva info: VA-API version 1.14.0
libva info: Trying to open /usr/local/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_14
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.14 (libva 2.14.0.pre1)
vainfo: Driver version: Intel iHD driver for Intel(R) Gen Graphics - 22.2.0 (35dc70f41)
vainfo: Supported profile and entrypoints
      VAProfileNone                   :	VAEntrypointVideoProc
      VAProfileNone                   :	VAEntrypointStats
      VAProfileMPEG2Simple            :	VAEntrypointVLD
      VAProfileMPEG2Main              :	VAEntrypointVLD
      VAProfileH264Main               :	VAEntrypointVLD
      VAProfileH264Main               :	VAEntrypointEncSlice
      VAProfileH264Main               :	VAEntrypointFEI
      VAProfileH264Main               :	VAEntrypointEncSliceLP
      VAProfileH264High               :	VAEntrypointVLD
      VAProfileH264High               :	VAEntrypointEncSlice
      VAProfileH264High               :	VAEntrypointFEI
      VAProfileH264High               :	VAEntrypointEncSliceLP
      VAProfileVC1Simple              :	VAEntrypointVLD
      VAProfileVC1Main                :	VAEntrypointVLD
      VAProfileVC1Advanced            :	VAEntrypointVLD
      VAProfileJPEGBaseline           :	VAEntrypointVLD
      VAProfileJPEGBaseline           :	VAEntrypointEncPicture
      VAProfileH264ConstrainedBaseline:	VAEntrypointVLD
      VAProfileH264ConstrainedBaseline:	VAEntrypointEncSlice
      VAProfileH264ConstrainedBaseline:	VAEntrypointFEI
      VAProfileH264ConstrainedBaseline:	VAEntrypointEncSliceLP
      VAProfileVP8Version0_3          :	VAEntrypointVLD
      VAProfileHEVCMain               :	VAEntrypointVLD
      VAProfileHEVCMain               :	VAEntrypointEncSlice
      VAProfileHEVCMain               :	VAEntrypointFEI
      VAProfileHEVCMain10             :	VAEntrypointVLD
      VAProfileVP9Profile0            :	VAEntrypointVLD

@sgjava
Copy link

sgjava commented Jan 15, 2022

OK, going to answer my own question here for someone else if needed.

sudo usermod -a -G render username
sudo usermod -a -G video username

username is your non-root user.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment