Skip to content

Instantly share code, notes, and snippets.

@Jim-Bar
Last active April 18, 2024 03:14
Show Gist options
  • Star 52 You must be signed in to star a gist
  • Fork 7 You must be signed in to fork a gist
  • Save Jim-Bar/3cbba684a71d1a9d468a6711a6eddbeb to your computer and use it in GitHub Desktop.
Save Jim-Bar/3cbba684a71d1a9d468a6711a6eddbeb to your computer and use it in GitHub Desktop.
About YUV formats

About YUV formats

First of all: YUV pixel formats and Recommended 8-Bit YUV Formats for Video Rendering. Chromium's source code contains good documentation about those formats too: chromium/src/media/base/video_types.h and chromium/src/media/base/video_frame.cc (search for RequiresEvenSizeAllocation(), NumPlanes() and those kinds of functions).

YUV?

You can think of an image as a superposition of several planes (or layers in a more natural language). YUV formats have three planes: Y, U, and V.

Y is the luma plane, and can be seen as the image as grayscale. U and V are reffered to as the chroma planes, which are basically the colours. All the YUV formats have these three planes, and differ by the different orderings of them.

Sometimes the term YCrCb is used. It's essentially the same thing: Y, Cr, Cb respectively refer to Y, U, V although Cr and Cb are sometimes used when speaking of the components of U and V (that is U = Cr1Cr2…Crn and V = Cb1Cb2…Cbn).

420, 422, (…), and subsampling

The chroma planes (U and V) are subsampled. This means there is less information in the chroma planes than in the luma plane. This is because the human eye is less sensitive to colours than luminance; so we can just gain space by keeping less information about colours (chroma planes) than luminance (luma plane, Y).

The subsampling is expressed as a three part ratio: J:a:b (e.g. 4:2:0). This ratio makes possible to get the size of the planes relative to each others. Refer to the Wikipedia article "Chroma subsampling" for more information.

Basically the chroma planes are often shorter than the luma plane. Most commonly, the ratio is length(Y) / n = length(U) = length(V) where n is 1, 2, 4, …

Packed, Planar, and Semi-planar

YUV formats are either:

  1. Packed (or interleaved)
  2. Planar (the names of those formats often end with "p")
  3. Semi-planar (the names of those formats often end with "sp")

Those terms define how the planes are ordered in the format. In the memory:

  1. Packed means the components of Y, U, and V are interleaved. For instance: Y1U1Y2V1Y3U2Y4V2…Yn-1Un/2YnVn/2.
  2. Planar means the components of Y, U, and V are respectively grouped together. For instance: Y1Y2…YnU1U2…Un/2V1V2…Vn/2.
  3. Semi-planar means the components of Y are grouped together, and the components of U and V are interleaved. For instance: Y1Y2…YnU1V1U2V2…Un/2Vn/2

Semi-planar formats are sometimes put in the Planar familly.

Some YUV formats

The following formats are described in the picture:

  • YV12
  • I420 = IYUV = YUV420p (sometimes YUV420p can refer to YV12)
  • NV21
  • NV12 = YUV420sp (sometimes YUV420sp can refer to NV21)
<mxfile userAgent="Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:55.0) Gecko/20100101 Firefox/55.0" version="7.3.5" editor="www.draw.io" type="device"><diagram id="33e20851-287e-c678-fda7-a99a3a0c866b" name="Page-1">7Z1Pc9pIEMU/DcetQn8QcIzZJbuH5JKCrT0SUICKQC4sr5399CtiSQb1y8ZbxbyZrmpfgiVAsX56o+mn7p5BMjs8vz+t7ncfyk1eDOLh5nmQ/DqI4ygbx/U/5y3fXrYkyfBlw/a03zRvet3waf9P3mxs3/a43+QPL9uaTVVZFtX+/uHq0+vyeMzX1dW21elUPl2/7UtZXB/1frXNxYZP61Uht/6531S7Zms0HL7u+D3fb3fNoSejZsfn1frr9lQ+HpvjDeLky/efl92HVftdzfsfdqtN+XSxKfltkMxOZVm9vDo8z/LifG7b0/byufkP9nb/71N+rN7ygYbT36visfnT/2q+46H61p6N739Pfv7EcJDcPe32Vf7pfrU+732q+dfbdtWhqH+L6pfdX3R+77ZYPTw0r9flYb9uXherz3lx152rWVmUp3rXsTzm56+oTuXXvN1Yn8Lh959uT4vkfLgv+6K4eOd0OpvN5+ft5bGarw774nwFzsrH0z4/1X/Vx/yp2dlcdFHW/I4Otyr222O9bV2fzfrjyV1ztvJTlT//8IxHHcdaH3l5yKvTt/otzQfi9hpqpDFpfn16vc7SZtPu4gprBbRqruxt98WvdOsXDWAMO5GwY4PtFHbqDXYqYY8NNlPZUcSjPZK0J0abKW0m7YmknWimPZpNRnEWNO2Jt4F8KmGnBtsl7CT2BrsdRC5pT402U9rMgTyKJO728Mabo24qbxCCjTTjntc/02nQuDN/gzmIwTKj7ZJ26s9diUAMFqk208LH3Rc3dSzPAG/Vflr4vPvypvIGUXekOuyez7MsSULmLSy1lMgbBN6R6tv3tP4J21QTc3Mi7/bQV7xVx94K9T0m8gaxd/dY1nhzTHMmbxB7R6qD7/DHc+GtMcdzEH1Hqp1zhfpm8gbxd6w6/laob+Z4DuLvWHX8HT5vMT9n8kbxt+qUlvn8blTfkULm3ffXmOM5ir9VJ7WEz1v4a0Te7XdcjefK/bXQeQt9E8fzBMXfyufnofMW+mbylvH3Qk/4HWucrvWn5x1HBm4Zfi/0zM4B7vAzWwTuIRG3jL6XeoJvqG5tGchU3DL4Xpq6qbE3FbeMvRembuqjMSpuGXov9MzMAW4FznkfN3Gq1n7v5WCuJ/CGuLUlMjHVncrAe2nq5k7VmOoGcbepm2qrUdUN4m49WWsQd+iumsDNVDeIu81V4wZiTNwg7jZ1c6dqRNxtPcEFbrWwm48Hy/kNjVkmAHN2A8wjec8exFlRH+Huc/1ie37xcRl1G+vv67aL66E+A1UP+hWxloNEI87q+Xzu16viXbPjsN9szoeBV9nrdXijC+0mV8otLoyerQ6eiaMLI73FhSHv7qZ/V/r/eYsHZ/qXd3XDTJqsMzGPDXNIlWPOOMunJcaZNGpTOcvHJMaZNGwzOWfSMK8j1nf1//adrBez6fetp99Db9PvTIbfD/dG3DXxvtaZxFGRoJpBXWcjxZ6+E2LOeQZqBPXcw3XiTj3iBiWCqiuIFODuq5uYcZ6BCkHVBUQKcPfVzcQt7RVri8uNvqmDOagH1ZPGpBJ3/8k3FTcoB1XdnSd83ELdxMG8PZR1xvUobyZvUA2qJ49JZTPFvs3CHM3bBaKsNa63PCYqbmSrqfbVwuct5M0czVHvLdXGWvi8hb6ZvFHva9Wxt4KaEvFcjMgb9b5Wff/Wl3ZO5Q2sNeuNS9Y3Me98DLw1643Ltc6pvFGvNdXhd/jjuUwr5/FuD229cT3qm8kb9VpTHX8r1DdxPJ8Aey1WHX+Hz1vMz5m8kb+mOrMl/LpQmaVI5I38NdWpLeHz7vtrVN6ot71yfy103kLfzPEc9bZXPj8PnbfQN5H31CqJgso3d1VJFLXH/u9K//NfYJX+/iv9E3CLd1V5Eg1ljG5jACk2544BMjg30KRJHBe0jMoNNOmujqIzd6BR/x4D7e2xiTvQ1o8nKH/NHWgZgFvJv7eSf+48XOa6WNE/v+ifyxytLahmZFdZKfrLz9utOeuqOQTpLnpu5Dpxp/5wt3VjVvbvTd0dAwpvkO2i+uGoAt79hb+pvKWhZoX/jnj7GL5BcovqZ6EB432+ZumDNkhtUV1pEDBtL4M1KhVTXVoQMGAsZy5vkMqiurIg/EpQj5F1BArFVNcFhk87ij3iRr6ZauMsfN5eI2tUJ6baOQufd1/fVODtsa2w36N3RmzUEsXAO7PKfu70nMobeGdW2U8WOLFTSxQDN81K+8nuOBU4qhVTHYEHPKJ7GcKRo6baIFeoaCpwVB2mOupWoGjqkA1ctHaiZoA5k3Aqb2Sjqc5QCb/c02uQjWw01Rkq4fMWNhoTePslVr/vT+DMAT1B/ZaUT8lD5y0ETgUubbSFnhg71jhh6+m7qxmh4JYm2kLP/BzgDj+HpR9xc3lLD22pJ+CG8g4+o7ivb2I7liiRltrS9M3VN5W3dNQWpm+uvqnjuTTYFnqm54B3+I6519u39NeWeqJviDvYrCUvw7f005YmZ6qcmbjbL74cvU3ObuXMHK5T6Z4t9KSgQb7azDMub2meLc08o5pn1OFbmmdLkzdX3lTe1h0tpK4qznpmpag5Wq+37R/p+Uq03rbE/kpd+7Q3XQk3aaeUSjvNFO9oZk5VuLTNjCtnhkbFLO0yw0y6YaO0JHegbdkBryUBzsCOpENmYDkDNZezdMqsTS2tZWl/7GZOsUfSM7s34q6J+wQOUs7MJHU6sosVHadE12wkXTNLMSTzzpi8QcqZpSA55S3WDKHylh6ZpRiSlw6h8gYpZ6Zvt7z7K65TeUsTzVIMybyp8zWQg2ZJSW7na/0Vgpj6bo9lOYf+5mtMfWcgKc307ZS3WJGZqm9psFkSIpk3Vd8gK838NW48RuUNSjpN39z5GpU36pKmhrfORYHesMq2O96oSZrxdso79ckb9ExT3UJLAe++vpkdVzLQM011Cy0FvPv6pvIGPdP0xN+6lg3yMX6315Kt8uarhpeLG3RIU912PmDcPobrsbTPbJk3sp6pvMGyAnrsM5ULA/mMrsdgUQE97plK3P0aXi5v5J6pts/CB+4zuh4D98wWeiMLnAoc2Ge20BvXP+uef1KAozUHVN/Cw3/g2c9Po/JGaw6ojrgVCpzZdqU9ti305s8h5wIHlpot9ObWU6MO4RPkqan2yBUqmgocrdWpOupWoGjqkA1stFh1mB0w4B9Mwqm8kY2mOksl/KxDn0H2BNloqrNUwufdt9G4wNHKncpttNCBew2ygYtmC72RBU4FLm00a8PC1TezaqA9lnVh8RdxU3lLD826sJBNcmaV51RaataFhaxvKm/QRc30zdU3dTwHXdT0TM8B7/Adc6+3b9BETU/0DXEHm7XkZfgGTdNMzlQ5U3GDnmkmZ7dypg7XoEeanhQ0yFedeUblDXqkmXlGNc+Iw3fXrstarPiTN5W3NM/U0g591Ym39FZxtexEPJSumVjp7a9lFNtKb//7WrnBFC4BD7xdLUsQD6WhZpp3NDfnatxW7QypktcdZ7Rqp3H2VvDlDrQtyum1LMAdWFuVM6RkUnecpVuW2mJvvhZ7486ypXF2b8jJq705JF7/eirL6mLf+/rc7j6Um/z8jn8B</diagram></mxfile>
@duclahoang
Copy link

Thank you so much !

@pengguoqing
Copy link

Thank you !

@46cv8
Copy link

46cv8 commented Jan 18, 2023

Awesome explanation! Thanks!

@nniranjhana
Copy link

nniranjhana commented Sep 13, 2023

Thank you, this helped. Can you also explain how single-planar and multi-planar relate to this?

Answering my own question:
Packed is single-planar as it uses 1 plane.
Semi-planar and planar use 2 and 3 planes, hence multi-planar.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment