Filter SDK/Data storage

This page is an edited summary of this thread at Doom9's forum

Part 1: Actual memory storage

Warning: technical. Most users will only need to read (and understand) Part 2.

In AviSynth, we process pixels of video data. These are stored in the memory in the form of data arrays. As noted elsewhere (like the AviSynth FAQ) there are two different colorformats in v1.0x/2.0x, RGB and YUY2, with a third YV12 added in v2.5. In v2.6 the follows colorformats are added: Y8, YV411, YV16 and YV24. These color spaces store their data in different ways.

Interleaved formats

RGB (also known as RGB24): Every pixel is associated with three bytes of data: one red, one green, and one blue. They are interleaved (mixed) in the memory like this:

RGB|RGB|RGB|RGB

Since data is most easily read in words of four bytes, most functions actually process 4 pixels at the same time in order to be able to read 3 words in a row. Usually memory is allocated as aligned which means that it always allocate memory in words of 4 bytes. Since the 3 to 4 relation isn't easy to map, RGB24 is very difficult to work with, and in general isn't recommended.

RGBA (also known as RGB32): This is an extension of RGB where a fourth color channel has been added. This is called the alpha channel, and is a definition of transparency in the pixel.

For an explanation of how the alpha channel is used see Mask and Layer. In general however, you shouldn't rely on filters processing alpha correctly - in some cases filters will even produce garbage in this channel.

RGBA also makes this a lot easier as it requires four bytes per pixel, and thus each memory access of a word, will correspond to exactly one pixel. In fact, RGB will only be used if you have a source that returns RGB or if you explicitly use ConvertToRGB24. ConvertToRGB will by default create RGBA. This is the recommended format for RGB-data.

YUY2: In this colorformat each pair of pixels will share the color data, as well as the data being interleaved like this:

YUYV|YUYV|YUYV|YUYV

A memory access of one word will get all data for two pixels. A pair should never be split, as this can create strange artifacts when almost all functions in YUY2 assume that they should read a full word and process that. Even if they return the correct width when they are done, they will most likely have used invalid data when processing valid pixels.

Planar formats

Now the real fun begins as this is a planar image format. This means that data is not interleaved, but stored separately for each color channel (also called color plane).

For filter writers this means that they can write one simple function that is called three times, one for each color channel, assuming that the operations are channel-independent (which is not always the case). Again, using aligned for both color and luma channels will allow easy memory access.

Y8: This colorformat is greyscale, i.e. contains no color. It is the only format which is both planar and interleaved.

YV12: Four pixels share the color data. These four pixels are a 2x2 block, i.e. two pairs on adjacent lines in the same field. As fields themselves are interleaved, this means that for field-based video line 1&3 share color data, as well as line 2&4. Frame-based video though has the more instinctive way of sharing color, line 1&2 share just as line 3&4 does. The 2x2 block should never be split as this may create strange artifacts.

YV411: Four pixels share the color data. These four pixels are a 1x4 block, i.e. a quadruple. The 1x4 block should never be split as this may create strange artifacts.

YV16: In this colorspace each pair of pixels will share the color data. The pair should never be split as this may create strange artifacts. It is a planar version of YUY2.

YV24: This color format has full color, i.e. each pixel has a unique color (just like RGB and RGBA).

Part 2: How does this affect me as a user?

1. As long as you don't split a colorsharing unit it's up to the filter writers to take care of problems with memory reading at end of lines.
2. Interlaced (fieldbased) video requires double mod on height.
3. Required Modulos in different colorformats.
   • RGB(A)
     • width mod-1 (no restriction)
     • height mod-1 (no restriction) if progressive
     • height mod-2 (even values) if interlaced
   • YUY2
     • width mod-2 (even values)
     • height mod-1 (no restriction) if progressive
     • height mod-2 (even values) if interlaced
   • Y8
     • width mod-1 (no restriction)
     • height mod-1 (no restriction) if progressive
     • height mod-2 (even values) if interlaced
   • YV411
     • width mod-4
     • height mod-1 (no restriction) if progressive
     • height mod-2 (even values) if interlaced
   • YV12
     • width mod-2 (even values)
     • height mod-2 (even values) if progressive
     • height mod-4 if interlaced
   • YV16
     • width mod-2 (even values)
     • height mod-1 (no restriction) if progressive
     • height mod-2 (even values) if interlaced
   • YV24
     • width mod-1 (no restriction)
     • height mod-1 (no restriction) if progressive
     • height mod-2 (even values) if interlaced
4. Examples of valid Crops with input 320x240 progressive
   • RGB(A)
     • Crop(1,7,-32,-19)
     • Crop(2,4,300,196)
   • YUY2
     • Crop(2,7,-32,-19)
     • Crop(2,4,300,196)
   • YV12
     • Crop(2,8,-32,-18)
     • Crop(2,4,300,196)
5. Note that final video may have other restrictions, most MPEG-n implementations want mod-16 on all resolutions etc.

More information

• See more about Color_spaces.
• See a general introduction to Working with images.

Back to Filter SDK.