Moving subjects with per-frame mask ground truth

Hard-edged and anti-aliased subjects in motion, each shipped with the exact per-frame mask used to create it, for scoring video object segmentation and rotoscoping frame by frame instead of spot-checking.

11 of 11 files

Base Plate: Orbit, Hard-Edged Solids

A green disc and a red square orbiting the centre in antiphase over a grid. Hard edges and flat fills make the boundary unambiguous, so segmentation and tracking output can be scored against exact geometry rather than a judgement call. One of eight shared base plates: every AI-video suite in this library degrades one of these rather than inventing its own footage, so results across suites are comparable. Encoded at CRF 14 (well above the house CRF 30), because a reference compressed as hard as the material under test puts the measurement floor above the effect being measured.

File: MP4 · Base Plates · 640x360
Use case: Video segmentationVideo matting+1· Conversion set

Base Plate: Subject on Chroma Field

An anti-aliased figure moving over a chroma-green field with a deliberate lighting falloff, so the key is not perfectly flat. Ships with a per-frame alpha ground truth, which is what makes matting output measurable instead of merely inspectable. One of eight shared base plates: every AI-video suite in this library degrades one of these rather than inventing its own footage, so results across suites are comparable. Encoded at CRF 14 (well above the house CRF 30), because a reference compressed as hard as the material under test puts the measurement floor above the effect being measured.

File: MP4 · Base Plates · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Matting Ground Truth: Per-Frame Alpha Matte

The exact per-frame alpha used to composite every clip in this group, as an 8-bit greyscale clip: white is opaque subject, black is background, and edges carry genuine intermediate values because the matte is anti-aliased rather than binary. This is what makes matting output measurable. Compare a predicted alpha against this frame by frame instead of inspecting a composite and forming an opinion.

File: MP4 · Matting · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Matting Input: Subject on Office interior

The same subject and the same alpha, composited over office interior: no chroma screen, which is the case a general background-removal model actually has to handle. Score the predicted alpha against the ground-truth matte in this group.

File: MP4 · Matting · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Matting Input: Subject on Outdoor daylight

The same subject and the same alpha, composited over outdoor daylight: no chroma screen, which is the case a general background-removal model actually has to handle. Score the predicted alpha against the ground-truth matte in this group.

File: MP4 · Matting · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Matting Input: Subject on Dark studio

The same subject and the same alpha, composited over dark studio: no chroma screen, which is the case a general background-removal model actually has to handle. Score the predicted alpha against the ground-truth matte in this group.

File: MP4 · Matting · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Matting Input: Subject on Busy patterned

The same subject and the same alpha, composited over busy patterned: no chroma screen, which is the case a general background-removal model actually has to handle. Score the predicted alpha against the ground-truth matte in this group.

File: MP4 · Matting · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Matting Input: Subject on Colour close to subject

The same subject and the same alpha, composited over colour close to subject: no chroma screen, which is the case a general background-removal model actually has to handle. The background colour deliberately sits close to the subject's own, so colour alone cannot separate them and the model must use shape and motion. Score the predicted alpha against the ground-truth matte in this group.

File: MP4 · Matting · 640x360
Use case: Video mattingVideo segmentation+1· Conversion set

Segmentation Ground Truth: Instance Masks

Per-frame instance masks for the orbit plate, colour-coded so the three objects are separable: red is the disc, green the square, blue the centre marker, black the background. Instance identity is stable across frames, which is what makes this usable for video object segmentation and tracking rather than only per-frame segmentation. Note the mask is encoded lossily like every other clip here, so threshold rather than testing for exact equality.

File: MP4 · Segmentation · 640x360
Use case: Video segmentationVideo matting+1· Conversion set

Segmentation Input: Orbiting Solids

Two hard-edged objects orbiting in antiphase over a grid, plus a static centre marker. The objects cross in front of the grid and reach the frame edges, so occlusion and boundary handling both get exercised. Every frame has an exact mask in this group.

File: MP4 · Segmentation · 640x360
Use case: Video segmentationVideo QA· Conversion set

Segmentation Input: Trimap (Foreground / Unknown / Background)

A three-level trimap derived from the instance masks: definite foreground, definite background, and a nine-pixel unknown band around every boundary. This is the input interactive matting and rotoscoping tools actually take, and the band is where all the difficulty lives: a matte is only as good as its handling of that region.

File: MP4 · Segmentation · 640x360
Use case: Video segmentationVideo matting+1· Conversion set