Toggle menu
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

MPEG Immersive Video

vrarwiki.com · VR & AR Wiki

MPEG Immersive Video (MIV) is a standard for representing and compressing volumetric video so that a viewer can change both viewing position and orientation within a limited region. It is Part 12 of the MPEG-I family, formally ISO/IEC 23090-12. The second edition, ISO/IEC 23090-12:2025, was published in September 2025 and replaced the first edition.[1]

Reviewed 21 October 2026. Official standards records and white papers, original coding paper and verification report About review dates.

Viewing space and XR applications

MIV's six degrees of freedom include rotation and translation. A scene is captured by several real cameras or rendered from several virtual cameras. The representation supplies information for generating views between those camera positions. Its intended viewing space depends on the capture arrangement; the standard describes movement within a constrained range.[2]

This supports motion parallax, in which nearby and distant objects change their relative image positions as the viewpoint moves. Ordinary 360-degree video lets a viewer look around from a fixed position. MIV also represents scene depth for positional viewing. Intended applications include immersive sports viewing, training and telepresence. Playback can use a head-mounted display or a conventional screen whose viewpoint responds to user input.[3]

Representation and coding

Source views

The usual multiview video plus depth representation combines images of a scene with corresponding depth maps. Geometry may come from depth sensors, computer vision or a computer-generated scene. Camera metadata describes the projection and camera pose, allowing samples from different views to be related in three-dimensional space. Perspective, equirectangular and orthographic projections are supported. The capture system and the technique for estimating depth are outside MIV's scope.[3]

Pruning, patches and atlases

Nearby cameras often record the same surfaces. MIV encoders can reduce this duplication before conventional video compression. In the Test Model for Immersive Video (TMIV), selected basic views retain their image data. Additional views are pruned to retain information needed beyond those basic views, including surfaces that were occluded from another camera. The retained regions become rectangular patches, which are packed into larger two-dimensional images called atlases.[4]

The atlas video is compressed by an underlying two-dimensional codec. MIV metadata records each patch's source view and its position and orientation in the atlas. A decoder uses this information to undo the packing and supply geometry and image data for view synthesis.[3] MIV therefore organizes scene information around existing video coding technology; it does not replace all the functions of codecs such as HEVC or VVC.[5]

Decoding and rendering

MIV extends the Visual Volumetric Video-based Coding (V3C) bitstream structure in ISO/IEC 23090-5. It shares that framework with video-based point cloud compression (V-PCC), while specifying different scene representation and processing. Its specification defines the bitstream syntax and required decoding processes. Encoding choices and the final renderer have implementation freedom. A hypothetical reference renderer illustrates reconstruction, but conforming implementations do not have to reproduce that renderer's operations.[6]

Editions and profiles

The first published edition was ISO/IEC 23090-12:2023, issued in August 2023.[7] The second edition reached Final Draft International Standard status at MPEG's January 2025 meeting, before its September publication.[8][1]

Profiles restrict the tools a bitstream uses and consequently the capabilities needed to decode it. The second edition retains the earlier profiles for compatibility and adds MIV 2 and MIV Simple MPI.[6]

Profile Main purpose
MIV Main Multiview video with depth.
MIV Extended Additional representation options, including transparency and multi-plane imagery (MPI).
MIV Geometry Absent Omits transmitted geometry, supporting workflows that estimate depth elsewhere.
MIV 2 Supports the additional tools introduced with the second edition.
MIV Simple MPI Transmits full-plane multi-plane imagery using a single video sub-bitstream.

[5][6]

Second-edition additions include capture-device information, patch margins, background views and static background atlases, colorized geometry, and further depth-quantization tools. MPEG's announcement also describes the Simple MPI profile as allowing playback with a single two-dimensional video decoder.[8]

Research and implementation limits

A 2023 MPEG verification test compared MIV Main and Geometry Absent configurations with an MV-HEVC reference configuration. MIV Main was tested on four scene sequences at target rates of 5, 17, 28 and 40 Mbit/s; Geometry Absent was evaluated on the CBABasketball sequence. Thirty viewers initially participated at RWTH Aachen University, with inconsistent ratings screened out during analysis. Participants rated prerecorded viewpoint paths on two-dimensional displays using an 11-grade quality scale.[9]

The report found overall quality advantages over that reference configuration, with results varying by sequence and rate. It evaluated the complete encoding and rendering configurations using predefined paths. It did not test freely navigated headset viewing or establish a headset-comfort benefit. The report also identified limitations in some source material and saturation where additional bitrate gave little improvement.[9] MPEG's second-edition white paper states that no new verification test was conducted for that edition because its principal changes added functionality.[6]

Capture density, camera placement and depth quality constrain the useful viewing region. Thin structures and hollow shapes can be difficult to capture, and geometry or compression errors can affect synthesized views. Six degrees of freedom describes the supported movement axes, rather than unrestricted travel through a fully recorded world.[4] The TMIV encoder, decoder and renderer support research and development; their algorithms are reference implementations rather than a requirement that every product use the same processing.[4]

Related media formats

Omnidirectional Media Format (OMAF), ISO/IEC 23090-2, is a separate MPEG-I part concerned with omnidirectional media presentation. Its first edition addressed a single camera position, while later work added support for more interactive viewing.[10] Apple Immersive Video is Apple's separately named media format and production workflow for stereoscopic, large-field-of-view playback on visionOS. The shared words "immersive video" do not make it the MPEG MIV standard.[11]

References

  1. ↑ 1.0 1.1 "ISO/IEC 23090-12:2025: MPEG immersive video". International Organization for Standardization. 2025-09. https://www.iso.org/standard/87643.html. Retrieved 2026-10-21.
  2. ↑ "MPEG-I: Immersive Video". MPEG. https://www.mpeg.org/standards/MPEG-I/12/. Retrieved 2026-10-21.
  3. ↑ 3.0 3.1 3.2 "White paper on MPEG Immersive video". ISO/IEC JTC 1/SC 29/AG 3. 2022-01. https://www.mpeg.org/wp-content/uploads/mpeg_meetings/137_OnLine/w21274.zip. Retrieved 2026-10-21.
  4. ↑ 4.0 4.1 4.2 Jill M. Boyce and colleagues (2021-03-10). "MPEG Immersive Video Coding Standard". Proceedings of the IEEE. https://www.multimedia.edu.pl/publications/MPEG-Immersive-Video-Coding-Standard.pdf. Retrieved 2026-10-21.
  5. ↑ 5.0 5.1 "MPEG Immersive video: project information and development updates". MPEG Immersive Video. https://mpeg-miv.org/. Retrieved 2026-10-21.
  6. ↑ 6.0 6.1 6.2 6.3 "White paper on MPEG immersive video 2nd edition". ISO/IEC JTC 1/SC 29/AG 3. 2026-01-23. https://www.mpeg.org/wp-content/uploads/mpeg_meetings/153_OnLine/w25996.zip. Retrieved 2026-10-21.
  7. ↑ "ISO/IEC 23090-12:2023: MPEG immersive video". International Organization for Standardization. 2023-08. https://www.iso.org/standard/79113.html. Retrieved 2026-10-21.
  8. ↑ 8.0 8.1 "MPEG 149: MPEG ratifies Second Edition of MPEG Immersive Video". MPEG. 2025-01. https://www.mpeg.org/meetings/mpeg-149/. Retrieved 2026-10-21.
  9. ↑ 9.0 9.1 "Verification test report of MPEG immersive video". ISO/IEC JTC 1/SC 29/WG 4. 2023-06-02. https://www.multimedia.edu.pl/publications/N0341-Verification-test-report-of-MPEG-immersive-video.pdf. Retrieved 2026-10-21.
  10. ↑ "MPEG-I: Omnidirectional Media Format". MPEG. https://www.mpeg.org/standards/MPEG-I/2/. Retrieved 2026-10-21.
  11. ↑ "Get to know Apple Immersive Video". Apple Developer. https://developer.apple.com/apple-immersive-video/. Retrieved 2026-10-21.