An experimental UE 5 (Windows, Mac, Linux) plugin for rendering Interactive Scenes

This plugin supports rendering our fully volumetric format (.luma) as well as Interactive Scenes powered by Gaussian Splatting (.ply) in real-time — no tinkering with mesh formats, geometry, materials or streaming required.

Table of Contents

🏎️ Getting Started

• Make sure you have Unreal Engine 5 installed.
• In the Unreal Marketplace, search for “Luma AI” (or navigate to this link) and download our official Unreal Marketplace plugin.

Luma AI

• Download the sample project that matches your Unreal Engine version in the “Sample Project Downloads” section below, and extract it somewhere.
• Open it in Unreal Engine 5 by double-clicking the .uproject file.
  • Note that on MacOS/Linux, you might need to manually specify the version of Unreal that should be used if there are multiple installed.
• Download a Luma Field (.luma) or Interactive Scene (”Splat”, which comes as a zipped .ply file) from one of your captures on https://captures.lumalabs.ai/me . We recommend downloading the more recent “Splat” representation for better performance and higher quality rendering.

• Drag the downloaded file into the Content Browser in the Unreal Editor.
• After a couple of seconds, Blueprints will be generated for your captures, which you can simply drag in and use inside Unreal Engine!
  • Depending on your system, it might take a couple of seconds to compile all the Blueprints – you can already drag them into the scene while they are compiling and they will start to render once the compilation is done.
• There are multiple Blueprints generated for different use cases:
  • Baked : These Blueprints contain the lighting as you captured them, so they will look as close to your capture as possible. They are not affected by shadows, or lighting, but can still be composited with other Unreal Objects.
  • Dynamic : These Blueprints are affected by Unreal's lighting.
  • Specific to Luma Fields (.luma):
    • Cropped: These Blueprints contain an automatically cropped version of the center object of your capture, if one exists.
    • With Environment: These Blueprints additionally render a fitting sky environment for each capture for any region that was unseen during capture.
  • Specific to Interactive Scenes (Splat / .ply):
    • No_TAA : These Blueprints will not calculate motion vectors during rendering, resulting in much better rendering performance at the cost of artifacts when using Temporal Anti-Aliasing solutions. You can use these if you use a different Anti-Aliasing approach in Unreal and need highest performance.

✂️ Cropping for Interactive Scenes

When dragging in any of the Interactive Scene blueprints, they automatically come with a CropBox and 4 CullBoxes .