Decart AI / Collaboration & challenge
Decart XR
Real-time AI transforms passthrough to match the atmosphere of a video.
- Contribution
- Open-source contributions and challenge submission
Collaboration with Decart AI; independent challenge entry
Challenge winner · prototype / 2025
The challenge
Extend the mood of a video into the physical room through AI-generated passthrough.
The work
We contributed fixes and improvements to the open-source Decart XR samples. Building on its real-time diffusion pipeline, we developed an immersive video-player prototype that transformed passthrough to match a video’s atmosphere. The result explored how generative visuals could extend what was playing on screen into the surrounding room.
This work connected improvements to the underlying samples with an application of the pipeline. The video-player prototype provided a concrete setting for exploring generated passthrough, using the film’s atmosphere as the context for the transformation.
- Contributions to Decart XR samples
- Video-driven passthrough transformation
- Immersive player challenge entry
The result
The submission won first prize in the Decart XR Challenge. It remains an experimental prototype, with latency and field-of-view limitations documented in the original work.