Skywork AI publishes Matrix-Game 3.0

Skywork AI launches Matrix-Game 3.0, a 5B and 28B MoE model generating interactive 720p video environments at 40 FPS from text and image prompts.

Skywork AI launches Matrix-Game 3.0, a model capable of generating interactive video environments in real time from an image and a text prompt. The result is controllable via keyboard/mouse actions, similar to a video game generated on the fly. The 5B-parameter version runs at 720p and 40 FPS, with memory coherence maintained over entire one-minute sequences, including during viewpoint changes. A 28B MoE version is also available for higher quality renderings. The model was trained on a mix of Unreal Engine scenes, AAA game captures, and real-world data. The code, weights, and technical report are freely accessible on GitHub and Hugging Face.