Microsoft has launched a technical demo of the Muse AI model, showcasing a generative model recreation of Quake II. Just six weeks ago, Microsoft released WHAM-6.0B, and immediately after that, a new project began to be started – training a WHAMM model for a new game. This entire process includes collecting data from scratch, polishing the previous WHAMM prototype, and then moving on to formal training of the image encoder/decoder and WHAMM model.

The whole team worked together to plan what data to collect—which game to choose, how testers would play it, what behaviors might need to be trained to model the world, and so on—and then to actually collect, organize, and clean the data needed for training.

What excites the team the most is that after the model is trained, it can really "enter" the simulated world. Inside we can move freely, turn the camera, jump, crouch, shoot, and even detonate the oil barrel like in the original game. And because the team added these things to the data, it's really cool to now be able to discover some hidden secrets in this level of Quake II.

Microsoft emphasized that the goal of this tech demo is not to fully recreate the real-life gameplay experience of the original Quake II. It's more like a research exploration using current machine learning methods. It can be understood as "experiencing the model" rather than "playing the game".

Experience address: Click me to enter