If you’re in the middle of creating what could well be Hollywood’s most ambitious consumer virtual reality project yet, you’d think having a concrete plan for how to get from beginning to end would be crucial.
“You’re building the plane while you’re flying it,” says Ted Schilowtiz, 20th Century Fox’s futurist—and per his business card its “consiglieri”—of the Hollywood studio’s production of rich VR experience based on its recent mega-hit film, The Martian.
“We didn’t have all the answers when we started, and we still didn’t have all the answers when we finished, but we know we created something meaningful. In scope and scale; it feels like a significant entertainment product.”
Fast Company interviewed Schilowitz for their current issue and he explained that the goal he and his compadres at the Fox Innovation Lab, which recently completed work on The Martian VR Experience, was to make sure the 20-minute project is much more than just a short marketing piece for the movie that happens to use VR as a gimmick. The Experience debuted this week at CES in Las Vegas and it enables users to step into the role of the film’s protagonist, Mark Watney, to experience what he would really go through in his efforts to survive on Mars.
Fox considers itself a bit more advanced than its competitors about VR, especially when it comes to leveraging the medium as a new form of premium content. Schilowitz told Fast Company in November:
“All the studios are doing good and smart things in VR, but if you ask around, the other studios and people within the industry would say that Fox started with a leadership position and has maintained that leadership position.”
For Fox, leadership means using VR not just for marketing, but as profitable entertainment in its own right. Fox very much wants it to be successful, standing on its own as something people will seek out, and be happy to spend money to see. And then it wants to repeat that success again and again, both with VR tie-ins to traditional movies, and as entirely new projects.
The initial result of that strategy is The Martian VR Experience and plans to release later in the year. It has not said how much it plans to charge, but it’s likely to be close to the price of a movie ticket.
“We wanted to not [just] make a new version of The Martian,” said Robert Stromberg, who directed the VR project, and who has also directed traditional Hollywood films, like Disney’s Maleficent. “We were attempting to take someone through an entire narrative storyline without it being a short demo.
The full version of The Experience requires a high-end VR system, such as the Oculus Rift, HTC’s Vive, or Sony’s PlayStation VR, all of which have handheld controllers that allow users to do things with their hands, opening the door to potentially far richer active experiences than is possible with mobile-phone-based VR hardware like Samsung’s Gear VR or Google’s Cardboard, which offer less interactivity.
All told, the full Martian VR Experience takes users through seven different scenes, each of which exploit the interactive features of the Rift, the Vive, or the PSVR. Each scene presents users with a scenario from the theatrical version of The Martian and tasks them with working their way through a challenge that Watney had to overcome in order to survive alone on Mars.
“We chose the clips based on the shots that were most poignant,” Stromberg said, “and the ones that would take us further down the story quickly.”
For example, in one scene, users have to load two large solar panels onto a Rover before heading out on a vital trip across Mars’s surface, using levers on a control panel to power a small crane and lift them up and onto the back of the vehicle. A menacing dust storm adds time pressure. It’s not difficult, but it’s exciting. Those who have seen the movie will find the scenario familiar, which is part of the point.
MORE THAN MARKETING
What’s Fox’s larger idea for VR? To prove that virtual is a great medium for storytelling and to find, define, and learn the best techniques for leveraging VR as a storytelling medium.
“Our role here is to create narrative-driven content,” says David Greenbaum, executive vice president of production at Fox Searchlight Pictures, and one of the Fox Innovation Lab’s principals. “We use real people, and integrate them into worlds. Some are computer-generated. Some are photo-real. So where we want this medium to go, and what [Stromberg] and all of us talk about all the time, is making VR storytelling that is human, that is emotional, that connects the viewer to stories. Our goal here is ultimately to create compelling stories.”
There’s plenty of experience with storytelling at Fox, and in some ways, the process of making The Martian VR Experience wasn’t all that different from what a Hollywood studio normally does.
“We approached it very much like a feature film,” Stromberg says. “It started as a concept, with a script, and then it [went] through an approval process.”
To make the project, Stromberg and the folks from the Fox Innovation Lab mined the wide range of visual assets from the full movie, and during the final months of production on the theatrical version, tweaked those they used so they would work for the VR experience.
“We worked closely with editorial,” he says, “which had never been done before, especially during the frantic winding down of the actual film.”
Although there was a script, the Fox team still had to work out exactly how to translate elements from the movie into interactive scenes that would be both challenging and which made sense in a VR experience.
LIKE PAINTING IN A HURRICANE
“What we were learning” to do, says Ted Gagliano, Fox’s president of post production, “was how to do a complementary VR experience that honors the film and the moments in the film, but also integrates with the process of post-production.”
The likely rapid advancements in VR production technology and viewing hardware to come over the next few years present a major challenge to the Fox lab face as they pursue virtual reality as a new storytelling medium.
“It’s like painting in a hurricane,” Stromberg says. “Every day you’re pushing with technology that isn’t quite there.”
So what does Fox plan to do with VR in the future?
The folks running the lab won’t say exactly, but did hint at other projects already in the works. It’ll “be something great,” Greenbaum says.
Either way, it’ll depend on story or no one will watch.
“Think about the original virtual reality medium,” Schilowitz says: “reading a great book. What trumps everything is a great story. If you don’t have a great story, you just have technology that doesn’t do anything.”
Still, Fox wants to establish itself at the vanguard of VR production in Hollywood. And it plans on making its virtual reality projects into must-see experiences.
“A lot of what we’re seeing now is like, ‘Have you seen VR?’” says Greenbaum. “The question will shift: ‘Yes, I’ve seen VR, but have you seen this?”