Stadium Tech Report: How VenueNext generates replays for Levi’s Stadium app

replay2During the final home game for the San Francisco 49ers this season, I was somewhat amazed to see a replay appear on the Levi’s Stadium app even before the next play had concluded. Clearly, the VenueNext team behind the app had progressed significantly from the early season, when the app’s replay function struggled somewhat.

During the Dec. 28 game against the Arizona Cardinals, the VenueNext team invited Mobile Sports Report to Levi’s Stadium for a behind-the-scenes look at how the replays are generated; here’s a quick take on how the video moves from playing field cameras to fans’ phones in a matter of seconds.

Step 1: Capturing what the cameras see

How do you make sure you have replays ready? You start by basically capturing all the action from all the cameras in the building. Those views are shuttled back to the main Levi’s Stadium video room, where 15 people have the somewhat enviable job of watching views from all the live cameras in the stadium. (We still haven’t heard a response to our offer of bringing a cooler in exchange for a spare seat next season.)

Inside the video room at Levi's Stadium. (Click on any photo for larger image) Credit all photos: Paul Kapustka, MSR

Inside the video room at Levi’s Stadium. (Click on any photo for larger image) Credit all photos: Paul Kapustka, MSR

According to VenueNext CEO John Paul, who led our tour at Levi’s, VenueNext has its own servers to cache video — here is a look at the Elemental gear used to store the video for the app’s replay function. Paul said that so far, VenueNext has only needed a little more than half of the capacity of the four servers pictured.

Elemental gear in data room next to video room at Levi's Stadium

Elemental gear in data room next to video room at Levi’s Stadium

Step 2: Labeling and thumbnailing the replay

While most of this kind of gear is not new to broadcast operations, the interesting part from an app perspective is the next layer, the choosing and human editing. One of my bigger questions was about how you exactly get a replay set up, labeled with a headline and a thumbnail, and into the app within seconds? The answer is: You write another app, and have two Android-based tablets with football-savvy operators in the press box so they can see the plays live and quickly attach the appropriate info to the replay clips.

In the two pictures below, you can see an over-the-shoulder view of the two tablet apps; the first one is a sort of play-by-play generator, which the operator uses to label the next replay clip as either a run, pass, punt, incomplete, etc., so that a fan looking at the app can quickly figure out what the play might be (“45-yard TD pass,” or something like that). On the second tablet app, another operator sees instant thumbnails gleaned from the video room from all the different camera angles, and when the play is over, that operator picks a thumbnail with a click and the replay is on its way to the app.

First replay tablet app, which adds info about the play

First replay tablet app, which adds info about the play

Second replay tablet app, which adds a thumbnail to the replay

Second replay tablet app, which adds a thumbnail to the replay

Since we only had a few minutes to watch the replay team in action (and since Paul was simultaneously hosting a group of representatives from a prospective future sports-team client), I didn’t get to ask detailed questions about how this all works but it does give you some idea. What’s impressive about the Levi’s Stadium app is that it offers four different camera angles of the same play, as well as a multi-cam view that shows all different angles at once. Though I’m not a fan of the all-at-once option I did find it enjoyable to watch a reply from multiple different perspectives, like watching a pass being caught from both a sideline and end-zone view.

Step 3: Educating fans how to use replay

Initially one of the most-hyped features of the planned stadium app, the replay function has seen only limited use this season, making it somewhat of a disappointment to Niners CEO Jed York. From our perspective, there were two big things holding back extended use of the replay function: The first was the ever-changing appearance of the app itself, which felt like a beta project for most of the season, with a different interface almost every single game; the second thing holding people back from using the app to view replays are the two excellent humungous video boards at Levi’s, which not only show live game action but also quickly show replays, sometimes from those multiple angle views as well.

There might even be a third thing holding fans back from trying out the replay function — that would be just getting fans to use the stadium app in the first place. While usage of the cellular and Wi-Fi networks started at record levels and remained strong from game to game, most fans at Levi’s Stadium were using their devices for other apps, like Twitter, Instagram, Facebook and good old email. As the season progressed, the team started promoting the app and the network more aggressively, adding more-frequent messages to the main video boards and dressing its stadium tech support crew (the “NiNerds”) in neon vests for easier recognition.

What’s next for next season? My guess is that with a year under their belt, the Niners and VenueNext will have a more-aggressive campaign in 2015 to steer more fans to the replay function, which is truly a wonderful enhancement to the game-day experience.

Levi’s Stadium update: Wi-Fi traffic steady at 2.3+ TB per game, Amazon and Google lead apps use

Scoreboard promo for the Levi's Wi-Fi network

Scoreboard promo for the Levi’s Wi-Fi network

Usage of the Wi-Fi network at the San Francisco 49ers’ new Levi’s Stadium continues to hold steady at 2.3-plus Terabytes of data offloaded per game, according to the most recent statistics provided by the Niners’ network staff.

Though he’s no longer the team’s vice president of technology, former Levi’s network guru Dan Williams remains as a game-day consultant to the team, and he shared some recent network statistics with MSR, including some app usage marks that show Amazon Cloud Drive and Google APIs being among the top two applications being used over the Levi’s Stadium Wi-Fi network.

According to Williams’ numbers, for the Niners’ Nov. 23 day home game against Washington, the Levi’s Stadium Wi-Fi network had 22,095 unique users, 35 percent of the total attendance; the peak number of concurrent users was 14,700, reached at 2:50 p.m. (near halftime), and the total data used was 2.31 TB, between the hours of 9 a.m. and 5 p.m.

During the Thanksgiving day game against the Seahawks, the network had 23,371 users (36 percent of attendees) who used 2.38 TB of data, with a peak of 16,800 concurrent users at 7:15 p.m.

Video-replay statistics from the Levi’s Stadium app apparently do better when there are more home-team highlights to watch. During the victory over Washington, 1,074 fans watched 4,885 replays, with the 30-yard TD pass from Colin Kaepernick to Anquan Boldin racking up 953 total views from 398 unique users — meaning many users are watching the same replay more than once (maybe showing it to people sitting around them?). For the Seahawks game, 1,407 fans watched 3,875 replays, with a Kaepernick pass to Michael Crabtree accounting for the most views, 487 total from 180 unique users.

The top 4 apps used by fans on the network varied a bit from the two close games, but according to Williams Amazon Cloud Drive was the top app for both recent games. For the Seahawks game, the next three top apps were Google APIs, Facebook and SnapChat, while for the Washington game the next three top apps used were stadium video, Google APIs and Apple iTunes.