Final Four final score: 17.6 TB (at least) of wireless data used at University of Phoenix Stadium

We finally have the Wi-Fi numbers from the NCAA men’s basketball tournament Final Four weekend at the University of Phoenix Stadium, and they are big — a total of 11.2 terabytes of data used during the two days of competition, according to the stadium network crews running the operations for the NCAA. Combined with AT&T’s reported DAS total of 6.4 TB, that means the total wireless usage so far is at least 17.6 TB — and that’s not including DAS numbers from Verizon Wireless, Sprint or T-Mobile, which if we had them would probably push the total far higher.

Just on the Wi-Fi side of things, the Saturday semifinal games this year produced enough single-day traffic (6.3 TB) to sneak into our unofficial Top 5 list for Wi-Fi events, barely edging Super Bowl XLIX, which saw 6.2 TB of traffic in the same building a couple years earlier. Granted, the Final Four has more fans in attendance and more time with two games compared to one, but it’s still a sign (to us, anyway) that wireless use by fans at big games of all types is continuing to grow. (It’s cool to see the comparison between a Super Bowl and a Final Four in the same venue, as well. Looks like the network operators there keep improving from big game to big game.)

According to the network stats provided to us, the Final Four crowd on Saturday saw 38,520 unique users connected to the Wi-Fi at some point, with a max concurrent user total of 20,675. On Monday night’s championship game, those numbers were 31,458 uniques and 19,861 max concurrent users. Attendance for the two sessions was 77,612 for Saturday’s semifinals and 76,168 for Monday’s championship, which were both second-highest ever numbers, according to a cool NCAA infographic that has some more stats on TV and internet viewership.

See you next year in San Antonio, NCAA… to see if the connectivity pace keeps increasing!

THE NEW TOP 8 FOR WI-FI

1. Super Bowl 51, NRG Stadium, Houston, Feb. 5, 2017: Wi-Fi: 11.8 TB
2. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB
3. Green Bay Packers vs. Dallas Cowboys, Divisional Playoffs, AT&T Stadium, Arlington, Texas, Jan. 15, 2017: Wi-Fi: 7.25 TB
4. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB
5. NCAA Men’s Final Four, University of Phoenix Stadium, Glendale, Ariz., April 1, 2017: Wi-Fi: 6.3 TB
6. Super Bowl 49, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB
7. Alabama vs. Texas A&M, Kyle Field, College Station, Texas, Oct. 17, 2015: Wi-Fi: 5.7 TB
8. Pittsburgh Steelers vs. New England Patriots, AFC Championship Game, Gillette Stadium, Foxborough, Mass., Jan. 22, 2017: Wi-Fi: 5.11 TB

Super Bowl LI Wi-Fi sees drop in average per-fan use total

Under seat Wi-Fi APs visible down seating row at NRG Stadium. Credit: 5 Bars

Under seat Wi-Fi APs visible down seating row at NRG Stadium. Credit: 5 Bars

While Super Bowl LI in Houston set records for most total Wi-Fi used in a single day event, the actual amount of average Wi-Fi data used per connected fan actually dropped from the previous year’s game, from about 370 megabytes per user at Super Bowl 50 to about 333 MB per user for Super Bowl 51.

Using official totals provided by the NFL’s official analytics provider, Extreme Networks, there was a total of 11.8 TB of data used on the Wi-Fi network at NRG Stadium in Houston during Super Bowl 51, compared to 10.1 TB used during Super Bowl 50 at Levi’s Stadium in Santa Clara, Calif.

While the total Wi-Fi data number represents approximately a 17 percent increase from Super Bowl 50 to Super Bowl 51, the most recent game had 35,430 users who connected at least once to the network, an almost 30 percent leap from Super Bowl 50’s 27,316 unique users. So while Super Bowl 51 had more unique users (and more peak concurrent users as well) and a higher data total, the average amount of data used per connected fan decreased, from about 370 MB per user to about 333 MB per user.

Data for Super Bowls in years past is thin (mainly because stadium Wi-Fi didn’t really exist), but it’s certainly the first time in very recent history that the per-user average has dropped from one Super Bowl to the next. Super Bowl 49, held at the University of Phoenix Stadium in Glendale, Ariz., saw a total of 6.23 TB of Wi-Fi used, with 25,936 unique users, for a per-user average total of 240 MB. We don’t have any stats for unique users at Super Bowl XLVIII in MetLife Stadium, but with the total Wi-Fi used there at 3.2 TB the average was also presumably much lower as well, unless there were also 50 percent fewer connected users.

Did autoconnect drop the average?

Wi-Fi gear visible above concourse kiosk at NRG Stadium. Credit: 5 Bars

Wi-Fi gear visible above concourse kiosk at NRG Stadium. Credit: 5 Bars

The drop in per-user average data for Wi-Fi is curious when compared to the huge leap in overall DAS stats for the last two Super Bowls, with Super Bowl 51 checking in at 25.8 TB of data, a figure that does not include statistics from T-Mobile, which is declining to report its data total from the game. At Super Bowl 50, all four top wireless carriers combined saw 15.9 TB, so the total for Super Bowl 51 is about 62 percent higher — and if you add in the estimated 3-4 TB that was likely recorded by T-Mobile, that leap is even bigger.

Unfortunately cellular carriers do not provide the exact number of connected users, so there is no per-user average data total available. It would be interesting to know if the expanded DAS preparations made at Super Bowl 50 and at Super Bowl 51 actually connected more total users, or allowed users to use more data per user. We have a request with Verizon for more stats, but it may be a long wait.

One theory we have here at MSR is that it’s possible that a large number of autoconnected devices may have increased the unique-user total while not necessarily adding to the overall Wi-Fi data-used total. In our reporting about the NRG Stadium network we noted that Verizon, which helped pay for the Wi-Fi deployment, had reserved 40 percent of the Wi-Fi capacity for its customers, many of whom could have been autoconnected to the network even without them knowing. We have asked both Extreme and Verizon for a breakdown on Verizon users vs. other wireless customer users on the Wi-Fi network, but have not yet received a response.

Update: Super Bowl LI breaks 37 TB wireless mark

NRG Stadium during Super Bowl LI. Credit: AP / Morry Gash/ Patriots.com

NRG Stadium during Super Bowl LI. Credit: AP / Morry Gash/ Patriots.com

It’s official now, and without any doubt Super Bowl LI broke the single-day wireless data use mark, with at least 37.6 terabytes used.

The official stats for Wi-Fi at NRG Stadium are finally in, with a mark of 11.8 TB, which is a bit more than the 10.1 TB recorded at last year’s Super Bowl at Levi’s Stadium, the previous top mark. The official stats were reported Thursday by Wi-Fi gear provider Extreme Networks, which posted them on the company website.

New DAS records even without any T-Mobile stats

On the cellular side Verizon Wireless, AT&T and Sprint all set new records, with Verizon reporting 11 TB of use and AT&T reporting 9.8 TB, while Sprint (which ran on its own DAS at NRG Stadium) hit 5 TB. At last year’s Super Bowl Verizon (7 TB) and AT&T (5.2 TB) had set their respective previous high-water marks, while Sprint had reported 1.6 TB at Levi’s Stadium. Even without numbers from T-Mobile the current DAS count is 25.8 TB, much higher than the 15.9 TB cellular total from Super Bowl 50.

(Unfortunately, T-Mobile right now is refusing to provide a total data number — a spokesperson who didn’t want to be quoted claimed on a phone call that the total data number was “not relevant,” and that T-Mobile would not provide a final number. However, we did see a blog post from the company claiming it passed its 2.1 TB total from last year by halftime, so at the very least we could probably accurately add at least another 2.2 TB to the overall DAS total. So we may see a combined total of all cellular and Wi-Fi nearing 40 TB before it’s all counted up, approved or not.)

One of our close friends in the business was at the game, and was kind enough to send us a bunch of Wi-Fi speedtests from NRG Stadium (go check our Twitter timeline at @paulkaps to see the tests linked).

What was interesting was watching the speeds go down when “spike” events occurred, like touchdowns and the end of Lady Gaga’s halftime show. The incredible comeback by the New England Patriots to claim a 34-28 overtime victory kept the network busy through the night, and after the game as well during the awards ceremony.

Tom Brady with the Lombardi Trophy. Credit: AP / Patriots.com

Tom Brady with the Lombardi Trophy. Credit: AP / Patriots.com

New record for take rate

According to Extreme, fans at NRG Stadium also set new high-water marks for unique connections to the network as well as for peak concurrent connections. At Super Bowl LI Extreme said it saw 35,430 fans connect to the network, a 49 percent take rate with the attendance of 71,795. Last year at Super Bowl 50 at Levi’s Stadium a total of 27,316 fans connected to the network out of 71,088 attending, a 38 percent take rate.

On the peak concurrent-connection side, Super Bowl LI set a new mark with 27,191 fans connected at one time, according to Extreme. At the Super Bowl 50, the top concurrent-connected mark was 20,300.

Extreme also released some social-media statistics, claiming that 1.7 TB of the Wi-Fi total was social media traffic. Leading the way in order of most users to fewer were Facebook, Instagram, Snapchat and Twitter. Interestingly, Snapchat consumed almost as much data as Facebook, according to pie graphs in the Extreme infographic, which did not provide any actual numbers for those totals. Extreme also did not report what is typically the highest use of bandwidth in any stadium situation, that being Apple iOS updates and Google Gmail activity.

The NFL, which had its own game-day application for Super Bowl LI, has not released any statistics about app use.

Congrats to all the carriers, integrator 5 Bars and Wi-Fi gear supplier Extreme Networks.

THE NEW TOP 6 FOR WI-FI

1. Super Bowl 51, NRG Stadium, Houston, Feb. 5, 2017: Wi-Fi: 11.8 TB
2. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB
3. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB
4. Super Bowl 49, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB
5. Alabama vs. Texas A&M, Kyle Field, College Station, Texas, Oct. 17, 2015: Wi-Fi: 5.7 TB
6. Pittsburgh Steelers vs. New England Patriots, AFC Championship Game, Gillette Stadium, Foxborough, Mass., Jan. 22, 2017: Wi-Fi: 5.11 TB

THE NEW TOP 4 FOR TOTAL USAGE

1. Super Bowl 51, NRG Stadium, Houston, Feb. 5, 2017: Wi-Fi: 11.8; DAS: 25.8 TB**; Total: 37.6 TB
2. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB; DAS: 15.9 TB; Total: 26 TB
3. Super Bowl XLIX, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB; DAS: 6.56 TB**; Total: 12.79 TB**
4. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB; DAS: 1.9 TB*; Total: 8.6 TB*

* = AT&T DAS stats only
** = AT&T, Verizon Wireless and Sprint DAS stats only

Verizon goes under concrete to bolster NRG Stadium DAS for Super Bowl LI

Nodes on wheels, or NOWs, provide extra coverage for Verizon Wireless in Houston for Super Bowl LI. Credit: Verizon Wireless

Nodes on wheels, or NOWs, provide extra coverage for Verizon Wireless in Houston for Super Bowl LI. Credit: Verizon Wireless

In a slight twist from its strategy for last year’s Super Bowl, Verizon Wireless has installed DAS antennas underneath the concrete flooring of lower-tier seats at Houston’s NRG Stadium, to provide extra bandwidth for the expected high wireless data usage at Super Bowl LI.

Last year at Levi’s Stadium in Santa Clara, Calif., Verizon beefed up its distributed antenna system (DAS) with under-seat antennas it designed specifically for use in stadiums. The idea of mounting antennas under seats, a growing trend in the stadium Wi-Fi world, is gaining traction as another method of bringing signals closer to fans, especially in places (like lower bowl seats) where there are no overhangs or other places to mount gear.

And while Verizon has been preparing for Sunday’s big game at NRG Stadium for years, that didn’t stop the company from “continually tweaking” its network preparations, according to Leo Perreault, executive director of network operations for Verizon’s South Central market, a region that stretches from west of Florida to Arizona, including Houston. In a phone interview this week, Perreault said that Verizon installed the under-concrete antennas during the middle of the 2016 football season, giving the company “some good experience” with the deployment ahead of Sunday’s game.

Under concrete = easier install and maintenance

A view inside the head end room that runs Verizon's NRG Stadium DAS. Credit: Verizon Wireless

A view inside the head end room that runs Verizon’s NRG Stadium DAS. Credit: Verizon Wireless

It might not be well known outside of wireless networking circles, but signals will travel through concrete; many early stadium Wi-Fi designs (and some current ones, including a new network installed at the Pepsi Center in Denver) use antennas mounted under concrete floors, pointing up. Though fixed under-seat antennas can provide better coverage, Perreault said the ease of deployment made putting the additional DAS antennas underneath the floor a better option in Houston.

“This way [under the concrete] is non-intrusive,” Perrault said, noting that the devices are also not affected by stadium power-washing units. The decision may have been influenced by the fact that NRG Stadium’s new Wi-Fi network had a big issue with moisture in under-seat AP placements, forcing a mid-season rip and replace for all the under-seat Wi-Fi APs.

Even though antennas under concrete are not as powerful, Perrault said Verizon is “very pleased with the performance. It’s a good compromise.”

Biggest stadium DAS?

Between the game being the Super Bowl and it being in Texas, there’s no shortage of hyperbole surrounding the game and all its attendant facets, including the network technology. But when Perreault claims that the DAS Verizon has installed for NRG Stadium “might be the largest we have anywhere,” that might be true since it also serves adjacent properties including the NRG Convention Center, the NRG Arena and an outdoor DAS in the surrounding spaces. In addition to Houston Texans games, NRG Park (which includes the stadium) is also host to the Houston Livestock Show and Rodeo, which humbly bills itself as the “world’s largest livestock show and richest regular-season rodeo.”

An alien spaceship, or a temporary cell tower from Verizon? You choose.

An alien spaceship, or a temporary cell tower from Verizon? You choose.

Inside NRG Stadium, Perreault said the new Verizon DAS (built before the 2015 season) has more than 900 antennas. As neutral host, Verizon will also provide access to AT&T and T-Mobile on its network; Sprint, which built a previous DAS at NRG, will continue to run on that system.

Outside the stadium and around Houston, Verizon has done the usual big-event preparations, with lots of permanent and temporary macro network improvements, and portable units like COWs (cells on wheels) and smaller NOWs (nodes on wheels). You can review all the Verizon preparations in a company blog post.

As previously reported in MSR, Verizon also helped foot part of the bill for the new NRG Stadium Wi-Fi network, a deal that will give Verizon a reserved claim to 40 percent of the Wi-Fi network’s capacity, according to Perreault.

Whether or not Super Bowl LI breaks the wireless data consumption records set at last year’s game remains to be seen, but Perreault said there doesn’t seem to be any slowing down yet of the perpetual growth in wireless data use at stadiums, especially at big events like the Super Bowl.

“Fans just seem to find ways to consume whatever additional bandwidth you provide,” he said.

NFL builds its own Super Bowl app, with no concessions delivery and fewer replays

Screen shot of map function on NFL Super Bowl LI app.

Screen shot of map function on NFL Super Bowl LI app.

The NFL has built its own Super Bowl mobile app, breaking with a recent history of using stadium-app specialists like VenueNext and YinzCam to develop specific apps for Super Sunday.

Also unlike recent years, the NFL’s Super Bowl app will not feature instant replays or have any kind of food or drink delivery services. Instead, there appears to be a big focus on promoting Super Bowl events (especially those for this weekend) and for helping out of town tourists find their way to Super Bowl events and to the game itself.

Curiously, an interview about the app with the NFL’s CIO claimed that this year’s app will also be the first to include the ability for fans at the game to watch Super Bowl commercials. The story also claims without any attribution that “In the past, commercials weren’t on the app in order to avoid using too much bandwidth in the stadium.” However, at the most recent Super Bowls, including the past two, stadium bandwidth has been more than sufficient enough to stream plenty of video. And in fact, both of the last two Super Bowl apps have included the ability for fans at the game to see Super Bowl commercials.

Last year’s app, developed by VenueNext for the Levi’s Stadium hosting of Super Bowl 50, definitely showed Super Bowl commercials, part of what the San Francisco 49ers network team said was a record-breaking day of app-based video watching. The Super Bowl 49 app, built by YinzCam, also included Super Bowl commercials according to this NFL video and according to our previous reporting.

Fewer replays, no food or beverage delivery service

Screen shot of transportation info links from Super Bowl LI app.

Screen shot of transportation info links from Super Bowl LI app.

And even though NFL CIO Michelle McKenna-Doyle is quoted in the previous story about the new app as saying “You won’t feel like you’re using two separate apps as fans have in the past,” the Super Bowl LI app contains a link to download the separate NFL Mobile app, which is apparently where Super Bowl highlights and replays will live. There was no confirmation from the NFL or Verizon about whether or not fans in the stands would be able to watch the live broadcast of the game via NFL Mobile. Fans not at the game will be able to use NFL Mobile to watch the game on cellular devices; fans can also stream the game from the FoxSports website, for PCs or tablet devices.

This year’s app will also not include any way for fans to use the app to order food or beverage delivery to their seats; last year’s app did have the ability to order in-seat delivery of beverages or to place an order for food and beverage express pickup, a service used for 3,284 orders. NRG Stadium, however, does not offer full-stadium in-seat ordering like Levi’s Stadium does; the stadium does have serving staff with wireless devices providing in-seat ordering services for club sections, which will likely be in use at the Super Bowl as well.

NRG Stadium hit 4.11 TB on Wi-Fi for Texans-Raiders playoff game

NRG Stadium. Credit: Houston Texans Instagram

NRG Stadium. Credit: Houston Texans Instagram

In what became the last live tune-up before the Super Bowl, NRG Stadium in Houston saw fans use 4.11 terabytes of data on the venue’s new Wi-Fi network during Houston’s 27-14 playoff victory over Oakland on Jan. 7, according to the Texans.

Jeff Schmitz, vice president of information technology for the Texans, said that NRG Stadium also saw approximately 35,000 unique users on the network at the playoff game, a 48 percent take rate against the total attendance of 71,790. The peak concurrent user number for the game was almost 24,000 users, with all numbers setting season highs for the network that debuted at the NFL season start, according to Schmitz.

“The playoff game was definitely the biggest” network-traffic day for the Texans, said Schmitz in a phone interview. During the talk Schmitz clarified that the network went through a serious up-and-down stretch during the middle of the season, due to under-seat Wi-Fi AP enclosures that didn’t completely seal out moisture.

Under seat APs visible down seating row. Credit: 5 Bars

Under seat APs visible down seating row. Credit: 5 Bars

While MSR had previously reported on the issue, Schmitz clarified that the full replacement of the APs took place in late October, meaning that the network staff had to basically re-tune and adjust the network in the later months of the season.

But the 4.11 TB mark and the large number of connected users for the playoff game was a sign that the network was in fine shape for Sunday’s Super Bowl LI, where if history offers any guidance there might be another new record set for single-day Wi-Fi usage.

The number to beat is the 10.1 TB mark from Super Bowl 50 at Levi’s Stadium last February, part of a 26 TB wireless day (with 15.9 TB recorded on cellular and DAS networks).

Wi-Fi coaches staying for Super Bowl

Schmitz also said that the Extreme Networks “Wi-Fi coaches” would be on hand for Super Sunday, helping fans figure out how to connect to the Extreme-based network and its 1,250 APs.

“We thought we’d only keep the coaches (who roam the stadium helping fans with network issues) for half a season, but with the switch [in APs] we ended up having them there for every game,” Schmitz said.

Wi-Fi gear visible above concourse kiosk. Credit: 5 Bars

Wi-Fi gear visible above concourse kiosk. Credit: 5 Bars

Having the Wi-Fi coaches at the Super Bowl also makes sense since many fans at that game will likely be visiting NRG Stadium for the first time, as opposed to Texans season ticket holders.

Though NRG Stadium won’t have to contend with temporary structures like those built on the concourses at Levi’s Stadium last year, Schmitz said there is some extra network work ahead to make sure the auxiliary press box area has “beefed up” Wi-Fi as well as wired connections for media use.

Another thing missing from last year’s Super Bowl is the ability for fans in any seat to order beverage delivery via the game-day app. Though details of services for the Super Bowl app have yet to be fully announced, Schmitz said the only in-seat delivery would be for premium club-level seats, which in addition to app-based ordering will have live humans who can take orders from fans for in-seat delivery, something Texans fans have available during regular-season games.

“That service [fans ordering from servers] gets used the most,” Schmitz said.