Wi-Fi Whispers: Standing fans and marching band interference; NFL sideline Wi-Fi fixed?

Baylor students standing at football game. Photo credit: Rod Aydelotte, WacoTrib.com

Baylor students standing at football game. Photo credit: Rod Aydelotte, WacoTrib.com

Welcome back to another posting of Wi-Fi Whispers, our once-active “notes” column that I think makes sense to start back up again. What I like most about this feature is that it gives me a chance to comment and “move the ball forward” on other stadium Wi-Fi (and DAS) stories I’ve seen out there, or to correct/comment/criticize as needs be.

STAND UP FOR WI-FI: First up is a story about the Wi-Fi network at Baylor University’s new McLane Stadium, and how it ran into some unexpected interference — namely, the fact that a lot of Baylor students like to stay standing during the game, something that messed with the initial access point and antenna deployment.

According to a story by Regina Dennis at WacoTrib.com, Baylor will be tweaking the Wi-Fi antennas to compensate for the standing fans, which is apparently a Baylor tradition (and something we’ve seen at other schools). One of the more interesting quirks of Wi-Fi reception is the fact that water is a big blocker of signals in the unlicensed bands used by Wi-Fi; and since human bodies are mostly water, a standing fan could become a sort of Wi-Fi shield. Here’s a quote from the story that tells more:

“There’s really no issue with the design, it works absolutely perfect — as long as people are either sitting in their seats or standing on the ground,” said Pattie Orr, Baylor’s vice president of information technology. “It doesn’t ruin the reception, but it makes the angles of the antenna not the best option.”

The story also notes that the Wi-Fi signals were degraded in the area where the Baylor band sits, in part because of the large instruments used. Extreme Networks, supplier of the Wi-Fi gear in McLane Stadium, will help Baylor fine-tune the system, according to the story. And we are sure we’ll hear some interesting stories about “tuba interference” at next year’s SEAT conference.

SIDELINE WI-FI IS FINE, SAYS NFL: While it’s a little tough getting tech information out of the NFL these days due to the public-relations siege the league is facing, we did get a source to comment on background about an article saying that the league’s sideline Wi-Fi isn’t working well. The article is basically a late follow-up to an issue that “surfaced” early in the season, when New England Patriots head coach Bill Belichick complained that the new system of Microsoft Surface tablets and league-provided Wi-Fi wasn’t up to snuff.

The follow-on article at TechTarget’s SearchNetworking site says in its headline that “NFL’s Cisco-based stadium Wi-Fi frustrates tablet-toting coaches,” but it only has one coach, Belichick, complaining, and it doesn’t have any new reactions or information other than the original Boston Globe story. What it does have is confirmation that Cisco equipment is used in the sideline Wi-Fi deployment, then several reactions from industry analysts — none of whom have any actual information about the system or any actual, proven or reported failures.

While it’s possible that there have been more glitches, our question is, why write an article about it if you can’t find more than the single episode, from someone you haven’t really talked to in order to find out what really happened? Our league source, who would only comment on background, said there were issues with network interference during the preseason, but that now the systems are working in all stadiums. Of course, if any coaching staff types beg to differ you can always let us know here at MSR, but our guess is that if the systems were failing you’d hear complaints since NFL head coaches aren’t the silent type.

Why can’t the sideline networks just tap into the stadium Wi-Fi, especially in places where the new networks are powerful? According to Dan Williams, the vice president of technology for the San Francisco 49ers, the sideline networks need to be separate for security and objectivity reasons — meaning, so you can’t accuse the home team of screwing up the network to gain advantage. As soon as we can, we’ll get a more thorough report together on the deployments, which we think are pretty interesting — and probably a lot better than running photos down a wire from the press box, like they used to in the old days.

LEVI’S STADIUM ANNOUNCES JMA AS DAS GEAR SUPPLIER: You may have read our feature about Levi’s Stadium DAS deployer DAS Group Professionals, but for a little deeper inside-baseball dive there is a press release from the Niners today announcing that JMA Wireless is one of the gear suppliers behind the DGP DAS. JMA, also known inside the industry for the Teko Telecom products it uses, is behind other stadium DAS deployments, including at the Anaheim Angels’ ballpark.

Stadium Tech Report: Wi-Fi + advanced stadium app helps Philadelphia Eagles ‘Linc’ with fans

Wi-Fi gear on the exterior of Lincoln Financial Field. Credit all photos: Philadelphia Eagles

Wi-Fi gear on the exterior of Lincoln Financial Field. Credit all photos: Philadelphia Eagles

With victories in their first three games, the Philadelphia Eagles are off to a fast start this NFL season. And from a networking standpoint, Eagles fans are keeping pace, with Wi-Fi connections at Lincoln Financial Field already surpassing last year’s totals.

Now in the second season of having full-stadium Wi-Fi available for fans, the Eagles’ technology team is pushing the needle forward, much like the high-powered offense head coach Chip Kelly runs on the field. An already advanced stadium app will soon get even more video features, including instant replay, to further enhance the game experience for the 69,176 fans who fill the “Linc” on home-game Sundays.

According to Anne Gordon, the Eagles’ senior vice president for media and communications, there were more than 21,000 fans using the in-stadium Wi-Fi network at the team’s Sept. 7 opening game, a total that surpasssed the 19,671 users on the network at the Eagles’ final game last season, a 26-24 loss to the New Orleans Saints in a wild card game on Jan. 4, 2014.

Anne Gordon, SVP Media and Communications, Philadelphia Eagles

Anne Gordon, SVP Media and Communications, Philadelphia Eagles

Along with the growth in user numbers is an even greater jump in the amount of data being used; according to Gordon, the Eagles’ Extreme Networks-powered Wi-Fi network carried 946 Gigabytes of data in the Sept. 7 game against the Jacksonville Jaguars, up from around 400 GB used during the playoff game in January. Unlike some other stadiums with Wi-Fi networks, Gordon said that the Linc network regularly sees fans download more data than they upload — a reflection of the team’s strategy to provide a wide range of custom content for fans to help improve the game-day experience.

“We want to help them become better fans, and improve their enjoyment of the game,” said Gordon in a recent phone interview. “That was our vision from the beginning.”

But to get to that vision, the Eagles first had to give fans a way to get the content. That meant using some of the $125 million in recent renovation fees to build out the stadium-wide Wi-Fi network, which Gordon said eliminated past connectivity headaches for Philadelphia fans.

Build it, and show them how to use it

Screen shot of Eagles' stadium app

Screen shot of Eagles’ stadium app

“Prior to the 2013 season, there were real issues trying to connect mobile devices in the stadium,” Gordon said. “You might get a signal, but then walk 20 steps and lose it. When we talked to fans, improving the wireless network [in the stadium] was high on their list.”

Working with partner Extreme Networks, which now runs Wi-Fi networks in four other NFL stadiums, the Eagles had stadium-wide coverage ready to go before the 2013 season kicked off. But unlike some venues, which do little to promote their in-stadium networks, the Eagles and Extreme brought some more NFL flavor to their wireless experience in the form of “Wi-Fi coaches,” network-savvy people who roamed the stands in readily identifiable clothing, offering personal assistance to fans trying to connect.

“We put notes in the cup holders the first few games of last season, and then had the coaches with jackets that said ‘ask me’ on them,” Gordon said. That little bit of assistance, she said, spreads quickly.

“If you connect one person, that fan shows six more people in the row [how to connect],” Gordon said. “Our fans took to the network immediately.”

And just in case fans need a refresher, the team’s website has perhaps the league’s best help pages, with simple screen shots showing how to install, open and use the most popular features on the team app.

Out front with app features

As we found out in our recent report on NFL stadium technology deployments, there are many teams with stadium Wi-Fi networks, but the level of application and content delivery varies from team to team. With a feature lineup that includes in-stadium access to the NFL’s popular RedZone channel alongside a live feed from the stadium’s large video boards, the Eagles’ app was clearly among the league leaders when it launched last year. And soon, Gordon said the Eagles will add more live camera views and replay choices to the menu, developments made possible in part by the team’s close relationship with app designer YinzCam Inc.

“We have a unique relationship with YinzCam, and work hand in hand with them [on new developments],” Gordon said. “We’re blessed in that we get a lot of things in our app first.” The Pittsburgh-based YinzCam, which has designed team and stadium apps for a long list of sports-team customers, is a preferred team-app partner of the NFL, which was an early investor in the company.

Can you find the Wi-Fi access point?

Can you find the Wi-Fi access point?

With a long history of full houses, Gordon said the team doesn’t need to use its network or app strategy to try to put people in seats.

“We are continuously sold out, so thankfully we don’t have to sell tickets [with the app],” said Gordon, noting that some fans have had season tickets in their families for several generations. That fact allows the Eagles’ tech team to make their digital strategy “100 percent about improving the game experience,” Gordon said. “We’re giving them a reason to download and consume.”

Not possible without the network

With more than 700,000 downloads of the stadium app so far, it appears as if the Eagles have a winning digital strategy to match the team’s recent on-field successes. Now the biggest challenge may be finding enough Internet bandwidth to keep the fans supplied with the in-game content.

“We are definitely bumping up against our [bandwidth] pipe threshold,” Gordon said. So far, it looks like the campaign to use content to improve the experience at the Linc is working — along with the network that links it all.

“If the [Wi-Fi] network doesn’t work, people get frustrated and don’t use the app,” Gordon said. “The network is what had to happen to make this vision possible.”

Stadium Tech Report: THE FOOTBALL ISSUE arrives, with extensive coverage of Levi’s Stadium launch and tech reports on all 31 NFL stadiums

STR3_ThumbMobile Sports Report is pleased to announce the arrival of THE FOOTBALL ISSUE, our third Stadium Tech Report for 2014. As the title suggests this long-form report focuses on technology deployments at U.S. football stadiums, with an extensive inside look at the technology inside Levi’s Stadium, the new facility for the San Francisco 49ers. The report is available for free download from our site.

In addition to our Levi’s coverage, the Q3 issue of Stadium Tech Report also includes team-by-team reports on all 31 NFL stadiums, with a focus on Wi-Fi and DAS deployments. Our research found that while there are still 10 stadiums without fan-facing Wi-Fi, there is a lot of innovation going around league-wide, including big new digital displays in Jacksonville and Dallas, and new Wi-Fi and app deployments in other facilities.

Included in the report is an exclusive MSR interview with Michelle McKenna-Doyle, the NFL’s chief information officer, who talks about how the league office acts as a guide to helping teams with their tech deployments. We also have additional insight, analysis, and more tech profiles, and the good news is it is all free to read! Simply head to our report download page and get your free copy today!

We’d like to take a quick moment to thank our report sponsors, without whom we wouldn’t be able to offer such extensive original reporting and analysis free of charge. Our list for the Q3 2014 report includes SOLiD, Crown Castle, TE Connectivity, Extreme Networks, Aruba Networks, Mobilitie and DAS Group Professionals.

Niners’ home opener tops Super Bowl for Wi-Fi data traffic with 3.3 Terabytes

Fans take pictures of opening kickoff from southwest concourse. Credit, all photos: Paul Kapustka, MSR

Fans take pictures of opening kickoff from southwest concourse. Credit, all photos: Paul Kapustka, MSR

The first regular-season home game for the San Francisco 49ers in their new home, Levi’s Stadium, produced more Wi-Fi traffic and far more actual fan-to-network connections than the most-recent Super Bowl, according to statistics from the Niners’ tech team.

Dan Williams, vice president of technology for the 49ers, said the Levi’s Stadium Wi-Fi network carried 3.3 Terabytes of data during Sunday night’s game between the Niners and the Chicago Bears, topping the 3.2 TB mark reported from Super Bowl XLVIII in February. According to Williams, out of the 70,799 that filled Levi’s Stadium Sunday, more than 30,000 fans connected to the Wi-Fi network at some point, with peak usage of 19,000 fans all connecting at one time occurring just before the 5:30 p.m. local time kickoff. According to the Super Bowl stats, the peak number of fans on Wi-Fi at that game at MetLife Stadium in New Jersey was 13,500.

“We’re pretty excited by Sunday,” said Williams, who said that the Wi-Fi network stood up well even under peak data transfer rates of 3.1 Gbps right before kickoff, and another 2.6 Gbps peak around 7:30 p.m. Around the peaks, network traffic stayed “well over 1 gig per second for three and a half hours,” Williams said.

North scoreboard screen at Levi's Stadium.

North scoreboard screen at Levi’s Stadium.

During the Niners’ first preseason game against the Denver Broncos, the Levi’s Stadium Wi-Fi network carried 2.13 TB of data, and during the Aug. 24 preseason game against San Diego there was another 1.96 TB of Wi-Fi data. The figures do not include any reporting from the stadium’s DAS network, which carries cellular traffic from AT&T, Verizon Wireless and T-Mobile customer. If preseason games are any indication, Williams expects to see numbers in the terabyte range for DAS traffic as well.

The Wi-Fi numbers from Sunday showed that fans quickly figured out a name change in the network name (or SSID). During preseason games, the Wi-Fi network was identified as “Levi’s Stadium” in a device list of available networks; on Sunday the free stadium network used the name “xfinitywifi,” reflecting the brand of Wi-Fi sponsor Comcast. Some fans might have been confused since the “xfinitywifi” SSID is the same one used by Comcast for its public Wi-Fi networks.

“Some folks may have been scratching their heads,” said Williams. “We changed the name last Monday before the opener.”

Replay app gets 7,800 views

As previously reported by MSR, the instant replay feature of the Levi’s Stadium app had its debut Sunday, and according to Williams fans watched 7,800 replays via the app. The top replay view was of the early touchdown pass from Niners QB Colin Kaepernick to Michael Crabtree, which Williams said was viewed more than 1,000 times.

Fans on southwest concourse take photos of live action.

Fans on southwest concourse take photos of live action.

As MSR reported, the replay feature was somewhat limited in functionality, not working at all until late in the first half and then only offering the last two plays plus some scoring highlights for viewing. Previously, team executives had said the replay feature would offer multiple camera angles and multiple replay reviews all at the same time. According to Williams, more features will be added to the replay function in the near future.

“It’s not the finished product, by any means,” Williams said. “You’ll see some more polish on it.”

The most-used feature in the stadium app, Williams said, continues to be the food and beverage features, which allow fans to either purchase concessions for express line pickup, or to have their orders delivered to their seats. Williams said the Niners delivered 2,100 food orders to fans Sunday, the most for the Niners so far.

Perhaps the best news for Williams was the lack of complaints about the wireless network, which the team had asked fans to tweet about if they were experiencing problems. Though some fans with older devices that only work on the 2.4 GHz wireless bands might not see the same speeds as those with newer devices (which use the more roomy 5 GHz bands), Williams said his team only got a couple complaints about network issues, and one of those was solved before they could respond.

“Overall it just was a really good [wireless] experience,” said Williams, who always ends by noting that networks are never completely finished products. But with its Super Bowl-beating performance Sunday, the Levi’s Stadium network appears in midseason form.

“I think we’re close,” Williams said.

View from the north porch

View from the north porch

Instant replay feature debuts as network rocks at Niners’ home opener at Levi’s Stadium

Instant replay feature on Levi's Stadium app. Credit all photos: Paul Kapustka, MSR

Instant replay feature on Levi’s Stadium app. Credit all photos: Paul Kapustka, MSR

Niners fans may not have liked the final outcome on the scoreboard, but there was no complaining about the wireless network performance for the regular season home opener at Levi’s Stadium.

The somewhat limited debut of the highly anticipated instant replay feature for the Levi’s Stadium app was perhaps the technology highlight, with plays available for viewing seconds after they happened — when the feature finally got going later in the game. Our unofficial speedtests from various points around the stadium showed the Wi-Fi network and DAS network in top form, with solid results in the 20-plus Mbps range at most places for both networks.

We’re still waiting for the official postmortem results stats from the 49ers’ tech crew, but we did get some in-game messages from Niners VP of technology Dan Williams, who said that right before the 5:30 p.m. local time kickoff the usage peak was hit, with more than 19,000 simultaneous users on the Wi-Fi network, using throughput of 3.1 GB per second. Our unofficial guess is that the Niners’ opener may have set new single-game records for data traffic, but we’ll wait until we hear the final totals before we make any such proclamation.

The good news for Niners fans is that everywhere we went in the stadium, including on the top-level cheap-seat decks, the network was strong.

Replay feature sees limited action

If there was any tech downside, it was the limited availability of the instant replay feature. When talking about this feature earlier this year, team officials were adamant that it would be an unbelievable thing, with multiple camera angles and multiple choices of replays to watch. In reality, the feature wasn’t even available for most of the first half, and then when it did start working in the second half it only offered replays of the last two live plays, and two scoring highlights, one of which did not function at first.

Picture of app late in the first half.

Picture of app late in the first half.

Another beef we had with the replay feature was that it wasn’t clearly located on the “Game Center” part of the app; you had to know to click on the down arrow of the screen for the last play replay to appear. We found it only by accident, and would guess that not many fans found it or used it during the Niners’ loss to the Chicago Bears.

When we did watch the replays, however, we were simply amazed by the system’s performance — instant replays were available just seconds after a play had taken place, with a text play by play description as well. But again, there were no options for multiple camera angles, and there were only two “scoring play” highlights available when we last checked, and one (of an early field goal) didn’t have working video.

Other impressions from our stadium visit (which was made possible thanks to a press pass given to MSR by the Niners PR team):

— Concourses are fun places to watch: We watched the national anthem and opening kickoff and drive from the southwest concourse, one of the many places in Levi’s Stadium where you can stand and still see live game action. It was a packed house for the kickoff and first series, with many fans snapping phone pictures of the nearby field. East concourses were also good (though in one section an usher shooed us away from standing two-deep) as long as you kept the setting sun out of your eyes.

Fans take pictures of opening kickoff from southwest concourse.

Fans take pictures of opening kickoff from southwest concourse.

— Food runners were tired on the top deck: We stopped by for a quick chat with some of the food runners on the Pepsi deck on the north end of the stadium, and they looked pretty tired. Again, no official stats here but one runner said he’d been kept busy all game bringing food and drinks to fans who placed their orders via the app. “It’s pretty steep up here,” he said, pointing to the 400-level seating sections. “You get tired going up and down those steps.”

View from the Pepsi seating porch at the north end of Levi's Stadium

View from the Pepsi seating porch at the north end of Levi’s Stadium

— Clubs are the place to be: Several stories about the game noted that club-level seating was often empty, with fans perhaps spending time inside the comfortable beverage/food/gathering areas. Here’s a pregame look inside the United Club, located on the third level of the main building on the stadium’s west side.

United Club during pregame

United Club during pregame

— Signal strength: We also made several phone calls and did speedtests during halftime, when Snoop Dogg surprised us all with a mini-concert on the field. Not once during the game did we see any slowdowns in the network performance; the slowest Wi-Fi speed we found was 11 Mbps on the north concourse, where the team has admitted it didn’t put a lot of antennas (and is working to correct that).

Snoop on da big screen

Snoop on da big screen

— Light rail works fine: Then it was time to go home, and our choice to use the VTA light rail from Mountain View (instead of our press parking pass) was validated, as it took us less than an hour from the start of the line to the end of the line in Mountain View. All in all, an extremely solid home opener for one of the most ambitious stadium technology deployments out there.

Planning a DAS deployment? Check out these AT&T stadium stats from football opening weekend

There’s lots of shared belief out there that fans want to use mobile devices while they are attending sporting events. What we like even more here at Mobile Sports Report are hard numbers that tell us just how much fans are using mobile devices while they are in stadiums and arenas. Though sometimes hard to get, such statistics are great signposts for those who are planning to build their own stadium networks sometime soon, because it gives them a target to shoot for.

Courtesy of our friends over at AT&T, here are some traffic statistics gleaned from AT&T’s distributed antenna system (DAS) deployments in major professional and college football stadiums during last weekend’s games. According to AT&T, the average amount of cellular data used at a pro venue home opener in 2014 was 361 gigabytes, up 59 percent from season-opening games last year. The stats, remember, are only from AT&T DAS networks at the 16 NFL stadiums where AT&T has a DAS network presence.

The top stadium in terms of AT&T DAS traffic was Miami’s Sun Life Stadium with 1,035 GB (or 1.035 TB), followed by AT&T Stadium in Dallas with 889 GB and Atlanta’s Georgia Dome with 696 GB. It will be interesting to see whether or not any of those totals are surpassed by the San Francisco 49ers’ Levi’s Stadium, which hosts its first regular-season home game this Sunday.

On the collegiate side, the average opening-day traffic number was 288 GB, which is huge compared to the 2013 season average of 186 GB per game. The stats are an average taken from 25 Division 1 schools where AT&T has a DAS presence. And in case you were wondering where college football is king, the stats for schools in the South was an average of 343 GB, with the rest of the country checking in at 186 GB. The top three schools in terms of home-opener DAS traffic were Oklahoma with 866 GB, Georgia with 688, and the new stadium at Baylor with 686 GB.

More AT&T DAS stats follow. Remember, this is just a fraction of the actual traffic since many of these venues also have other carriers on DAS networks, as well as Wi-Fi networks in place. Other carriers and stadiums — send us your stats!

AT&T STADIUM DAS STATS

Year-over-Year Professional Mobile Data Increase

o 2014 home opener – 361GB average per venue

o 2013 season average – 227GB average per venue

· 2013 season average to 2014 season opener is a year-over-year increase of more than 59 percent

· 2013 season opener to 2014 season opener is a year-over-year increase of more than 58 percent

Opening Weekend Mobile Data Usage Professional vs. Collegiate

o 2014 professional season opener – 361GB average per venue

o 2014 collegiate season opener – 288GB average per venue

Top 5 Opening Weekend Professional Venues by Total Mobile Data

o Miami, FL – 1035GB

· Equivalent to more than 2.9 million social media post with photos

· Peak hour – 1-2pm ET – 146GB

o Dallas, TX – 889GB

· Equivalent to more than 2.5 million social media post with photos

· Peak hour – 2-3pm CT – 158GB

o Atlanta, GA – 696GB

· Equivalent to nearly 2 million social media post with photos

· Peak hour – 2-3pm ET – 159GB

o Chicago, IL – 452GB

· Equivalent to nearly 1.3 million social media post with photos

· Peak hour – 1-2pm CT – 107GB

o Pittsburgh, PA – 385GB

· Equivalent to more than 1.1 million social media post with photos

· Peak hour – 2-3pm ET – 83GB

Caveats:

· All figures include only data traffic seen on AT&T’s venue-specific mobile network.

· All data metrics come from only venues with a DAS where AT&T’s mobile network is on-air. These metrics are not comprehensive of every game played during the opening weekend for professional or college football.

· This data is compiled from 16 professional football stadiums and 25 division one college football stadiums that had opening week home games where AT&T is on-air on a DAS.

· All 2013 season average data is compiled from only venues with a DAS where AT&T’s mobile network was on-air and games where data was tracked and available.

ADDITIONAL AT&T COLLEGIATE DAS STATS

Regional Breakdown by Mobile Data Usage

o South – 343GB average per venue

o Rest of the US – 186GB average per venue

· Year-over-Year Mobile Data Increase

o 2014 home opener – 288GB average per venue

o 2013 season average – 155GB average per venue

· Top 5 Opening Weekend College Venues by Total Mobile Data

· Norman, OK – 866GB

o Equivalent to more than 2.4 million social media post with photos

· Athens, GA – 688GB

o Equivalent to more than 1.9 million social media post with photos

· Waco, TX – 686GB

o Equivalent to more than 1.9 million social media post with photos

· Auburn, AL – 506GB

o Equivalent to more than 1.4 million social media post with photos

· Los Angeles, CA – 469GB

o Equivalent to more than 1.3 million social media post with photos

Caveats:

· All figures include only data traffic seen on AT&T’s venue-specific mobile network.

· All data metrics come from only venues with a DAS where AT&T’s mobile network is on-air. These metrics are not comprehensive of every game played during the opening weekend for college football.

· This data is compiled from 25 division one college football stadiums that had opening week home games where AT&T is on-air on a DAS.

· All 2013 season average data is compiled from only venues with a DAS where AT&T’s mobile network was on-air and games where data was tracked and available.

· The “South” region is based off how it is qualified by the U.S. Census. It includes the following states: Delaware, District of Columbia, Florida, Georgia, North Carolina, South Carolina, Virginia, West Virginia, Alabama, Kentucky, Mississippi, Tennessee, Arkansas, Louisiana, Oklahoma and Texas.