Levi’s Stadium ‘NiNerds’ get high-visibility wardrobe upgrade

NiNerd sporting the new neon vest. (Click on any photo for a larger image) Credit all photos: Paul Kapustka, MSR

NiNerd sporting the new neon vest. (Click on any photo for a larger image) Credit all photos: Paul Kapustka, MSR

I needed a one of the NiNerds Sunday at Levi’s Stadium, and thanks to a new wardrobe addition, they were a lot easier to find.

Discovering a problem with the Levi’s Stadium app, I looked around for one of the stadium’s walk-around technology helpers — aka the “NiNerds” — and found one quickly thanks to the new neon-yellow vests many were wearing during Sunday’s game between the San Francisco 49ers and Washington.

Earlier this season, the NiNerds were much more nattily dressed in their gingham-check shirts, bow ties and fake horn-rim glasses. While cool and cute, the outfits proved hard to recognize in the crowd, especially since the NiNerds’ red check shirts looked a lot like the jerseys and t-shirts worn by the many faithful fans. Perhaps in order to make the NiNerds stand out more, the team dressed them in neon Sunday, like Wi-Fi “coaches” in other stadiums have done.

Unfortunately, the NiNerd I talked to wasn’t able to solve my problem (it seems to be related to a known bug in the newest Android release of the stadium app) but I did notice during my visit Sunday that the NiNerds in general seemed to be more numerous and visible, and they even got a nice shout-out on the Levi’s Stadium big screen (see photos below). Below are some thoughts and observations on the network performance, the app performance and the overall fan experience at Levi’s, which I hadn’t visited since the season opener back on Sept. 14.

Wi-Fi network struggles at 2.4 GHz, soars at 5 GHz

Speed test results from outer concourse location, Levi's Stadium, pregame

Speed test results from outer concourse location, Levi’s Stadium, pregame

On the network-performance side of things, the Wi-Fi system seemed as robust as ever for new devices, including the AT&T LG Optimus G Pro I’ve been test-driving lately. With the Android device and its 5 GHz Wi-Fi connection I hit speeds of 31 Mbps download and 29 upload before the game on the Levi’s Stadium outside concourse, and then had a 14 Mbps download connection in my seat in section 229 (south end zone) at kickoff. In the third quarter I wandered up to the top (7th) level of seats, and got a 28/33 Mbps reading while waiting in a concession-stand line.

With my older Verizon Droid 4 device, however, I struggled to connect to the Wi-Fi network. Since the phone only runs on the 2.4 GHz Wi-Fi frequency, it doesn’t do well at Levi’s Stadium, where the Wi-Fi is more heavily tuned for newer, 5 GHz-capable devices.

Full charging station... before the game starts

Full charging station… before the game starts

The best Wi-Fi speedtest I could get with the Droid device was a 1.06 Mbps download/3.04 Mbps upload mark, from the same spot on the outer concourse where the newer device recorded blazing connectivity speeds. Switching it over to its Verizon 4G LTE radio, I was able to get much faster connectivity, including one mark of 21.60/9.58 on the main level inside concourse.

I also ran out of juice on the Verizon phone before the end of the game — which could have been either the device draining due to its inability to get a solid connection, or due to the fact that it’s getting old and the battery doesn’t hold a charge that well anymore. Judging from the crowds around the Levi’s Stadium recharging stations (the picture to the left was taken during pregame) I am not alone in my device-energy woes.

App problem derails beacon test

One of the main tasks I had planned for Sunday was to see how well the beacon-assisted wayfinding feature in the stadium app worked. Only problem was, in the new update of the Levi’s Stadium app that was released in the past week (which I downloaded to both devices Sunday morning), several features were missing, including the “Maps” feature.

Picture of app fail in Levi's Stadium Android app

Picture of app fail in Levi’s Stadium Android app

A NiNerd I talked to outside the stadium on the Faithful Mile area showed me the maps/wayfinding feature on his iPhone, and pulled up a GPS-supported direction message that pointed the correct way for me to enter the stadium. But neither he nor the NiNerd I talked to inside the stadium could figure out why both of my Android devices weren’t showing the maps feature, or several other features on the left-upper-corner pull-down menu.

According to Louise Callagy, vice president of marketing for app developer VenueNext, the new version of the app released this week did have a known Android bug. In an email response Sunday night Callagy said, “we know we have a bug where Android gets confused and won’t return results from the network,” adding that rebooting the device might have fixed the problem; however, I did reboot both devices during the game and the problems were not corrected.

Callagy said the Levi’s network also had issues Sunday in getting location information from the beacons. “Our plan is to re-write the code [for the app] and solve this issue, releasing a new version before the Seahawks game on Thursday,” Callagy added in her email.

On the good-news side the replay function of the Levi’s Stadium app was more impressive than earlier versions, with highlights appearing in the app in mere seconds after the original play had concluded. After the Niners’ first TD pass of the day, I was able to view the highlight of the Colin Kaepernick-to-Anquan Boldin pass just after the extra point had been kicked.

I was also able to see the red light/green light system for restroom wait times that drew so much attention when it was talked about earlier this year. However, in real-life practice it’s doubtful anyone thinks of looking at the app when it’s time to go. (It’s also quite likely that while you are looking at the app for a short restroom line, a natural break in action will occur and restroom lines will predictably lengthen everywhere.) I found a quick trick for Levi’s attendees that might pay off in the future: If the restroom you’re aiming toward has a long line, walk a small bit farther to find its back door — where there is often no line at all.

New version of app, with clearer icons on main screen

New version of app, with clearer icons on main screen

I messed up later in the game, however, in thinking that it would just be easier to find a concession stand than to use the app’s express window ordering function. At least the 10 minutes I spent in line behind three women who were apparently ordering for their entire row (five hotdogs, six orders of fries, two orders of wings, two beers and one large ice water) gave me time to conduct a couple more Wi-Fi speedtests. Next time, I’m using the food-ordering features on the app.

I also made great use of the app’s ability to let fans watch live game action (I chose the feed from the main video screens in the stadium). Since I had to leave early I was on the first VTA train when I saw the game-winning TD run courtesy of the app’s live action broadcast. The live video, incidentally, kept playing seamlessly over the AT&T 4G LTE network as I sped away from the stadium, allowing me to watch the final game-sealing sack as I beat most of the traffic home.

VTA trains a smooth ride, once you figure out how to get on

I also had another smooth ride to and from the stadium using the VTA light rail trains from Mountain View — once I was on the train it took just a little over 30 stress-free minutes both coming and going. Getting on the trains, however, is a process that could still use some work. The Mountain View station, which is logistically hampered by having to share space with the Caltrain tracks and station, has very little signage on game day, and has a lot of confusing temporary gates to try to flow foot traffic toward the ticket-verification checkers.

Packed VTA train en route to Levi's Stadium

Packed VTA train en route to Levi’s Stadium

Once I figured out the maze and was guided across the Caltrain tracks I was directed to one of two waiting trains — but then a VTA staffer looked into the train and told people there were also express buses that wouldn’t stop on the way to Levi’s (unlike the trains, which stop at numerous stations en route). The quizzical advice — nobody said if it was any faster to take the buses — had many people wondering what they were supposed to do, causing a delay in closing the train doors as people made up their minds without any more information.

Once we arrived at the stadium, on the exit platform there was no person or sign directing fans in the proper direction. Good thing for the many newbies on the train (the train 2 hours before kickoff was packed) several of us were veterans and directed everyone down the proper ramp. For the return trip the Mountain View line suffered from similar lack of information and signing — and after one train passed the station with signs that said “Not in Service” we got on a second train that also said “Not in service” but whose doors opened anyway and one person in a yellow vest told everyone, “get inside.”

Overall impressions: Levi’s experience and technology still a work in progress

While I continue to be impressed by the network and app performance at Levi’s Stadium, I also felt several times on Sunday like the technology, the stadium and the entire fan experience is still a work in progress — perhaps something to be expected for a venue in its first year of events. But I have to wonder a bit about releasing a new version of the app in midseason, without apparently testing it enough to make sure it worked well on all devices that might want to use it.

I’m also still skeptical on how well the wayfinding feature will work in real world situations; though it sounds great to be able to get GPS-like directions to places inside the stadium, the reality of trying to walk around looking down at your phone on one of Levi’s Stadium crowded concourses is more likely to lead you into someone’s backside. Anyone with tales to tell of Levi’s Stadium technology experiences, please chime in below in the comments or send me an email to kaps at mobilesportsreport.com. I’d be especially interested to know if anyone else saw my app problems Sunday on Android phones. More Levi’s pictures below.

A NiNerd (no vest) helps fans outside the stadium.

A NiNerd (no vest) helps fans outside the stadium.

Kickoff view from Section 229. Thanks to the Niners for the free media access.

Kickoff view from Section 229. Thanks to the Niners for the free media access.

Niners fans get their phone cameras busy for kickoff ceremonies.

Niners fans get their phone cameras busy for kickoff ceremonies.

Scoreboard plug for the app.

Scoreboard plug for the app.

Scoreboard promo for the NiNerds (one in a series)

Scoreboard promo for the NiNerds (one in a series)

Second in the series. This one got laughs from the crowd.

Second in the series. This one got laughs from the crowd.

Probably the first time many fans heard the term "NiNerds"

Probably the first time many fans heard the term “NiNerds”

Nothing says geek like a bow tie

Nothing says geek like a bow tie

NFL’s CIO says teams need to share technology know-how

Michelle McKenna-Doyle, CIO, NFL

Michelle McKenna-Doyle, CIO, NFL

Editor’s note: the following interview with NFL CIO Michelle McKenna-Doyle was featured in our most recent long-form report, THE FOOTBALL ISSUE, which is available for free download. In addition to team-by-team capsules of technology deployments for all 32 NFL teams the issue also has several in-depth stadium technology profiles and an extensive look at the technology behind the San Francisco 49ers’ new Levi’s Stadium. Get your copy today!

In a league known for its intense rivalries, is it possible to get teams to work together and share information for the betterment of all? In the area of stadium technology, that task is on the to-do list for Michelle McKenna-Doyle, who is now in her third season as chief information officer for the National Football League.

In an interview with Mobile Sports Report, McKenna-Doyle outlined some of the league’s recent accomplishments in technology-related areas like instant replay and digital content, while also explaining how the league oversees stadium technology deployments. According to McKenna-Doyle, one of her office’s jobs is to act as a best-practices and lessons-learned clearinghouse, to better move the state of NFL stadium technology forward faster as a whole.

“One of our roles is helping teams help themselves” with technology deployment strategies, McKenna-Doyle said. “What we want is to provide a forum where clubs can share information with each other. If somebody’s done something and learned it doesn’t work, we can tell other clubs not to waste their time doing the same thing.”

The business use of technology

Focusing on the business uses of technology and not the 1s and 0s is somewhat of a natural fit for McKenna-Doyle, who spent 13 years at the Walt Disney Company in disciplines including finance and marketing before becoming a VP in IT for two years. During CIO stints at Centex Homes and Universal Orlando Resort, McKenna-Doyle said she focused on using technology to enhance the guest experience, a goal the NFL sought when it brought her aboard in September 2012.

Wi-Fi access point antennas visible on poles at CenturyLink Field, Seattle. Credit: Extreme Networks

Wi-Fi access point antennas visible on poles at CenturyLink Field, Seattle. Credit: Extreme Networks

“Part of my job is making sure our in-stadium experience for mobility meets the needs of our fans,” McKenna-Doyle said. While it is true that commissioner Roger Goodell said he wanted all NFL stadiums to have fan-facing Wi-Fi, and that the league does expect teams to meet a minimum set of connectivity standards, McKenna-Doyle said the NFL’s overall stadium-tech strategy is to be more of a guide than to dictate exactly which technologies or apps teams should deploy.

“People really are fans of their own team first, and we encourage clubs to have that engagement, and help them interact with fans,” McKenna-Doyle said. “There are minimum standards and we do grade their [technology] experience, and report that back to the club. But they manage it. We are more of a guide.”

Putting out a plan for stadium Wi-Fi

In the area of Wi-Fi, for example, McKenna-Doyle said that last year the league put together “a really deep-dive spec” that laid out all the basics necessary for stadium Wi-Fi deployments. “That was so teams didn’t have to start at square one for design,” McKenna-Doyle said.

The league also helped move Wi-Fi deployments forward faster by signing a preferred-supplier deal with Extreme Networks, under which teams get a discount on pricing in exchange for the league-wide sponsorship exposure. (Editor’s note: This week, the league announced that Extreme is now the official Wi-Fi technology supplier for the NFL.) Though teams are not required to use Extreme’s Wi-Fi gear, new Extreme-based Wi-Fi networks are in use this season at Seattle, Jacksonville, Tennessee, and Cincinnati, joining two previous Extreme installations in Philadelphia and New England.

“It’s a great option if teams choose Extreme, and it [the league deal] also creates a competitive environment for other suppliers like Cisco to step up,” McKenna-Doyle said.

Fans take pictures at Levi's Stadium. Credit: Paul Kapustka, MSR

Fans take pictures at Levi’s Stadium. Credit: Paul Kapustka, MSR

If necessary, the league can also play Wi-Fi matchmaker, as McKenna-Doyle said it did in bringing partner Verizon into Seattle, where the carrier deployed a Wi-Fi network at CenturyLink Field that is live this season.

At the writing of this report, 10 of the NFL’s 32 teams still had no fan-facing Wi-Fi services at their stadiums, a list that includes Green Bay, Baltimore, Cleveland, Buffalo, Houston, Oakland, San Diego, Washington, Minnesota and St. Louis. While McKenna-Doyle said that there are “a few more Wi-Fi announcements coming,” she also noted that some teams with lease uncertanties still don’t have firm plans to deploy Wi-Fi.

Help on the app side with partner YinzCam

McKenna-Doyle said the league also provides assistance in stadium application development via YinzCam Inc., a Pittsburgh-based company that has developed mobile apps for a number of pro sports teams. The NFL, which was an investor in YinzCam, uses the company’s technology in its league mobile apps, and McKenna-Doyle said YinzCam is also developing an app for the upcoming Super Bowl XLIX that will be “like nothing we’ve ever had before.”

Though teams are not required to use YinzCam – the San Francisco 49ers, for example, turned to newcomer VenueNext to develop their Levi’s Stadium app – McKenna-Doyle said that YinzCam may be a fit for other teams.

“For quality and speed to market, [YinzCam’s] product is very strong,” McKenna-Doyle said.

It’s about the fans, not the technology

Following a summer that saw her office overseeing the new method for on-field official review of replay calls – “which meant building a new system for 32 teams, 31 stadiums, and training all the officials” – as well as the launch of the NFL Now digital content site, McKenna-Doyle is back spending time with teams, counseling them on technology deployment resource management – “what to prioritize, and what to put on the back burner,” she said.

That includes technology ideas that might not work operationally, like a food-ordering service that isn’t staffed properly. For the in-seat food ordering feature at Levi’s Stadium, for instance, the 49ers said they did extensive research, hiring and training to make sure they had enough feet on the ground – runners carrying orders – to make the tech-inspired feature work.

If teams don’t do the human engineering behind the scenes, McKenna-Doyle said, the technology may not be that cool.

“We stress that it’s not about the technology, but about the fan experience,” McKenna-Doyle said. “It has to be operationally sound, and it has to be integrated with being at the game. If it’s not something that’s operationally sound, you might be better off not doing it.”

AT&T: Getting busy with multiple college football DAS deployments

In an interview with AT&T’s John Donovan earlier this year the company’s senior executive vice president told us that AT&T would continue to be aggressive in its deployment of stadium DAS systems. True to his word, here are announcements from no fewer than eight new top U.S. universities (and one that was announced earlier in the year) that got an AT&T DAS in time for this fall’s football season.

Included in the list of DAS deployments that AT&T either is leading or has joined another operator’s infrastructure are Baylor University, which has a whole new stadium and a new stadium Wi-Fi network as well; Big Ten schools Indiana University, Ohio State University, Michigan State University, the University of Minnesota and the University of Wisconsin (where AT&T also installed a new Wi-Fi network and some IPTV systems); the University of Missouri from the SEC; and Pac-12 schools the University of Washington as well as the University of California, an installation plan that we covered last year. AT&T also participated alongside Verizon in a unique joint DAS deployment at the University of Oregon, also announced earlier this year.

Why so much DAS? As we are finding out in the process of doing a lot of reporting for our upcoming Q4 Stadium Tech Report on college football stadium technology deployments, Wi-Fi deployments are still somewhat of a rarity, even at some of the biggest schools. As we’ve said before, bringing in a DAS deployment makes a lot of sense for schools since A) you can usually get the carrier to pay for most if not all of the cost of building the DAS; and B) a good DAS goes a long way toward eliminating the feared “no signal” problem that can still be found on many major college campus facilities.

How much have fans already been using the new networks? According to AT&T the new Mizzou DAS has done the biggest amount of traffic so far, with 290 gigabytes of traffic crossing the DAS system with its 150+ antennas at one game this season. Cal was close behind with an average of 253 GB per game so far in 2014, while up in Seattle at UDub the fans are generating an average of 190 GB per game. Remember, these stats represent ONLY AT&T traffic on the AT&T part of the DAS; since we still can’t convince Verizon to provide similar statistics we’ll just have to guess what the total-totals are.

Stay tuned for more information about college stadium deployments… look for our Q4 STR report in early December!

Stadium Tech Report — NFL stadium technology reports — NFC West

Editor’s note: The following team-by-team capsule reports of NFL stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE FOOTBALL ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

NFC WEST

Reporting by Chris Gallo

Arizona Cardinals
University of Phoenix Stadium
Seating Capacity: 65,000
Wi-Fi – Yes
DAS-Yes
Beaconing – No

As the site of the Super Bowl XLIX, University of Phoenix Stadium is in the midst of massive upgrades. This includes an $8 million dollar improvement for faster wireless and larger video boards. The stadium turned eight this summer and already has one Super Bowl under its belt. Look for more information about upgrades throughout the year before the big game on Feb. 1, 2015.

San Francisco 49ers
Levi’s Stadium
Seating Capacity: 68,500
Wi-Fi – Yes, 1,200 access points
DAS – Yes, 700 antennas
Beaconing – Yes

View from the Pepsi seating porch at the north end of Levi's Stadium

View from the Pepsi seating porch at the north end of Levi’s Stadium

There is a buzz around Levi’s Stadium entering this season. And for good reason. The brand-new venue boasts more than 1,200 Wi-Fi access points and 700 DAS antennas. Aruba Networks (Wi-Fi) and DAS Group Professionals are hoping to fulfill the 49ers’ desires to own the most-connected stadium in all of sports. An ambitious new team app, with replays and food ordering and delivery to all seats is also part of the technology offerings.

Early tests of the stadium network during the preseason and regular season opener were promising, with Wi-Fi performance at Super Bowl-surpassing levels. On the DAS side, strong cellular signals were reached, with a nearly full house of fans. The question for the network, like the team itself – can it keep performing at a high level during the full season?

Seattle Seahawks
CenturyLink Field
Seating Capacity: 72,000
Wi-Fi-Yes
DAS-Yes
Beaconing – No

Fans of the reigning Super Bowl Champions will have more to cheer for in coming years at CenturyLink Field. The question is, will the loudest stadium in the NFL stay that way if Seahawks fans are using their phones more often, now that Verizon has installed stadium-wide Wi-Fi using Extreme Networks equipment?

St. Louis Rams
Edward Jones Dome
Seating Capacity: 66,000
Wi-Fi – No
DAS-Yes
Beaconing – No

After a proposed $700 million dollar upgrade was rejected, the St. Louis Rams are still seeking to improve the Edward Jones Dome. The good news for fans is that for this season a Mobilitie neutral-host DAS should significantly improve cellular communications not just in the stadium itself, but also in the adjacent convention center.

Stadium Tech Report — NFL stadium technology reports — NFC East

Editor’s note: The following team-by-team capsule reports of NFL stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE FOOTBALL ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

NFC EAST

Reporting by Chris Gallo

Dallas Cowboys
AT&T Stadium
Seating Capacity: 105,121
Wi-Fi – Yes, 1,525 access points
DAS – Yes, 1,374 antennas
Beaconing – No

AT&T Fan Experience board with single message

AT&T Fan Experience board with single message

Everything is bigger in Texas – including connectivity. AT&T Stadium features 1,525 Wi-Fi access points and 1,374 DAS antennas. That’s enough cellular capacity to service the small suburb of McKinney, Texas. While watching Tony Romo target Dez Bryant, Cowboys fans will notice a new 130-foot LED display along the east platform. The AT&T Fan Experience board features 40 robotic panels that work in combination with other stadium displays to entertain fans all game along. And don’t forget the big TV hanging in the middle of the place!

New York Giants
MetLife Stadium
Seating Capacity: 82,500
Wi-Fi – Yes, 850 access points
DAS – Yes, over 600 antennas
Beaconing – No

The Super Bowl champions just three years ago, it appears their bunk mates’ play is rubbing off on the Giants. Like the cross-town Jets, the G-Men missed the playoffs for the second straight season last year. If it’s any consolation, the Giants still share one sports top venues in MetLife Stadium. AT&T and Verizon gave enough love and attention the stadium last year as host of Super Bowl XLVII. Over 600 DAS antennas, 850 Wi-Fi access points, Cisco StadiumVision with over 2,100 HD TVs around the concourse – that’s a recipe for a good time at a game, at least from a connectivity standpoint.

Philadelphia Eagles
Lincoln Financial Field
Seating Capacity: 69,176
Wi-Fi – Yes, 600+ access points
DAS-Yes
Beaconing – No

Lincoln Financial Field is one of the “greenest” stadiums in all of professional sports. And that’s not just because of the Eagles’ colors. All (100 percent) of the Eagles operations are powered by the sun and the wind. The stadium’s connectivity is something fans can get behind too. With over 600 Wi-Fi access points and a group of Extreme Networks’ “Wi-Fi coaches”, the Eagles are doing everything they can to make sure fans are connected at games.

Washington Redskins
FedEx Field
Seating Capacity: 85,000
Wi-Fi – Limited / club level only
DAS-Yes
Beaconing – No

A new coach, name controversy, and a $27 million dollar renovation underway at FedEx Field. It’s been an offseason full of distractions in the nation’s capital. The good news: The team just signed a deal with supplier Huawei to put Wi-Fi in the stadium, first in the club seats and then (hopefully) next year in the full seating bowl.

Stadium Tech Report — NFL stadium technology reports — NFC South

Editor’s note: The following team-by-team capsule reports of NFL stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE FOOTBALL ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

NFC SOUTH

Reporting by Chris Gallo

Atlanta Falcons
Georgia Dome
Seating Capacity: 71,280
Wi-Fi – Yes, approximately 500 access points
DAS-Yes
Beaconing – No

Last year’s 4-12 record came as a surprise to Falcons fans after three straight playoff seasons. With lots of talent on the field, the fans are looking forward to a rebound year. And they’ll get to follow the team with ease as the multi-venue Georgia Dome features 500 Wi-Fi access points from Cisco.

Carolina Panthers
Bank of America Stadium
Seating Capacity: 74,455
Wi-Fi – Yes, 645 access points
DAS-Yes
Beaconing – No

Bank of America Stadium receives a Wi-Fi boost from AT&T in 2014. Now with 645-plus Wi-Fi access points, Panthers fans should find it a little easier to share that photo of Cam Newton’s touchdown celebration. Will they be able to do so for another home playoff game?

New Orleans Saints
Mercedes-Benz Superdome
Seating Capacity: 76,468
Wi-Fi – Yes, 600+ access points
DAS-Yes
Beaconing – No

Remember the blackout from Super Bowl XLVII? How could you forget? The Superdome doesn’t. Good thing the versatile venue was prepared to keep fans connected with a robust DAS and more than 600 Cisco Wi-Fi access points. Saints fans will have plenty to share on game days with a high-powered offense back in 2014.

Tampa Bay Buccaneers
Raymond James Stadium
Seating Capacity: 65,890
Wi-Fi-Yes
DAS-Yes
Beaconing – No

After installing Wi-Fi in 2012 and releasing an updated team mobile app in 2013, Tampa Bay delayed plans to enhance the stadium’s video boards in the offseason. The reason? The organization wants to supersize the upgrades with larger screen sizes and video replay capability. Owned by the Tampa Bay Sports Authority, Raymond James Stadium has secured the 2017 College Football National Championship game. This means Bucs fans can expect the game day experience to continue to improve in the coming years.