Stadium Tech Report: Levi’s Stadium network lives up to hype, but team app still needs work

Levi's Stadium from Section 244. All photos: Paul Kapustka, Mobile Sports Report

Levi’s Stadium from Section 244. All photos: Paul Kapustka, Mobile Sports Report

At the very least San Francisco 49ers fans Sunday could take heart in the fact that the wireless network in Levi’s Stadium largely lived up to its advance billing, performing quite well even as the team on the field sputtered and failed to connect. In its first “real” test with an almost-full house on Sunday the Levi’s Wi-Fi and cellular networks seemed to work well throughout the game, delivering solid speed test results from almost every part of the new 68,500-seat facility, even as Colin Kaepernick and the rest of the 49ers were dealt a 34-0 preseason drubbing by Peyton Manning and the visiting Denver Broncos.

And just like the team, the Niners’ stadium technology lineup still has some weak spots that will hopefully be fixed before the regular season home opener on Sept. 14. Among the disappointments Sunday was a no-show by the highly heralded instant replay feature, the crown jewel of the new Levi’s Stadium app. We also experienced some location-connection problems with one of our devices, exposing what we consider a flaw in the Levi’s app, namely an over-reliance on location technologies to enable key parts of the app, like wayfinding and on-site video streaming.

Ticket scanner with Niners visor to block sun

Ticket scanner with Niners visor to block sun

Some other not-so-advanced technology flaws that could use fine-tuning include the volume level on the main stadium public-address and announcing system, which was so loud that it made it a struggle just to talk to the person next to you for long stretches of time. The ticket scanning machines also seemed to have issues working in the bright sunlight, a problem that found a low-tech fix when ticket personnel placed Niners’ visors around the tops of the machines to shade the scanning area. And many concession stands around the stadium were unable to serve guests or could only take cash because the staff operating the stands said they weren’t given access codes to the point-of-sale systems.

Overall, however, the first football game at Levi’s was a success on many levels, including the fantastic sight lines available from most seats and largely incident-free travel and parking operations, with noticed improvements especially on the VTA light rail front that struggled mightily during the stadium’s opening-event soccer game two weekends ago. Most fans also probably got a little weight loss from the no extra-charge sauna situation, thanks to the cloudless day and bright sun that bathed most of the seats in searing heat for long times after the 1 p.m. start.

Smooth start for early VTA riders

What follows here is a somewhat minute-by-minute account of my trip to the game, and my experience with the network and stadium operations on site.

Mtn View lot sign, not in operation at 9:30 a.m.

Mtn View lot sign, not in operation at 9:30 a.m.

Since I wasn’t given press access to the game, Mobile Sports Report attended like a regular fan, purchasing a single ticket through the NFL Ticket Exchange service on the 49ers’ web site. My plan to get to Levi’s from San Mateo was to drive to downtown Mountain View, park there and take VTA the rest of the way. (I didn’t take CalTrain mainly because I didn’t want to have to sync my return schedule with the CalTrain options going northbound on Sunday.)

Though I was somewhat incredulous about having to buy tickets online — VTA said that the ticket machines in Mountain View would be shut down Sunday to keep big lines from forming — upon further review the VTA app was slick and easy to operate and understand. After purchasing a ticket for $6.50 Saturday night I activated it Sunday, and showed it at the gate where they checked boarding passes. For people who didn’t have tickets there was a tent set up where they could buy a pre-loaded Clipper card for $10 good for a day’s worth of VTA riding. There was an abundance of VTA workers on hand, as well as a large and very obvious police presence. As a nice touch there was also a large bank of porta-potties, and behind the trains there were express buses waiting, according to one VTA employee, in case of crowd overloads.

“We learned some lessons from two weeks ago,” he said.

If there was a glitch in the VTA operations it was with the city of Mountain View — though a couple city lots were designated as places where fans could buy all-day parking passes, and there were clear signs to those lots, at 9:30 a.m. those lots were not yet staffed with anyone to pay; MSR found one sign leaning up against a post, waiting to be deployed. Fans could also park in the CalTrain lot for $5, payable via the CalTrain track podium ticket machines.

Fans transferring from CalTrain to VTA at Mtn View station

Fans transferring from CalTrain to VTA at Mtn View station

I boarded the first VTA train to leave for the stadium, along with many fans who had just gotten off CalTrain. The pleasant, air-conditioned trip took just 27 minutes, passing many Silicon Valley company headquarters and one neighborhood with “no parking here” patrols before stopping pretty much right at the Levi’s Stadium entrance. A few steps later I was in the parking lot, and took the first of many Wi-Fi speed tests and got a signal of 29 Mbps download and 23 Mbps upload, a good sign for network operations.

Looking for Wi-Fi, finding lots of it

DAS antenna in "Faithful Mile" area

DAS antenna in “Faithful Mile” area

Once inside the gates — and past the shaded scanners — I started speed testing in earnest, with the two devices I brought with me: A Motorola Droid 4 on Verizon, and a Samsung Galaxy Note 3 on AT&T. While waiting for the main stadium gates to open at 11 a.m. I got the weakest Wi-Fi signals of the day along the “Faithful Mile” area where promotional booths from sponsors kept early arrivers entertained. Wi-Fi on both devices out there only hit 2 to 3 Mbps on the download, while cell signals on both devices were in the 6-7 Mbps download range. Since I could see multiple DAS radios in the area but not any Wi-Fi access points I wasn’t too surprised; but it was an unusual area not to be blanketed with Wi-Fi, especially since there was good access a couple hundred yards away in the parking lots.

After finally entering the stadium proper, I ran into Niners president Paraag Marathe — who said he was “nervously excited,” and looked ready to start sweating in his suit and tie. “We’ve just got to make sure everything works today,” Marathe said, shaking my hand. Then I went up the escalator and saw the “Kezar pub,” an open-air bar filling the top area above the Intel gate. There, draft beers like Shock Top and Goose Island IPA were available for $11, and bottled beers available for $10.25.

As I started walking around the outside concourse I took my first speed test in the stadium and it blew the needle off the edge: 57.92 Mbps download, 41.00 Mbps upload.

A few minutes later on the inside concourse (where most of the concession stands are) I hit 27.85 Mbps/21.34 Mbps, still impressive. Then I tried to launch the app, and — problem. Apparently the device wasn’t connecting because it wouldn’t show my location on the wayfinding app. Luckily, right in front of me was Racquel, one of the “NiNerds,” the team’s new staff of technical experts who are there to help fans make the app work. But Racquel couldn’t solve my problem, even after we both tried turning on all location services, including Bluetooth.

Racquel the NiNerd

Racquel the NiNerd

“I can try to find another NiNerd who might know more about this device,” offered Racquel, who was visibly dismayed at her failure to help solve my problem. Instead, I moved on, hoping that the problem would solve itself later. But it didn’t.

Failure to locate… and other app problems

After downloading the Levi’s app to both devices over the weekend, I noticed that the first item on the app list of functions — Tickets — required me to “sign in” with my “Stadium Ticket Account,” something I didn’t have and didn’t know how to get. I did figure out how to enter my purchased seat location (which I could have used to order food to my seat, or for the express pick-up option), but I could never get the location feature to work on the Samsung device, which kept me from being able to see the live streaming TV option (I kept getting a message that said, “You must be at the stadium to play this video”). I was able to watch the live TV option on the Motorola device, after turing on location services. But for both devices — and, as it turns out, for everyone in the stadium — the final feature on the app, Game Center, where we were supposed to be able to see all the instant replays we could handle, remained labeled “coming soon.”

Finally sitting in my most excellent seat — section 244, row 3, seat 17 — I noticed that the Motorola device could no longer connect to Wi-Fi, even as the Samsung device was hitting marks in the 15-16 Mbps range. I started tweeting about the problem, and instead of a NiNerd coming to help me I got a personal visit from the Levi’s version of a Jedi Master, namely Dan Williams, the team’s vice president of technology. (Never underestimate the power of a complaining tweet!)

Niners VP of technology Dan Williams attempts to fix my Droid 4 Wi-Fi issues (while trying not to laugh at the fact that I actually have and use a Droid 4)

Niners VP of technology Dan Williams attempts to fix my Droid 4 Wi-Fi issues (while trying not to laugh at the fact that I actually have and use a Droid 4)

On my own, I had guessed that the Droid’s inability to connect came from its having only a 2.4 GHz Wi-Fi radio. If you’re not familiar with Wi-Fi networks, the 2.4 GHz band of unlicensed airwaves is what most first-generation Wi-Fi networks used; more recent devices are able to also use the 5 GHz band of unlicensed airwaves, which simply offer more channels and more bandwidth. The iPhone 5s, for example, mainly uses 5 GHz for Wi-Fi, as does my Samsung Note.

In scanning the available Wi-Fi networks, I had also noticed something else that I thought could be gumming up the Droid’s connection — a bunch of personal Wi-Fi hotspots in the immediate area, including several labeled as GoPro cameras. After curiously examining my Droid 4 — and its slide-out keyboard — Williams and a technician from Wi-Fi gear provider Aruba Networks concurred that my device was getting bogged down in the 2.4 GHz mess, and also wasn’t refreshing the available networks list, a device-specific problem.

Bottom line? Levi’s is no country for old phones.

Initial verdict: Wi-Fi and cellular is world class… but app needs work

After staying into the third quarter — and visiting another friend in section 109, where I got another hefty Wi-Fi speed test (24.42/25.39 Mbps) — I followed the lead of many fans and took an early leave of Levi’s, which meant no lines at the VTA trains and just a couple short delays due to track congestion that stretched the return train trip to 40 minutes. Overall, my travel to and from the stadium from San Mateo took just over an hour each way, a happy stat to report.

My initial verdict is that the Wi-Fi and DAS (cellular) networks delivered as promised, with solid speeds all around the stadium every time I checked. It’s no small accomplishment just to deliver such world-class service to such a crowded space, especially in the middle of Silicon Valley. True to its roots, the crowd Sunday was device-happy, with many iPads and GoPros being carried around as video cameras, in addition to all the phones that were in constant use. It’s a tribute to Williams and his staff, as well as the technology suppliers like Aruba, Brocade, Comcast (backbone bandwidth supplier) and DAS Group Professionals, who built the distributed antenna system (DAS) which brings advanced cellular connectivity inside the gates, to have built a solid network that worked well on its first big test.

The team app, however, did not even come close to living up to its advanced billing. To equal the network I think the app needs more advance instructions, especially on the ticketing/registration options as well as on the location services needed to make everything work. And until we see the multiple-camera angle live replays in action, to me the app is an incomplete project. The good news is, the Niners and their technology teams have several weeks to make improvements, including another preseason game Aug. 24 against the San Diego Chargers.

It’d also be helpful for the team to reach out a bit more to the VTA and players like the City of Mountain View, since the VTA site maps and Mountain View’s parking maps are far from what you would call “advanced design.” I think it’s up to the Niners to help pay for improvements to the city and transportation entities’ technology offerings, simply because of the burden placed on those operators by the fans going to Niners’ games. At the very least, more links from football to getting-there operations seems in order, instead of trusting that all parts of the operation will work in sync.

VTA lines going home

VTA lines going home

Stadium Tech Report: Niners President Marathe confident that Levi’s Stadium network, apps will deliver as promised

Niners president Paraag Marathe (center) at Intersport Activation Summit panel.

Niners president Paraag Marathe (center) at Intersport Activation Summit panel.

So, Paraag Marathe — will the network at Levi’s Stadium live up to its considerable pre-launch billing and be ready to go when the stadium opens later this year?

“It better work, since we’ve been talking about it,” said Marathe Friday, during a panel discussion at the Intersport Activation Summit presented by SportsBusiness Journal/Daily in San Francisco. “We better be right.”

Even though the short history of in-stadium networks suggests that any new endeavor be launched with words of caution, Marathe and the San Francisco 49ers are instead confident — very confident — that their new stadium will launch with a network second to none, and have game-changing services like food and beverage delivery to seats and on-demand instant replay that will redefine the game-day experience.

Paraag Marathe, president, San Francisco 49ers

Paraag Marathe, president, San Francisco 49ers

In both his panel discussion at the Ritz-Carlton hotel and in an additional interview afterward, Marathe provided some additional details about plans the Niners have talked about previously for the technology features at the new stadium, which is located in Santa Clara, Calif., smack dab in the middle of Silicon Valley. Though Marathe said the stadium’s location — quite literally next door to several high-tech company campuses — made technology “part of the DNA,” he stressed Friday that the Niners are seeking to use technology to improve the fan experience, and not just to have cool stuff.

“It’s not technology for technology’s sake,” Marathe said. “It’s to enhance being at the game.”

But he did add that the stadium’s Wi-Fi network will be the base for much of the innovation.

Wi-Fi is ‘the master key’

An under-the-seat access point. Credit: Aruba Networks

An under-the-seat access point. Credit: Aruba Networks

The Wi-Fi network, which Marathe said “will absolutely be working” when the park opens, is “the master key that unlocks everything,” he said. Currently being built with Wi-Fi access point gear from Aruba Networks and back-end network equipment from Brocade Networks, the Levi’s Stadium Wi-Fi network will also have twin 10-Gigabit broadband pipes provided by Comcast to provide what Marathe said will be throughput “30 times more than any other stadium.”

Marathe said the Wi-Fi network is being built with what he calls a “spider web” of access points, though neither the Niners nor Aruba have yet said just how many access points will be used to create the network. There will also be a neutral-host cellular DAS at the stadium, built by DAS Group Professionals (DGP). Already, DGP has signed up the “big four” carriers of AT&T, Verizon Wireless, Sprint and T-Mobile, to use the DAS at the stadium.

What will the networks be used for? Marathe outlined four main points of technology innovation during his talk, including high-definition, on-demand replays via the new Niners stadium app; in-seat delivery of food and beverages to every seat; way-finding features to perform tasks like locating friends, finding parking spots, and to tell which bathroom lines are shortest; and paperless tickets, based on RFID and near-field communication to fans’ devices. Of the four, the replay idea and the food-delivery service stand out as massive technical and industrial challenges.

Promised: Better replays than those on TV

If there is one promise that has many in the stadium technology industry shaking their heads, it’s Marathe’s pledge of Levi’s being able to deliver “better replays than what the coaches are seeing,” since team coaches only get to see replays provided by the network broadcasts. The Niners, Marathe said, will have “a massive [internal] production crew” working on the replay feature, since replays not only need to be picked out of the video stream, they also need to be coded to work over the Internet and to be delivered to handsets. Though Marathe admitted that the video quality may dip a bit below true HD if a lot of fans try to watch replays at once, he told the conference crowd that the Niners’ stadium app is going to deliver “HD, slo-mo [replays] within seconds after a big play.”

While other stadiums, like Barclays Center in the NBA, use technologies like Cisco’s StadiumVision Mobile to deliver separate “channels” of live video and replays, Marathe said the Niners’ app will allow fans to choose their own replays and when they want to watch them. “If you have a [replay] channel, you’re subject to whatever is on that channel,” Marathe said.

The food-delivery feature, Marathe said, is more than putting a menu in an app — “it’s an immense industrial engineering exercise,” he said, to figure out things like how many runners are needed and when and how food needs to be prepared. In addition to food delivery — an option he said will be available to every seat in the 68,500-seat stadium — the Niners will also have “express pickup” lanes for digitally placed orders at concession stands, an idea that Marathe said helps eliminate or significantly reduce two of the three things that make concession interactions a time-consuming act.

“There’s decision time, transaction time, and preparation time,” Marathe said. “If you can eliminate two of three variables, that’s a few more minutes fans have to watch the game.” Waiting until fans show up at a stand to prepare the food will help keep the order fresh, he added.

Wayfinding, paperless tickets and the 9-Nerds

If there’s one idea that’s already gotten a lot of press, it’s the plan to have wayfinding technology assist features like the one that will let fans know how long the bathroom lines are. Marathe said the idea was to make it simple — “red light, yellow light, green light” — to let fans know that if they have to go, it might be faster to try the bathroom one section over.

“We’re really just trying to be smart,” said Marathe. Other wayfinding apps might include a parking-spot locator, or a friend-finder feature.

The fourth area where Marathe wants Levi’s to innovate in is paperless ticketing, which he said wouldn’t be 100 percent this year but it will eventually get there. A future scenario described by Marathe might use RFID or near-field communications to let fans simply walk through a gate without having to show a ticket or even a bar code to be scanned. Some ski areas, like Aspen and Vail in Colorado, already use such technology to let skiers get on lifts without having to show anyone their RFID-equipped lift tickets.

“The idea is to have greeters who can actually greet you” when you walk in, and perhaps extend a personal offer for discount goods purchases or seat upgrades, Marathe said. “It’s a more human interaction,” fueled by technology.

Wi-Fi coach in the stands at Gillette Stadium. Credit: Extreme Networks

Wi-Fi coach in the stands at Gillette Stadium. Credit: Extreme Networks

Finally, to help fans figure out how to use the new network and apps, Marathe confirmed plans previously reported by Mobile Sports Report to hire a crew of “network coaches” to roam the stands. According to Marathe the coaches will be called “9 Nerds” (say it quickly) and will likely be college students, dressed in what Marathe called “Poindexter outfits.” The Niners are looking to hire 150 such network helpers, which would be the largest such crew we’ve heard of in the stadium networking marketplace.

“They’ll stand out,” Marathe promised.

Lots of network use — and a team ready for its launch

With all the hype about the network, Marathe expects that Levi’s Stadium wireless usage will far eclipse that at other stadiums, where often far fewer than half of the fans in attendance actually ever use things like Wi-Fi or stadium apps.

“Forget 10 percent [fan network use], we’re going to see something higher,” Marathe said. Even people who don’t have digital devices, he said, will probably borrow one “just to bring it to Levi’s to test it out.”

When asked why his team was so confident — in an industry where under-promising seems to be a sensible way to go — Marathe said that both the Silicon Valley heritage and the greenfield nature of the building gives the Niners and Levi’s a technological edge.

“Five years ago, we put together a kind of think tank with VCs and design people, and thought about what would be useful [at a new stadium], well before we ever put a shovel in the ground,” Marathe said. And even though the Niners’ CTO left the team earlier this year, Marathe is confident that his crew of 25 engineers (which he said also still gets some consulting help from the departed CTO, Kunal Malik) will deliver the network and apps as promised.

Having advanced technology in the new stadium, Marathe said, “was our mandate — the DNA of the building is all these tech companies that are around us. It’s who we are.”

https://duwit.ukdw.ac.id/document/pengadaan/slot777/

https://mtsnupakis.sch.id/wp-content/zeusslot/

https://insankamilsidoarjo.sch.id/wp-content/slot-zeus/

https://smpbhayangkari1sby.sch.id/wp-content/slot-zeus/

https://alhikamsurabaya.sch.id/wp-content/slot-thailand/

https://mtsnupakis.sch.id/wp-content/bonus-new-member/

https://smptagsby.sch.id/wp-content/slot-bet-200/

https://lookahindonesia.com/wp-content/bonus-new-member/

https://ponpesalkhairattanjungselor.sch.id/wp-content/mahjong-slot/

https://mtsnupakis.sch.id/wp-content/slot777/

https://sdlabum.sch.id/wp-content/slot777/

https://sdlabumblitar.sch.id/wp-content/bonus-new-member/

https://sdlabumblitar.sch.id/wp-content/spaceman/

https://paudlabumblitar.sch.id/wp-content/spaceman/