Stadium Tech Report: Network finishes season strong at Niners’ Levi’s Stadium

Arriving at Levi's Stadium for last 2014 season game

Arriving at Levi’s Stadium for last 2014 season game

While the football season didn’t turn out like 49ers fans wanted, the wireless network at the team’s new Levi’s Stadium closed out the year with strong performances to complete a largely glitch-free stretch of events at what is one of the world’s most technologically advanced stadiums.

With more than 2 Terabytes of data used by fans at each of the last two home games for the San Francisco 49ers, the Wi-Fi and DAS networks at Levi’s Stadium closed out a season of superb connectivity that eventually allowed the team to not just offer in-seat food and beverage delivery, but also ordering and delivery of merchandise like hats and T-shirts, an option that was available for the Dec. 20 game against the San Diego Chargers and the Dec. 28 closer vs. the Arizona Cardinals.

According to the Levi’s Stadium network crew, the Wi-Fi network carried 2.34 TB of data for the Chargers game and another 2.11 TB for the Cardinals game, with 20,096 fans using the network on Dec. 20 and 20,164 on Wi-Fi on Dec. 28. Peak concurrent user numbers were 13,700 for the Chargers game, and 14,400 for the season closer.

All season long, our speed tests in various parts of the stadium showed strong signals for both the Wi-Fi as well as the distrbuted antenna system (DAS) enhanced cellular network. At the final game it was no different; we found Wi-Fi download speeds of 16 Mbps on the rooftop deck, 25 Mbps in a suite and a scorching 39 Mbps in the Levi’s 501 Club seats (no doubt in part because there was a Wi-Fi antenna under the seat next to us).

Both Verizon and AT&T 4G LTE services also worked well, consistently scoring download speeds in the 4-6 Mbps range in most places and much higher in others. In short, we didn’t find any flaws in the network coverage in five games of walking all around the stadium, testing everywhere we went.

CalTrain to VTA a smooth ride

Caltrain crown en route to Arizona game

Caltrain crown en route to Arizona game

At the final game, Mobile Sports Report (me) tested out the full public-transit method of getting to the game, starting from San Mateo on CalTrain at 10:51 a.m. The parking lot at the station was almost completely empty, and free since it was Sunday; it’s possible that crowds were lighter since the Niners had been eliminated from postseason play, but nevertheless the ride to Mountain View went without hitch, a good sign for next year when many fans in town for Super Bowl 50 will no doubt be using CalTrain to get from San Francisco to Levi’s.

At the Mountain View CalTrain/VTA station operations were at their best I’ve seen, with more neon-vested VTA helpers offering clear instructions on why you might want to take an express bus instead of the light rail. Insider tip: If the express bus is available, take it, because in our testing it arrived at Levi’s in about half the time as the train trip (~20 minutes as opposed to almost 40 minutes for the light rail option).

Express bus option at Mountain View

Express bus option at Mountain View

The only thing that still remains to be ironed out is the fare confusion in switching from CalTrain to VTA, which are two different operators. On CalTrain there was advertising for a $6 “combo ticket” that would let you ride VTA and could be purchased at the same time you bought your CalTrain pass. But an online single-day ticket purchased via the VTA app was only $4.50, so it’s not clear why you would buy the CalTrain pass. Especially for the Super Bowl, it’d help fans if there was one price and one place to buy a single “Get to Levi’s” public-transit ticket.

Food order arrives as promised

Another thing I tried at the season closer was the in-seat food ordering feature on the Levi’s Stadium app. Sitting in the Levi’s Club section seats on the third level, I consulted the app to order a cold beer and a warm pretzel, which the app said could be delivered in 10 minutes.

Food runner bringing me my cold beer and warm pretzel

Food runner bringing me my cold beer and warm pretzel

After entering credit-card information into the app and hitting the order button the app updated itself with timely notices about the order being prepared, and that it was on its way. I found that information to be very assuring, a sign that things were indeed happening; there was even a big number associated with my order that appeared, apparently to make it easier for the food runner to confirm the order.

The order arrived exactly in 10 minutes’ time, as predicted by the app — it also arrived in a lot of extra packaging, a separate plastic bag for the steel bottle of beer and a paper sack holding a cellophane wrapper-encircled pretzel. Since there is no way to add a gratuity in the app, I gave the runner a cash tip, which seemed appropriate even though there is a $5 charge added to the order cost for the delivery service. I have to admit it felt a little weird to have someone bring me my food and drink but in the time it took to order and deliver I sat in my seat and watched the Niners’ game-winning TD drive so it’s clearly a fan-friendly option.

Video replays work well, for small amount of viewers

Another part of the Levi’s Stadium technology that was at peak performance by year’s end was the app’s instant replay feature. Though it started slowly and had some hiccups early on, by the final game instant replays were appearing in the app even before the next play had concluded (see our feature on how the VenueNext team gets the replays to the app so quickly).

While it’s an impressive addition to the in-game experience, the replays are a feature that only a small amount of fans are watching. According to the team network stats there were only 1,253 unique users watching replays on Dec. 20, and 1,019 during the Dec. 28 game. Total replays viewed for the Chargers game were 6,285, while 4.310 replays were watched during the season closer.

Why aren’t the replays catching on? Our main guess is that the Levi’s Stadium big screens are so clear and so quick to show replays (they also show live action as it’s happening), fans don’t find it necessary to use their phones to watch replays. It’s also possible that many fans in the stadium who are using the network aren’t using the Levi’s Stadium app. Indeed, according to the team network stats, the team app hasn’t yet cracked the top-four apps being used at any of the games this season; for the Dec. 20 game the top apps being used on the network were Amazon cloud drive, Facebook, Google APIs (probably Gmail) and Apple; for Dec. 28 the list was Amazon, Google, Facebook, then Apple.

We’ll try to get some season-long stats to share for both the network and the app features, but our quick conclusion after five live-game visits to Levi’s Stadium this year is that the wireless network and the app both pretty much lived up to their pre-season billing and hype, delivering a wireless game-day experience that is the standard other large public facilities will be measured against, going forward. More photos from our last visit below.

The Microsoft Surface/sideline Wi-Fi unit

The Microsoft Surface/sideline Wi-Fi unit

close-up of cable connection

close-up of cable connection

Niners' Flickr promotion on scoreboard -- very popular

Niners’ Flickr promotion on scoreboard — very popular

Sideline Surface tablets for Niners players and coaches

Sideline Surface tablets for Niners players and coaches

Colin Kaepernick exchanges his radio helmet for his flat-brimmed hat after throwing a TD pass

Colin Kaepernick exchanges his radio helmet for his flat-brimmed hat after throwing a TD pass

View from the Levi's skydeck out over Santa Clara

View from the Levi’s skydeck out over Santa Clara

If you throw a rooftop party, the cheerleaders might visit

If you throw a rooftop party, the cheerleaders might visit

View from the Levi's 501 Club section seats

View from the Levi’s 501 Club section seats

Wi-Fin antenna right under the seat next to me (probably why my speedtest was 40+ Mbps)

Wi-Fin antenna right under the seat next to me (probably why my speedtest was 40+ Mbps)

In-stadium signing help to get fans to light rail

In-stadium signing help to get fans to light rail

End of game view from skydeck

End of game view from skydeck

A final toast to the season at the BNY Club

A final toast to the season at the BNY Club

VTA train line. Only took 15 minutes from here to get on bus.

VTA train line. Only took 15 minutes from here to get on bus.

Caltrain platform at Mountain View. Extra trains helped make ride home easy

Caltrain platform at Mountain View. Extra trains helped make ride home easy

Niners add in-seat merchandise delivery, transit info to Levi’s Stadium app

Screen shot of new merchandise ordering feature in Levi's Stadium app. Credit: VenueNext

Screen shot of new merchandise ordering feature in Levi’s Stadium app. Credit: VenueNext

As previously reported by Mobile Sports Report, the San Francisco 49ers have added in-seat merchandise ordering and public transportation information to the Levi’s Stadium app, ahead of Saturday night’s game between the Niners and the San Diego Chargers.

While the new features were hinted at during a recent technology summit at the stadium, application developer VenueNext made the upgrades official today. Here are the official new features the app will have by Saturday:

— Now Levi’s Stadium app users can order jerseys, novelties and other 49ers apparel to their seat, anywhere in the stadium, paying with credit card or Apple Pay.
— Faithful49 loyalists can redeem yards to purchase food, beverage and merchandise right in the app.
— Users can also get up-to-the-minute transit information for their ride home with TransitScreen (which includes every possible mode of public transport in real time, viewable on one screen)

Photo of directions function in Levi's Stadium app. Credit: MSR

Photo of directions function in Levi’s Stadium app. Credit: MSR

Fans should upgrade their Levi’s Stadium app before coming to the next game, since only the latest version of the app will support the new features. According to the VenueNext press release, the Levi’s app also offers in-stadium access to the NFL Network’s RedZone channel, something which we hadn’t seen in several trips to Levi’s this season.

We’re interested in hearing from any fans who are at the next games at Levi’s about whether or not the transit feature is helpful; while we think it could be a big timesaver (so far at all our visits we regularly see people getting off the light rail train wondering where to go next) we wonder if enough people are aware of all the functionality in the app. Even Niners CEO Jed York has been somewhat surprised at the light takeup of things like the app’s ability to show multiple camera-angle replays.

Stadium Tech Report: Levi’s Stadium network lives up to hype, but team app still needs work

Levi's Stadium from Section 244. All photos: Paul Kapustka, Mobile Sports Report

Levi’s Stadium from Section 244. All photos: Paul Kapustka, Mobile Sports Report

At the very least San Francisco 49ers fans Sunday could take heart in the fact that the wireless network in Levi’s Stadium largely lived up to its advance billing, performing quite well even as the team on the field sputtered and failed to connect. In its first “real” test with an almost-full house on Sunday the Levi’s Wi-Fi and cellular networks seemed to work well throughout the game, delivering solid speed test results from almost every part of the new 68,500-seat facility, even as Colin Kaepernick and the rest of the 49ers were dealt a 34-0 preseason drubbing by Peyton Manning and the visiting Denver Broncos.

And just like the team, the Niners’ stadium technology lineup still has some weak spots that will hopefully be fixed before the regular season home opener on Sept. 14. Among the disappointments Sunday was a no-show by the highly heralded instant replay feature, the crown jewel of the new Levi’s Stadium app. We also experienced some location-connection problems with one of our devices, exposing what we consider a flaw in the Levi’s app, namely an over-reliance on location technologies to enable key parts of the app, like wayfinding and on-site video streaming.

Ticket scanner with Niners visor to block sun

Ticket scanner with Niners visor to block sun

Some other not-so-advanced technology flaws that could use fine-tuning include the volume level on the main stadium public-address and announcing system, which was so loud that it made it a struggle just to talk to the person next to you for long stretches of time. The ticket scanning machines also seemed to have issues working in the bright sunlight, a problem that found a low-tech fix when ticket personnel placed Niners’ visors around the tops of the machines to shade the scanning area. And many concession stands around the stadium were unable to serve guests or could only take cash because the staff operating the stands said they weren’t given access codes to the point-of-sale systems.

Overall, however, the first football game at Levi’s was a success on many levels, including the fantastic sight lines available from most seats and largely incident-free travel and parking operations, with noticed improvements especially on the VTA light rail front that struggled mightily during the stadium’s opening-event soccer game two weekends ago. Most fans also probably got a little weight loss from the no extra-charge sauna situation, thanks to the cloudless day and bright sun that bathed most of the seats in searing heat for long times after the 1 p.m. start.

Smooth start for early VTA riders

What follows here is a somewhat minute-by-minute account of my trip to the game, and my experience with the network and stadium operations on site.

Mtn View lot sign, not in operation at 9:30 a.m.

Mtn View lot sign, not in operation at 9:30 a.m.

Since I wasn’t given press access to the game, Mobile Sports Report attended like a regular fan, purchasing a single ticket through the NFL Ticket Exchange service on the 49ers’ web site. My plan to get to Levi’s from San Mateo was to drive to downtown Mountain View, park there and take VTA the rest of the way. (I didn’t take CalTrain mainly because I didn’t want to have to sync my return schedule with the CalTrain options going northbound on Sunday.)

Though I was somewhat incredulous about having to buy tickets online — VTA said that the ticket machines in Mountain View would be shut down Sunday to keep big lines from forming — upon further review the VTA app was slick and easy to operate and understand. After purchasing a ticket for $6.50 Saturday night I activated it Sunday, and showed it at the gate where they checked boarding passes. For people who didn’t have tickets there was a tent set up where they could buy a pre-loaded Clipper card for $10 good for a day’s worth of VTA riding. There was an abundance of VTA workers on hand, as well as a large and very obvious police presence. As a nice touch there was also a large bank of porta-potties, and behind the trains there were express buses waiting, according to one VTA employee, in case of crowd overloads.

“We learned some lessons from two weeks ago,” he said.

If there was a glitch in the VTA operations it was with the city of Mountain View — though a couple city lots were designated as places where fans could buy all-day parking passes, and there were clear signs to those lots, at 9:30 a.m. those lots were not yet staffed with anyone to pay; MSR found one sign leaning up against a post, waiting to be deployed. Fans could also park in the CalTrain lot for $5, payable via the CalTrain track podium ticket machines.

Fans transferring from CalTrain to VTA at Mtn View station

Fans transferring from CalTrain to VTA at Mtn View station

I boarded the first VTA train to leave for the stadium, along with many fans who had just gotten off CalTrain. The pleasant, air-conditioned trip took just 27 minutes, passing many Silicon Valley company headquarters and one neighborhood with “no parking here” patrols before stopping pretty much right at the Levi’s Stadium entrance. A few steps later I was in the parking lot, and took the first of many Wi-Fi speed tests and got a signal of 29 Mbps download and 23 Mbps upload, a good sign for network operations.

Looking for Wi-Fi, finding lots of it

DAS antenna in "Faithful Mile" area

DAS antenna in “Faithful Mile” area

Once inside the gates — and past the shaded scanners — I started speed testing in earnest, with the two devices I brought with me: A Motorola Droid 4 on Verizon, and a Samsung Galaxy Note 3 on AT&T. While waiting for the main stadium gates to open at 11 a.m. I got the weakest Wi-Fi signals of the day along the “Faithful Mile” area where promotional booths from sponsors kept early arrivers entertained. Wi-Fi on both devices out there only hit 2 to 3 Mbps on the download, while cell signals on both devices were in the 6-7 Mbps download range. Since I could see multiple DAS radios in the area but not any Wi-Fi access points I wasn’t too surprised; but it was an unusual area not to be blanketed with Wi-Fi, especially since there was good access a couple hundred yards away in the parking lots.

After finally entering the stadium proper, I ran into Niners president Paraag Marathe — who said he was “nervously excited,” and looked ready to start sweating in his suit and tie. “We’ve just got to make sure everything works today,” Marathe said, shaking my hand. Then I went up the escalator and saw the “Kezar pub,” an open-air bar filling the top area above the Intel gate. There, draft beers like Shock Top and Goose Island IPA were available for $11, and bottled beers available for $10.25.

As I started walking around the outside concourse I took my first speed test in the stadium and it blew the needle off the edge: 57.92 Mbps download, 41.00 Mbps upload.

A few minutes later on the inside concourse (where most of the concession stands are) I hit 27.85 Mbps/21.34 Mbps, still impressive. Then I tried to launch the app, and — problem. Apparently the device wasn’t connecting because it wouldn’t show my location on the wayfinding app. Luckily, right in front of me was Racquel, one of the “NiNerds,” the team’s new staff of technical experts who are there to help fans make the app work. But Racquel couldn’t solve my problem, even after we both tried turning on all location services, including Bluetooth.

Racquel the NiNerd

Racquel the NiNerd

“I can try to find another NiNerd who might know more about this device,” offered Racquel, who was visibly dismayed at her failure to help solve my problem. Instead, I moved on, hoping that the problem would solve itself later. But it didn’t.

Failure to locate… and other app problems

After downloading the Levi’s app to both devices over the weekend, I noticed that the first item on the app list of functions — Tickets — required me to “sign in” with my “Stadium Ticket Account,” something I didn’t have and didn’t know how to get. I did figure out how to enter my purchased seat location (which I could have used to order food to my seat, or for the express pick-up option), but I could never get the location feature to work on the Samsung device, which kept me from being able to see the live streaming TV option (I kept getting a message that said, “You must be at the stadium to play this video”). I was able to watch the live TV option on the Motorola device, after turing on location services. But for both devices — and, as it turns out, for everyone in the stadium — the final feature on the app, Game Center, where we were supposed to be able to see all the instant replays we could handle, remained labeled “coming soon.”

Finally sitting in my most excellent seat — section 244, row 3, seat 17 — I noticed that the Motorola device could no longer connect to Wi-Fi, even as the Samsung device was hitting marks in the 15-16 Mbps range. I started tweeting about the problem, and instead of a NiNerd coming to help me I got a personal visit from the Levi’s version of a Jedi Master, namely Dan Williams, the team’s vice president of technology. (Never underestimate the power of a complaining tweet!)

Niners VP of technology Dan Williams attempts to fix my Droid 4 Wi-Fi issues (while trying not to laugh at the fact that I actually have and use a Droid 4)

Niners VP of technology Dan Williams attempts to fix my Droid 4 Wi-Fi issues (while trying not to laugh at the fact that I actually have and use a Droid 4)

On my own, I had guessed that the Droid’s inability to connect came from its having only a 2.4 GHz Wi-Fi radio. If you’re not familiar with Wi-Fi networks, the 2.4 GHz band of unlicensed airwaves is what most first-generation Wi-Fi networks used; more recent devices are able to also use the 5 GHz band of unlicensed airwaves, which simply offer more channels and more bandwidth. The iPhone 5s, for example, mainly uses 5 GHz for Wi-Fi, as does my Samsung Note.

In scanning the available Wi-Fi networks, I had also noticed something else that I thought could be gumming up the Droid’s connection — a bunch of personal Wi-Fi hotspots in the immediate area, including several labeled as GoPro cameras. After curiously examining my Droid 4 — and its slide-out keyboard — Williams and a technician from Wi-Fi gear provider Aruba Networks concurred that my device was getting bogged down in the 2.4 GHz mess, and also wasn’t refreshing the available networks list, a device-specific problem.

Bottom line? Levi’s is no country for old phones.

Initial verdict: Wi-Fi and cellular is world class… but app needs work

After staying into the third quarter — and visiting another friend in section 109, where I got another hefty Wi-Fi speed test (24.42/25.39 Mbps) — I followed the lead of many fans and took an early leave of Levi’s, which meant no lines at the VTA trains and just a couple short delays due to track congestion that stretched the return train trip to 40 minutes. Overall, my travel to and from the stadium from San Mateo took just over an hour each way, a happy stat to report.

My initial verdict is that the Wi-Fi and DAS (cellular) networks delivered as promised, with solid speeds all around the stadium every time I checked. It’s no small accomplishment just to deliver such world-class service to such a crowded space, especially in the middle of Silicon Valley. True to its roots, the crowd Sunday was device-happy, with many iPads and GoPros being carried around as video cameras, in addition to all the phones that were in constant use. It’s a tribute to Williams and his staff, as well as the technology suppliers like Aruba, Brocade, Comcast (backbone bandwidth supplier) and DAS Group Professionals, who built the distributed antenna system (DAS) which brings advanced cellular connectivity inside the gates, to have built a solid network that worked well on its first big test.

The team app, however, did not even come close to living up to its advanced billing. To equal the network I think the app needs more advance instructions, especially on the ticketing/registration options as well as on the location services needed to make everything work. And until we see the multiple-camera angle live replays in action, to me the app is an incomplete project. The good news is, the Niners and their technology teams have several weeks to make improvements, including another preseason game Aug. 24 against the San Diego Chargers.

It’d also be helpful for the team to reach out a bit more to the VTA and players like the City of Mountain View, since the VTA site maps and Mountain View’s parking maps are far from what you would call “advanced design.” I think it’s up to the Niners to help pay for improvements to the city and transportation entities’ technology offerings, simply because of the burden placed on those operators by the fans going to Niners’ games. At the very least, more links from football to getting-there operations seems in order, instead of trusting that all parts of the operation will work in sync.

VTA lines going home

VTA lines going home

https://duwit.ukdw.ac.id/document/pengadaan/slot777/

https://mtsnupakis.sch.id/wp-content/zeusslot/

https://insankamilsidoarjo.sch.id/wp-content/slot-zeus/

https://smpbhayangkari1sby.sch.id/wp-content/slot-zeus/

https://alhikamsurabaya.sch.id/wp-content/slot-thailand/

https://mtsnupakis.sch.id/wp-content/bonus-new-member/

https://smptagsby.sch.id/wp-content/slot-bet-200/

https://lookahindonesia.com/wp-content/bonus-new-member/

https://ponpesalkhairattanjungselor.sch.id/wp-content/mahjong-slot/

https://mtsnupakis.sch.id/wp-content/slot777/

https://sdlabum.sch.id/wp-content/slot777/

https://sdlabumblitar.sch.id/wp-content/bonus-new-member/

https://sdlabumblitar.sch.id/wp-content/spaceman/

https://paudlabumblitar.sch.id/wp-content/spaceman/