Stadium Tech Report: Partners the key to fast Wi-Fi deployment at Staples Center

Staples centerDuring the 2012 NHL playoffs, no other team could stop the Los Angeles Kings. But as the Kings’ fans were celebrating their team’s run to the Stanley Cup, their cheers from Staples Center stayed inside the walls. Without a Wi-Fi network or good cellular connectivity in the venue, fans there were shut off from sharing their joy with the outside world — a frustration they let team officials know about, in no uncertain terms.

“Not having Wi-Fi was really impacting the fan experience, especially during that championship run,” said Denise Taylor, chief information officer for arena owner AEG. “Our fans went through a lot of pain. And we heard them.”

Fast-forward to the 2013 playoffs, and while the LA Kings weren’t as successful on the ice, at least the fans were able to stay fully connected while at the games thanks to a new HD Wi-Fi network and a neutral DAS deployment at Staples Center. With some impressive help from infrastructure partners Cisco and Verizon, AEG was able to get Wi-Fi and a full DAS deployment installed in both Staples and the adjoining LA Live center in just two and a half months, despite nearly constant activity in the venue that never sleeps.

With its network now in place, AEG and Staples are keeping all the Los Angeles teams’ fans connected while busily looking for more opportunities to not only further enrich the fan experience, but to also add to the teams’ and facilities’ bottom lines. And AEG is already learning lessons about how to better deploy Wi-Fi at its arenas and venues worldwide, including the knowledge that fan network use is showing no signs of slowing down.

Building a network in a building that never sleeps

According to Taylor, deciding that Staples Center needed a Wi-Fi network was the easy part “It was a must-have,” she said. “We knew had to get it in immediately.”

The LA Kings celebrating the 2012 Stanley Cup win at Staples Center

The LA Kings celebrating the 2012 Stanley Cup win at Staples Center

The hard part? Building that network into a building that hosts not one but two NBA teams, the Los Angeles Lakers and the Los Angeles Clippers, as well as the NHL’s Los Angeles Kings and the WNBA’s Los Angeles Sparks, plus is host to numerous concerts special events and the Grammy Awards. When the business plan was put in place in late 2012 to deploy the networks, Taylor said there were only four “dark” nights during the two and a half months of construction.

“That’s when it pays to have really great partners,” she said. Though there was heavy lifting necessary to retrofit the 20,000-seat venue, including opening up walls to install conduit and access points, Taylor said AEG’s partners worked around the busy Staples event schedule, with most work taking place between the hours of 2 a.m. and 2 p.m. When the dust settled, Cisco had installed a total of 463 APs in both Staples Center and L.A. Live, meaning that fans could stay connected inside the stadium and outside at the adjoining cluster of stores, restaurants, movie theaters and other facilities.

Almost instantly, fans were talking about events, sharing pictures and messages on social media networks. “It was a great feeling to see people talking about the games,” Taylor said. “Our partners really delivered.”

Future Advice: Don’t make any small network plans

LA Kings fans, who previously couldn’t even use the team’s app while at Staples, are now the biggest network users. According to Taylor, an average of 3,000 fans are connected to Wi-Fi during LA Kings games at Staples Center, just ahead of the facility’s average NBA game network user number of 2,410. Even at this early stage of the game, Taylor is seeing that her team’s predictions for network usage might have been low.

“We had originally designed [the network] for use by 25 to 30 percent of a capacity crowd,” Taylor said. But during a recent concert run of four sold-out shows by the band One Direction, Taylor said 35 percent of attendees were using the network during those shows.

“Use of mobile phones in venues is just going to grow and grow,” she predicted. “We’re seeing more and more penetration every day.”

And while pure connectivity is great, Taylor and AEG are now moving forward to enhance the fan experience in multiple ways, including implementation of mobile ticketing apps and apps for ordering food and concessions from your phone.

“We’re in the early stages, but all of that — concessions, ticketing, team apps — is in the works,” Taylor said. “Having a real HD Wi-Fi network creates so many business opportunities, for teams, venues and owner groups. There’s the whole area of captive analytics, which has tremendous potential upside. It’s just a question of how you monetize this big digital asset you have in your hands.”

More lessons: Don’t skimp on 2.4 GHz, and pick good partners

When it comes to Wi-Fi technology, the future is devices that work in the 5 GHz unlicensed spectrum band, which has tons of available bandwidth. Many newer devices, like Apple’s iPhone 5 series, include radios for connecting to 5 GHz Wi-Fi. But Taylor said venue owners and operators need to make sure they don’t skimp on building in support for the 2.4 GHz band, where a large legacy of devices still operate.

“Designers may prefer the 5 GHz range but if you only support that band the truth is you would eliminate a good portion of consumers,” Taylor said. “There are also back of house management applications that still require 2.4 GHz support. So you still have to build for the lowest common denominator of devices to make sure you are engaging every fan who comes in, even those with older phones.”

And since most networks built now are going to be put into arenas that already exist — meaning retrofits — there will probably be a Staples Center-like challenge of doing deployment work around events. That means, Taylor said, that owners and operators need to find partners who are “willing to work hours that aren’t always 8 to 5.”

As AEG develops overall plans for site operations at its numerous international locations, Taylor said that wireless networks are no longer seen as a luxury.

“The two most important things are having HD Wi-Fi and a robust DAS,” she said. “You give the fan what they want, and take advantage of all the opportunities to monetize the network. It’s just not an option anymore.”

Verizon Wireless joins the tablet market with Ellipsis 7

Ellipsis-7-tablet-366x251

Football fans that use a Verizon-backed smartphone to watch NFL games will be thrilled to learn that they may now be able to boost the screen size in the future with the company’s 7-inch HD Ellipsis tablet that is expected to be in its stores by week’s end.

The details are sparse from Verizon on the exact specifications but the tablet will have a HD display but no report on the resolution while C/net is reporting that it will also feature a 1.2GHz quad core processor, 1GB of RAM and 8GB of storage that can be expanded via an optional microSD card.

Not surprisingly connectivity is a big feature with the Ellipsis 7. It will feature 4G LTE and mobile hotspot support for as many as eight additional Wi-Fi devices, according to C/net.

The Ellipsis tablet is obviously not chasing after Apple’s iPad, the Samsung Galaxy offerings or the high-end releases from Google, Amazon and others. Rather it is positioning itself as a low cost, solid alternative to these products for users who might not want or need all of the bells and whistles, and associated price tag, that come with these different offerings.

While it seems that everybody is now jumping into this space, from supermarkets to bookstores that is not a bad thing. As their price continues to drop the commercialization of tablets will continue and customers will benefit from this.

When the prices get low enough it makes sense to have one dedicated to work purposes, maybe with an external keyboard that has an additional battery while having a second tablet that can be kept by the television that can serve as a second screen, to watch two football games or allow one person in the room to escape sports. A low cost offering bedside for a late night reading before sleep. All of this is coming closer to reality as tablets become increasingly ubiquitous.

Verizon said that the tablet is the first of an expected family of Ellipsis products and it will be available online exclusively at the company’s stores for $249.99, with a short term offer now for $100 off any tablet from Verizon with a new 2-year wireless service contract.

Verizon Suffers NFL Mobile Failures on Opening Day

Did you have problems connecting to the Verizon NFL Mobile app Sunday? If so, it’s not your phone — it’s Verizon, which once again proved that it wasn’t ready for the opening day of the NFL season.

As a Verizon customer and a longtime NFL Mobile customer as well, I’ve experienced much frustration over the past couple years due to glitches with the app and programming for it. When it works I am amazed at the ability to watch live football on my phone. But how can two companies, the NFL and Verizon, which make billions in profits each year, have such consistent failures? Does anyone there care if the app actually works or not?

On Sunday I downloaded the new version of the NFL Mobile app, then tried to connect to watch RedZone for the afternoon game endings. I got an authentication failure, which surprised me since I had done everything possible beforehand (turned on all location services, turned off Wi-Fi) to make sure Verizon knew where my phone was.

After going through a half-hour of support hell waiting (including, ironically, a Drew Brees commercial telling me how great NFL Mobile is) I finally got a technician to tell me that because “so many people” were using the NFL Mobile app, Verizon’s network basically went kablooey, and that massive amounts of NFL Mobile users weren’t able to connect. Imagine that! People wanted to watch the NFL today! That’s like not stocking Elmo toys the week before Thanksgiving, or any similarly stupid move. The Verizon rep also told me that “because of high call volume” Sunday there weren’t enough technical reps at work to handle the NFL Mobile outage.

I will give the Twitter reps at NFL Mobile customer support a small bit of respect for finding my tweets and trying to respond, but really — this just shouldn’t happen. Not when the NFL itself says that more people are going to its websites via mobile than via desktops. The biggest app for the biggest sport simply shouldn’t have network failures. And reps shouldn’t be whining that too many people are trying to use it as the reason why it failed. Unless we all get a month’s credit on our Verizon bills.

Is “hiccups” on a server a new technical term? Is there a “hiccup reset” button?

As of 5 p.m. Pacific Time, it still wasn’t working for me. But the support folks found time for humor.

So — Verizon can pay the NFL a billion bucks for NFL Mobile rights, but can’t keep enough engineers on staff on Sundays to make the thing work? That’s fail with a capital F. Which is the grade we give Verizon for its performance on what is probably the sports world’s most-used app. And they’re locked in for four more years. Now I know what a Cleveland Brown fan must feel like.

UPDATE: At 5:42 p.m. Pacific Time NFL Mobile finally authenticated my device. Just in time to watch Tony Romo be Tony Romo.

NFL, Verizon Introduce New NFL Mobile App

New NFL Mobile app; photo courtesy of NFL.

New NFL Mobile app; photo courtesy of NFL.

If you, like me, enjoy watching live NFL action on your Verizon smartphone, things are probably going to be a lot better this season as the league and Verizon have teamed up for a full refresh of the NFL Mobile app, which will also be available to smartphone customers of other carriers, with the only catch being that those customers won’t have access to live game action.

In a phone interview with Manish Jha, General Manager of Mobile at the National Football League, we learned about a whole bunch of new bells and whistles, maybe things you won’t necessarily notice, like improved back-end design and more up-to-date score information. What hasn’t changed for the 2013 season is the $5 monthly fee Verizon will charge its smartphone customers to view live NFL games on Sunday, Monday and Thursday nights, along with NFL network coverage and (perhaps most important) live RedZone coverage on Sunday.

(Don’t dismiss the RedZone coverage. If you live in California, like we do, you can sometimes get a full extra live game or two on Sundays because they are the only ones still going on.)

If your phone is from AT&T, or Sprint, or T-Mobile, you won’t be able to watch live action but you also won’t have to fight to find an NFL app that works well to bring you things like video highlights, replays, scores, and fantasy stats. Jha said the NFL and Verizon teamed up to produce one app to rule them all, the new NFL Mobile app which you should be able to find in the operating system app store of your choice. Also built into the new version of the app are some of the features from last year’s experimental Thursday Night Xtra app, which we never felt was fully baked; hopefully some of its interesting social media ideas are better fleshed out this time around.

“We want to make this the definitive NFL experience for a smartphone,” said Jha. And well should the NFL pay a lot of attention to mobile access: According to Jha, during last season mobile traffic to all NFL Internet sites surpassed desktop Internet traffic, even as that latter figure also increased.

Read that again: Mobile traffic to NFL sites eclipsed desktop traffic last year, even as desktop traffic grew. So now you have an idea why Verizon paid $1 billion to keep the rights for 4 more years as the NFL’s exclusive mobile carrier.

The only thing we still argue about is the league and Verizon’s decision to keep live cellular action off tablets; the Verzion NFL Mobile live access only works for devices they consider “phones,” though Jha even admits that such a definition may be a short-time thing, given the trend of phones getting big phat screens.

“We’re staying on top of trends, watching what comes out of Silicon Valley,” Jha said. “Right now we’re being pragmatic, trying to strike the right balance between serving fans and creating value for our sponsor.”

Wi-Fi Whispers: Giants Double Wi-Fi Access Points, Add Charging Stations at AT&T Park

SFG_ATT_parkThe San Francisco Giants are making a case for keeping thier unofficial title of having the best wireless networked ballpark by doubling the number of wireless access points and adding mobile-device charging stations at AT&T Park for the 2013 season.

Already easily one of the best un-wired sporting arenas, the home field for the 2012 World Series champs isn’t resting on its tech laurels. According to an email from Giants CIO Bill Schlough, “the Giants and AT&T Wi-Fi Services are more than doubling the number of access points at the ballpark (760) to stay ahead of demand from our increasingly connected fan base.” Schlough said the Wi-Fi network at AT&T Park hosted 980,000 gameday connections during the 2012 season, up 90% from 2011. Total data usage, Schlouh said, increased by 140 percent over the previous year, with more than 16 million megabytes sent over the AT&T Wi-Fi network during the Giants’ regular and playoff seasons.

To better serve fans who probably burn out batteries sending tweets and Vine videos, the Giants and AT&T are helping make sure nobody has to crouch down by a concourse wall, looking for an outlet mid-game. According to Schlough, fans at AT&T Park will have access to more than 400 mobile device chargers throughout the stadium, with 10 mobile kiosks capable of charging 16 devices each. And perhaps most importantly, the Giants will keep their highest-paying customers well-charged, with four device chargers in each suite.

Schlough also gave us a Giants’ point of view on the announcement last week about Qualcomm and Major League Baseball “working together” to bring more Wi-Fi networks to MLB parks. While we cynically tweeted that such deals don’t mean much without monetary figures attached (I mean, the best way to bring Wi-Fi to the ballparks that don’t have them is to BUILD NETWORKS), Schlough said the Qualcomm deal would only help build better networks.

In an email reply to a question about how the Qualcomm-MLBAM deal might affect the Giants, Schlough responded: “We’ve actually been working with Qualcomm and MLB Advanced Media to benchmark the work that AT&T has done here with our Wi-Fi and 3G/LTE DAS networks, in hopes that this we can A) identify specific areas within the ballpark to be targeted for continued improvement and B) potentially serve as the model that other ballparks can follow.”

Charging stations sound like another good step in the fans’ direction. Now if only airports and convention centers would follow suit.

Xirrus Brings Wi-Fi to Liverpool FC

Our friends at Xirrus scored another big stadium deal for their new-era Wi-Fi networking gear, bringing wireless services to Anfield Stadium, the home of the club since its formation in 1892. Here’s a good writeup on the deal from TechWorld. We are guessing the ability for Xirrus’s antennas to cover more space and provide more capacity per access point was a selling plus for the ancient Anfield Stadium; here’s the official press release about the win.

ExteNet Bags Four Major Carriers for Barclays Center DAS

On the DAS (distributed antenna system) front the folks at ExteNet Systems scored a major win for their network at the new Barclays Center in Brooklyn. ExteNet, which builds DAS networks to improve in-building cellular connections, signed agreements with the big 4 U.S. wireless carriers — AT&T Wireless, Verizon Wireless, Sprint and MetroPCS — for the Barclays DAS, meaning that all the carriers will pay ExteNet to help bring better signals to their customers inside the arena.

Signing all four is a huge win for ExteNet, whose strategy of building “neutral DAS” networks and then acting as the middleman seems to be paying off not just for ExteNet, but also for cellular customers. By picking ExteNet, Barclays is putting the fan experience above the potential income of a single-carrier “exclusive” deal. Let’s hope more stadiums think of ExteNet and other neutral DAS players first, instead of deals that leave two thirds of the cellular users without better connections.

Wi-Fi Whispers: Where’s Brocade in Niners’ New Stadium Plans? Plus More NFL Wi-Fi with Cisco in Atlanta, Verizon in Detroit

There was one thing missing from the great Ars Technica blowout on the proposed Wi-Fi network at the new stadium being built for the San Francisco 49ers: Any mention of networking partner Brocade, which made a big deal about how it was going to help the Niners with a state-of-the-art stadium network.

In a Twitter exchange with the story’s author, Jon Brodkin, he said that the Niners’ networking crew asserted that they hadn’t yet picked a vendor for the access points the network will use. That opinion was not taken well by the folks at Brocade, who have not commented publicly but are most likely having some interesting discussions with their new partner the 49ers.

What it may boil down to is the fact that the Niners’ networking crew is waiting for the next generation of Wi-Fi hardware to come out — most likely built around the new 802.11ac protocol — and since the network isn’t scheduled to go live for another year, it’s probable that they are not yet at final hardware decisions. Though no monetary details of the Brocade agreement were ever revealed, it was supposed to encompass not just building of the stadium network but name-sponsoring an attached meeting room area that Brocade (whose headquarters are close to the stadium site) would be able to use during non-football times.

Then there is the big question about whether or not networking giant Cisco, which also has headquarters within walking distance of the Niners’ stadium, will be involved in any way at all. Cisco, the current big player in the stadium-network space, might be tapped for digital signage or video, but it’s hard to imagine both Cisco and Brocade being “partners.” We are guessing this story is far from over…

Cisco Network in Georgia Dome Profiled

MSR would like to give a shout out to Steve Zurier, who penned this excellent breakdown of the new Cisco Wi-Fi network in the Georgia Dome. Steve, who at one point held down bass guitar duties on our old industry band Kludge, spells out how stadiums are the ultimate BYOD operation. I bet there will be plenty of Cisco employees on hand to “make sure the network keeps working” during the upcoming men’s Final Four.

Verizon makes Lions Wi-Fi Official

We’ve noted here before how Verizon Wireless doesn’t like to call attention to its stadium network deals — probably because it doesn’t want every team clamoring for the same investment — but it is nice to see Big Red come out publicly and talk about the Wi-Fi network it put into Ford Field in Detroit.

What I think is kind of bogus is the fact that the network is available only to Verizon customers; I hope the tradeoff of having a network that only keeps a third of your customers happy is worth it for the Lions, but to me it sounds like a poor decision. Check out the quote from Mark Emerick, Verizon’s director of network operations, about what fans can do if they’ve shelled out thousands for season tickets but have a phone from another provider:

“As fans are frustrated with other carriers they may look to their neighbors next to them and decide to switch.”

Or, they could decide to not come to the games.