Stadium Tech Report: San Francisco’s AT&T Park lives up to its wireless reputation

Another tough day at the office for MSR. Credit all photos: Paul Kapustka, MSR. (Click on any picture for a larger image)

Another tough day at the office for MSR. Credit all photos: Paul Kapustka, MSR. (Click on any picture for a larger image)

Many times here at Mobile Sports Report we’ve referred to AT&T Park as the “most connected” or “best connected” stadium in baseball, if not for all sports anywhere. But even after multiple network tours and numerous reports from stats given to us by Giants CIO Bill Schlough and his staff I realized that one thing I’ve never done is to roam around the park on a game day, checking to see if its renowned Wi-Fi and DAS networks perform as promised.

Now after attending a recent day game as the guest of AT&T, I can tell you that the stadium that first put in fan-facing Wi-Fi for every seat is still at the forefront of ballpark connectivity, with Wi-Fi and DAS performance that knocks the ball out of the park almost every time. I say “almost” because during my walkaround tour I was able to find one place in the park that had almost no connectivity at all — but I will also bet you that as soon as this story is published, Schlough and his team will likely be out there the next day installing some kind of coverage since he and they have an almost unmatched enthusiasm for making their fan-facing network the best it can be. That, plus a strong partnership with AT&T, gives fans at Giants games perhaps the best stadium network anywhere, with performance so good for so long that it has almost become somewhat of an afterthought, one of the best kind of compliments a network staff can receive.

Nothing beats a strong team

Dynasty is a word fans like to use around Third and King Street in San Francisco, especially after the Giants won their third World Series title in 5 years last fall. Schlough, who loves baseball and the Giants as much as he loves networks, used the press-day gathering to show off his most recent Series ring, a chunk of gold and diamonds that probably gives you a wrist-curl workout when you put it on.

AT&T Park CIO Bill Schlough shows off his World Series bling.

AT&T Park CIO Bill Schlough shows off his World Series bling.

(Point of reference: Schlough offered the ring to me to try on, but as a dyed-blue Cubs fan I refused. “Waiting for one with ‘Cubs’ on it,” I told him. As we say in Chicago, “if it takes forever.”)

You might have heard some of the early Wi-Fi stories from AT&T Park before, but they’re fun to repeat. Then known as SBC Park, after the sponsoring “Baby Bell” that would later revive the family name of AT&T, the Wi-Fi network that debuted in 2004 attracted an average of about 94 fans a game, Schlough said, diehard geeks who would have to put up with people mocking them for bringing laptops to a ballgame. Remember, the iPhone was still 3 years away from existing, and you had to stick a PC card in a laptop to connect to Wi-Fi.

Fast forward to 2015, and now for regular season games the Giants see an average of just more than 13,000 people connecting to the Wi-Fi network, a number that has basically leveled off over the past 3 years, Schlough said. What hasn’t leveled off, however, is data use — even from last season, when fans used an average of 591 gigabytes of data per game, so far this season they’re averaging 915 GB per game. That’s why this season Schlough and team will be busy adding another 400+ Cisco Wi-Fi access points to the park, a total that should hit 1,700 by the time October rolls around.

“We’ll be working hand in hand with AT&T trying to stay one step ahead of demand,” Schlough said.

AT&T Park cabling runs are SRO

AT&T Park cabling runs are SRO

Scott Mair, AT&T’s senior vice president of technology, was on hand to help lead network tours before the game and to talk about how AT&T was using a new device called the EchoBOT to help gauge network performance in the park. Though it’s a bit of inside baseball, EchoBOT — which is basically an off-the-shelf cell phone that sits in a ruggedized box — is the kind of thing that can come out of the smart-person pool at a technology giant like AT&T. Invented in-house, the EchoBOT basically gives network operators an on-the-spot way to determine not just how the network is working, but what the actual user experience is like from the end-user point of view.

With 18 EchBOTs scattered throughout AT&T Park, Schlough and AT&T can get a much more granular view of how the stadium’s network is performing, just another way of using the resources of one of the world’s biggest telecom companies helps the fan experience at AT&T Park.

The one place without Wi-Fi

With our network tours concluded and some crispy chicken fingers inhaled in the comfy confines of the AT&T suite just above the third-base line, it was time to go to work to see if the AT&T Park network could deliver as promised. Since I’ve sat in seats at the park many times and had great connectivity there, I spent my time during the afternoon game seeking out what I thought might be some of the hardest places to bring connectivity. The first, in the second-level concourse, looked like it might be a tough antenna spot, with narrow halls and lots of concrete. But bam, on my Verizon iPhone 6 Plus I got a Wi-Fi signal of 31 Mbps down, 21 Mbps up; on my companion loaner device from AT&T, an LG Optimus G Pro, I got a 4G LTE connection of 26.15 Mbps down, 18.02 up. (For all remaining measurements I’ll just use the down/up convention to save time; I was using the standard Speedtest.net app from Ookla for all measurements.)

So yeah, you can connect while you’re in line to get a hot dog.

Here's the only place we couldn't find decent Wi-Fi. #firstworldproblem

Here’s the only place we couldn’t find decent Wi-Fi. #firstworldproblem

Strolling through the concourse toward right field, I saw several Wi-Fi advertisement signs, letting fans know they should definitely connect to the network. That’s a sign of deployment confidence, unlike many parks that install Wi-Fi but don’t really promote it, perhaps in order to keep user numbers down. After walking outside to get a view of McCovey Cove and the kayaks waiting for home-run balls to clear the park’s fences for a “splash landing,” I found a spot with almost zero connectivity — in the standing-room-only area backed up against the wall overlooking the bay.

With a Wi-Fi reading of 0.93/2.23 on the Verizon device and a 0.94/3.24 on Verizon 4G the SRO perch on the promenade was easily the poorest connection I found all day. But looking around, it’s kind of a silly place to be looking at your phone since from one direction a well-hit ball might be landing on your head and in the other direction there’s great views of the San Franicsco Bay. But still it does go to show that even in the most-connected stadium perhaps on earth, it’s not easy to get a signal everywhere. With no roof overhead and no railings close by, there simply isn’t a place to put an antenna out there. (But I bet Schlough and team will soon come up with a solution.)

Concourses covered, and upper deck too

I kept wandering around the outfield concourse and found decent connectivity at the centerfield Coors Light bar, 9.32/17.31 for Wi-Fi on the Verizon device and 14.21/43.00 for Wi-Fi on the AT&T device, as well as outside the Giants’ social media cafe in left-center, 14.32/32.20 for Wi-Fi on the Verizon device and 13.61/34.70 for Wi-Fi on the AT&T phone. Unless you’re a Wi-Fi geek like me you probably won’t ever see the APs since they are painted to match the structures they’re attached to. But I could see multiple APs hanging off the centerfield scoreboard structure, a piece of architecture that helps to deliver such solid connectivity to the open outside areas.

You can see Wi-FI APs -- if you know where to look.

You can see Wi-FI APs — if you know where to look.

Taking a break in a standing area behind the left field foul pole I got a smoking result for Wi-Fi on the Verizon phone, 22.46 Mbps on the download side and an amazing 52.05 on the upload. (I think it’s important to note that some of the best signals were on a device from an AT&T competitor, a sign that the facility does a great job of ensuring that any customer will get a good signal, no matter where you purchased your phone or service plan.) Climbing the stairwells to the view deck I still got a good signal on the concourse behind the seats in upper left field — 7.24/8.75 on the Verizon phone.

Since it was getting windy and cold (summer in SF!) I ducked back inside and found an empty seat in section 332, near the upper left field corner of the park. There I got a Verizon Wi-Fi mark of 17.52/24.33, and a Verizon 4G LTE mark of 5.62/6.81, again showing that the AT&T Park DAS is also delivering solid performance for customers on other carriers. The AT&T phone at that location saw 12.46/18.79 on Wi-Fi and 12.68/17.06 on 4G LTE. According to Schlough, the AT&T neutral-host DAS, which uses CommScope ION equipment, is so good that many fans don’t even bother to switch their phones to Wi-Fi. The upper deck, or view level, is scheduled to get many of the APs slated for installation this summer, in the under-the-seat enclosures that bring the network right into the seating areas.

Conclusion: Like the Giants, AT&T Park is tough to beat

Here at MSR we get the question a lot — “what’s the park with the best network?” — and I would have to say that like its tenants, AT&T Park is tough to beat. Schlough and the impressive IT team down at AT&T Stadium have a friendly rivalry, and you can’t have the most-connected discussion without mentioning Levi’s Stadium. But the park that did Wi-Fi first continues to improve year in and year out, never resting on its historic laurels. That’s a “dynasty” that is perhaps as impressive as the one built by the team on the field.

(More AT&T Park visit pictures below)

A little hard to see, but if you look closely you can see the Giants showing fan social media posts on the big screen.

A little hard to see, but if you look closely you can see the Giants showing fan social media posts on the big screen.

These signs are up all over the park

These signs are up all over the park

EchoBOT enclosures (white) next to a Wi-FI AP

EchoBOT enclosures (white) next to a Wi-FI AP

View from the Coors Light concourse walk-up bar in center field

View from the Coors Light concourse walk-up bar in center field

Good connectivity here in left field. Maybe the buttons on the hat improved reception?

Good connectivity here in left field. Maybe the buttons on the hat improved reception?

MLB app ads greet you as you walk up the stairs at AT&T Park

MLB app ads greet you as you walk up the stairs at AT&T Park

Nice place for a ballpark, don't you think?

Nice place for a ballpark, don’t you think?

For Giants fans only: I swear that thing weighs about 3 pounds

For Giants fans only: I swear that thing weighs about 3 pounds

MSR editor Paul Kapustka, your man on the Wi-Fi scene.

MSR editor Paul Kapustka, your man on the Wi-Fi scene.

NBA stadium tech reports — NBA West, Pacific Division

Editor’s note: The following team-by-team capsule reports of NBA stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE HOOPS AND HOCKEY ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

Reporting by Chris Gallo

NBA WEST: Pacific Division

Golden State Warriors
Oracle Arena
Seating capacity: 19,596
Wi-Fi: Yes (185 APs)
DAS: Yes

The Warriors have the oldest home court in the NBA as Oracle Arena opened almost a half century ago. The age hasn’t stopped Golden State from making upgrades to the arena in the past few seasons with Wi-Fi and DAS available. (In fact, the Wi-Fi network is currently undergoing upgrade during this season). The Warriors are also out front with beacons, now in the second generation of using the technology to power features like store discounts and seat upgrades. The Warriors also remain one of the recognized leaders in all sports in social media outreach.

Los Angeles Clippers
Staples Center
Seating capacity: 19,060
Wi-Fi: Yes
DAS: Yes

Staples centerWhile the Clippers went through an eventful summer last year, the Staples Center was busy improving the fan experience. The 15-year-old facility completed a new LED sports lighting system to the tune of nearly $7.5 million. The conversion to LED lighting allows the Staples Center to save an estimated $280,000 annually in energy costs. Those savings combined with Wi-Fi and DAS deployment from Verizon, help new owner Steve Ballmer in his pursuit to make the Clippers a championship franchise. (Which will have to wait until next year.)

Los Angeles Lakers
Staples Center
Seating capacity: 18,997
Wi-Fi: Yes
DAS: Yes

While there wasn’t much to cheer about on the court this season, Los Angeles Lakers fans still benefited from sharing the Staples Center with multiple professional franchises. The Wi-Fi and DAS systems are among the best in the NBA, and more improvements are scheduled for the arena. The latest planned renovation is a retractable seating system to help the Staples Center more easily complete almost 150 doubleheader games each year between the Lakers, Clippers, LA Kings, and Sparks.

Phoenix Suns
US Airways Center (Talking Stick Resort Arena)
Seating capacity: 18,422
Wi-Fi: Yes (300+ APs)
DAS: Yes (325 antennas)

Verizon and the Phoenix Suns agreed to a long-term extension this fall to make the arena fan-friendly for years to come. Verizon plans to install beacons, and allow fans to keep tickets and arena credit in a “wallet” directly on their mobile devices. The upgrades will coincide with a name change of the arena. A Phoenix-area tribe purchased the naming rights in December. With its new moniker, Talking Stick Resort Arena will take over the rights from the US Airways for the 2015-16 season.

Sacramento Kings
Sleep Train Arena
Seating capacity: 17,317
Wi-Fi: Yes (90+ access points)
DAS: Yes

The Sacramento Kings broke ground on their new $477 million downtown arena this fall. The franchise plans to open the new arena in time for the 2016 season, and to make a splash in stadium technology. The Kings are aiming to have more per capita connectivity than the 49ers’ Levi’s Stadium. Bold. And to prepare for the new arena, Sacramento is using the aging Sleep Train Arena to experiment with new technologies. In limited pockets, the Kings took advantage of their partnership with SignalShare to make the team app more location-specific and gather data of fans’ habits that will be useful for the opening of the new arena.

NBA stadium tech reports — NBA West, Northwest Division

Editor’s note: The following team-by-team capsule reports of NBA stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE HOOPS AND HOCKEY ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

Reporting by Chris Gallo

NBA WEST: Northwest Division

Denver Nuggets
Pepsi Center
Seating capacity: 19,155
Wi-Fi: No
DAS:Yes

The Denver Nuggets rely on DAS to help fans stay connected at games. As the Pepsi Center turns 16 years old this year, there are no immediate plans to add fan-facing Wi-Fi to the arena. No Wi-Fi means it’s no surprise the Nuggets rank towards the bottom of the league in home attendance.

Minnesota Timberwolves
Target Center
Seating capacity: 19,356
Wi-Fi: No
DAS:Yes

Still no Wi-Fi available at the Target Center. But the city of Minneapolis and the franchise are working toward an estimated $97 million renovation that would be sure to include ways to improve the experience for the fans. Any connectivity upgrades would be welcomed, as the arena enters its 25th year of existence. Maybe Kevin Garnett can help hang some APs as part of his return?

Oklahoma City Thunder
Chesapeake Energy Arena
Seating capacity: 18,203
Wi-Fi: Yes
DAS:Yes

Oklahoma City installed new video boards and reconfigured suites as part of an estimated $2.4 million worth of upgrades this offseason. The updates are a nice compliment for fans, who can connect to Wi-Fi and DAS in Chesapeake Energy Arena.

Portland's Moda Center, home of the NBA Trail Blazers. Credit all photos: Moda Center (click on any photo for a larger image)

Portland’s Moda Center, home of the NBA Trail Blazers. Credit all photos: Moda Center (click on any photo for a larger image)

Portland Trail Blazers
Moda Center
Seating capacity: 19,980
Wi-Fi: Yes
DAS:Yes

Owner Paul Allen delivered on a $16 million renovation plan this season, bolstering Wi-Fi and DAS in the Moda Center for years to come. It’s now easier for fans to view highlights during home games from the team’s mobile app.

Utah Jazz
EnergySolutions Arena
Seating capacity: 19,911
Wi-Fi: No
DAS:Yes

The Utah Jazz partnered with Boingo Wireless last spring to deliver a modern Distributed Antenna System to EnergySoultions Arena. The neutral DAS system is a major upgrade for fans and the 24-year-old facility. While Wi-Fi is not yet present in the arena, the franchise is patiently evaluating its needs to make it available in the future.

RootMetrics debuts tests of cell service inside stadiums

Screen shot of RootMetrics reporting app.

Screen shot of RootMetrics reporting app.

RootMetrics, a Bellevue, Wash.-based concern that has made a name for itself by conducting tests of wireless services in cities and airports across the nation, is now starting to test wireless networks in sports stadiums, which may give fans a heads-up on how their provider is performing inside stadium walls.

Though it only has visited a handful of arenas so far, RootMetrics eventually plans to test more than 100 stadiums this year, according to the company. For each venue, RootMetrics sends an unspecified number of testers to track data performance of the top four wireless carriers in the U.S., a list that includes AT&T, Verizon Wireless, Sprint and T-Mobile. RootMetrics’ venue testers also check performance of the internal Wi-Fi network if one is available, but it does not let Wi-Fi compete for its “RootScore Award,” which it bestows upon the carrier with best performance in the combined categories of speed and “data reliability,” basically a measurement of the ability to make and hold a connection during any wireless data request or action.

RootMetrics also doesn’t take into account whether or not any of the carriers has preferential deals inside a venue, which may give that provider a leg up on the competition. For its report on the Staples Center, for instance, RootMetrics gives its award to Verizon, which is not surprising to us since Verizon built both the Wi-Fi and the DAS network at the facility. But RootMetrics makes no mention of the business agreements at Staples or anywhere else, which is by design, according to the company.

Why can’t Wi-Fi win?

RootMetrics CEO Bill Moore said in a recent phone interview that such details about contracts and preferred suppliers really don’t matter to consumers — what really matters, he said, is how well each carrier performs in the venue.

While the “scoreboard” mentality does perform a service by presenting just what data the testers find, the RootMetrics venue surveys have some gaps that may need to be filled or changed in the future to present a fully accurate picture of stadium network performance. One big reporting gap is the fact that RootMetrics doesn’t use any iOS devices in its stadium tests, a strange omission since most stadium networks say they still see a majority of iPhones among the devices being used on stadium networks. RootMetrics also seems to unfairly leave Wi-Fi networks out of the scoring, even though in many cases so far the local Wi-Fi networks far outperform the carrier cellular links.

Screen shot of RootMetrics' test results for the Moda Center in Portland.

Screen shot of RootMetrics’ test results for the Moda Center in Portland.

For Portland’s Moda Center, for instance, RootMetrics gives its RootScore award to Verizon, since in their testing Verizon was found to have better data reliability and better data speeds than the other cellular carriers. But the stadium’s in-house Wi-Fi network was 3 Mbps faster than Verizon on the download side and more than five times faster than Verizon on the upload side — yet Wi-Fi wasn’t mentioned in the venue “scores” and only got a footnote at the bottom of the results page.

Founded in 2008, RootMetrics has (apparently) built a good business in its chosen field, since it was acquired last month by the Englewood, Colo.-based IHS, a large information and analytics concern that recorded $546 million in revenue for its most recent quarter.

In the industry, RootMetrics is well known for its wireless coverage performance map and its “RootScores,” which attempt to determine winners and losers in the wireless service game for major U.S. metropolitan areas and the nation’s busiest airports. The basic RootMetrics premise is that they measure exactly what service levels consumers see in real life, providing an independent way for customers to evaluate services in a given area. While consumers can see the high-level results of its tests — which include both internal testing as well as data “crowdsourced” from consumers who download the RootMetrics reporting app — RootMetrics also sells its information directly to carriers and other infrastructure providers.

NBA stadium tech reports — NBA East, Southeast Division

Editor’s note: The following team-by-team capsule reports of NBA stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE HOOPS AND HOCKEY ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

Reporting by Chris Gallo

NBA EAST: Southeast Division

Atlanta Hawks
Philips Arena
Seating capacity: 18,118
Wi-Fi: Yes
DAS: Yes

Philips Arena features a different kind of video board this season. The court. That’s right, the Hawks are using a 3D projection system to display video on the hardwood and create an experience fans can’t find anywhere else. Atlanta can even use the projection system to bring tweets and Instagram posts from fans on the floor. Imagine seeing your selfie on the court, how cool is that?

The experience is even better after Boingo Wireless outfitted the 16-year-old facility with Wi-Fi and a robust neutral DAS system. The upgrades couldn’t have come at a better time given how the Hawks are performing on the court this season.

Charlotte Hornets
Time Warner Cable Arena
Seating capacity: 19,077
Wi-Fi: Yes (120+ antennas)
DAS: Yes (524 antennas)

With a not-so new name, the Charlotte Hornets continue to benefit from having a cable giant’s name on the front of their arena. The franchise plans to make Time Warner Cable Arena a bigger attraction in the future, and it should have no trouble as the city of Charlotte approved an estimated $33 million renovation project over the next decade. The buzz is indeed back.

Miami Heat
American Airlines Arena
Seating capacity: 19,600
Wi-Fi: No
DAS: Yes

The Miami Heat depend on a powerful Distributed Antenna System (DAS) to keep fans connected during home games at American Airlines Arena. There’s no fan-facing Wi-Fi in the arena yet, but it’s something the franchise is considering for the future, possibly first in a new bar/gathering area attached to the arena. Despite losing LeBron James to free agency, fans are still finding their ways to games, as the Heat rank in the top 10 in the league in attendance this season.

Orlando Magic
Amway Center
Seating capacity: 18,846
Wi-Fi: Yes
DAS: Yes

Orlando Magic in action at Amway Center. Credit: Orlando Magic

Orlando Magic in action at Amway Center. Credit: Orlando Magic

Only in its fifth year, the Amway Center is still one of the newest arenas in the NBA. Orlando partnered with AmpThink last year to give its Wi-Fi and DAS coverage a boost. This season, the Magic have joined forces with Chase and E15 Group to be one of the first NBA teams to incorporate Apple Pay into their home arena. Fans were able to make concessions and retail purchases from their phones throughout the arena.

Washington Wizards
Verizon Center
Seating capacity: 20,356
Wi-Fi: Yes
DAS: Yes

Mobilitie brought upgrades to the Verizon Center’s Wi-Fi and DAS systems over the past year, and it’s helping the Wizards connect with fans. Already with free iPhone and Android mobile apps, the Wizards released a native iPad app to help encourage fans to use the franchise’s digital ticketing system. And as a unique thank you to fans, the Wizards placed over 3,000 names of season ticket holders in the baseline logo of the Verizon Center’s court. Nice touch, Wizards.

Final Four final score: 11 Terabytes of total wireless traffic

Screen Shot 2015-03-10 at 6.37.28 PMWe finally have some final wireless results in from the Final Four, and the total wireless-traffic number of 11 terabytes used over the weekend is just another sign that mobile device use at “big” sporting events is still increasing, with no top in sight.

According to figures sent to us by Ryan Marketing Group Technologies — an official outlet for the NCAA’s men’s basketball tournament tech operations — there was 9.47 terabytes of wireless data used over the Final Four weekend in and around Lucas Oil Stadium in Indianapolis, with 5.3 TB of that running over the stadium’s Wi-Fi network and the balance running on the building’s DAS. According to Ryan Marketing Group they believe the DAS numbers only reflect Verizon Wireless customer traffic (we have asked Verizon to confirm the numbers, but have not yet received a response from Verizon). The NCAA numbers also include usage for attendees at the accompanying Fan Fest events, in addition to the Saturday and Monday night games.

Separately, AT&T had said that it saw 1.52 TB of cellular traffic on its own DAS for the Final Four games, so adding the figures together we get 10.99 TB of total data, a number that should give pause to stadiums or arenas with “big events” on the horizon. Following huge wireless traffic numbers from recent big events like the Super Bowl and the College Football Playoff championships, it’s clear that there is still no plateau in sight for mobile-device wireless usage at big events. And just when you thought networks might be able to keep pace with users, devices and apps, you have the recent emergence of livestreaming apps like Meerkat and Periscope to potentially swamp arena networks with even more data demands. So, big event holders… what’s in your network? Is it ready for the terabyte age?