Arizona Cardinals’ University of Phoenix Stadium beefs up Wi-Fi and DAS ahead of College Football Playoff championship game

University of Phoenix Stadium before Super Bowl XLIX. Photo: Paul Kapustka, MSR (click on any photo for a larger image)

University of Phoenix Stadium before Super Bowl XLIX. Photo: Paul Kapustka, MSR (click on any photo for a larger image)

After just hosting a Super Bowl, one with record wireless traffic numbers, you might not think that the University of Phoenix Stadium in Glendale, Ariz., needed to upgrade its Wi-Fi and DAS networks. But with many more big events on the way soon, including hosting this season’s College Football Playoff championship game, the UoP Stadium isn’t sitting still, but instead is fine-tuning and expanding its networks to ensure fans stay connected as well as possible.

According to Mark Feller, vice president of technology for the Arizona Cardinals, more Wi-Fi has been added to the stadium networks for this football season, including lawn areas just outside the stadium and the Pat Tillman Plaza area on the north side of the stadium. For the Super Bowl last year the venue had extensive DAS coverage outside from a Crown Castle deployment, but in an email message Feller said adding Wi-Fi to the mix was always part of the plan. Here’s Mark:

“Our plan from the start was to have Wi-Fi outdoors for our fans to use and we are rolling it out as time allows. We have such good weather that there are thousands of people tailgating on game days. In addition, the Cardinals Mobile App (from Yinzcam) provides live Stadium Feeds, Replays, and the Red Zone Channel so our fans can keep up with the early games while they are outside.”

Outside UoP Stadium, where the architecture allows for DAS antenna placement under the fascia as well as behind speaker covers.

Outside UoP Stadium, where the architecture allows for DAS antenna placement under the fascia as well as behind speaker covers.

Inside the stadium, Feller said there are now Gimbal beacons deployed for “selective messaging” alerts that are tied to the stadium app. The team also added a separate Verizon Wireless SSID to its Wi-Fi mix, giving Verizon customers reserved bandwidth as well as the ability to autoconnect. The Wi-Fi network uses Cisco gear and is managed and supported by CDW. At the Cardinals’ most recent home game, a 26-18 win over the Baltimore Ravens on Oct. 26, the Wi-Fi network carried 1.445 terabytes of data, with 22,502 unique connections, according to numbers provided by Feller. Out of the 63,500-seat stadium a maximum number of 19,559 concurrent users was seen that day, with the top sites connected to by fans being Apple, Facebook, Google, iCloud, Yahoo, Instagram, Twitter and ESPN, according to Feller.

Getting ready for the playoff championship

For both the biggest college game of the year (scheduled for Jan. 11, 2016) which like last year should be a big network event, as well as a host of other “big events,” like a U.S. Women’s soccer team game vs. China on Dec. 13 and the Fiesta Bowl on New Year’s Day, Feller said the UoP stadium team is continuing to expand the Crown Castle DAS as well, with more sectors in the stadium’s Club and Loft sections, as well as more coverage outside on the lawns. Portable Wi-Fi is also an option, Feller said, as the stadium adds temporary seating to expand for the big game of the collegiate season:

“Having the Super Bowl here did give us some ideas about increasing density in some areas where we put temporary seating. We tested some different WiFi portable enclosure systems that we could put up and take down quickly and figured out how to get cabling to them quickly as well. That will help us get set up for the CFP Championship.”

Kansas City Royals score with jump in postseason stadium Wi-Fi and DAS traffic

Royals fans at Kauffman Stadium enjoying the postseason. Credit all photos: Kansas City Royals (click on any photo for a larger image)

Royals fans at Kauffman Stadium enjoying the postseason. Credit all photos: Kansas City Royals (click on any photo for a larger image)

If you need a reason to justify Wi-Fi network installs or improvements in your stadium, here’s an optimistic rationale: If your team makes it to the playoffs and the championship, you can expect a big surge in postseason wireless traffic.

That idea was proven again this fall by the Kansas City Royals, who racked up big postseason Wi-Fi and DAS traffic numbers at Kauffman Stadium during their march to the 2015 World Series championship, including a 3.066 terabyte night on the Wi-Fi network for Game 1 of the World Series. That’s a 1 TB jump from last season, when Kansas City saw 2+ TB of Wi-Fi traffic during Game 7 of the 2014 World Series.

According to numbers provided by Brian Himstedt, senior director of information systems for the Royals, the Kauffman Stadium Wi-Fi network saw an average of 1.9 TB of aggregate throughput for the eight home games Kansas City hosted in the playoffs.

Fans cheering the Royals at Kauffman Stadium

Fans cheering the Royals at Kauffman Stadium

The average peak user count over those games was 11,850, with a high peak of 13,900 during Game 2 of the World Series. The stadium’s capacity for the postseason games, Himstedt said, was 40,500.

The postseason Wi-Fi traffic, Himstedt said, was approximately 34 percent upload and 66 percent download. During the regular season, the Kauffman Wi-Fi network had upload/download averages of 22 percent and 78 percent respectively, meaning that during the playoffs fans were probably more busy sharing information than obtaining it.

Overall, the postseason Wi-Fi numbers were much larger than the Royals’ regular-season stats, Himstedt said. Here are some of the regular-season stats during a summer that saw the network serve more than 180,500 unique clients on the Wi-Fi network:

— Average throughput per game: 625 GB
— High throughput, single game: 1.05 TB (Sept. 26)
— Average peak concurrent users per game: 5,150
— High peak concurrent users, single game: 7,500 (Opening Day, April 6)

The average attendance of Kauffman Stadium during the regular season was 33,900, Himstedt said.

Sprint DAS numbers also jump

And while the DAS at Kauffman Stadium is still awaiting full participation by all of the top wireless carriers, hometown favorite Sprint was active on the new system deployed by Advanced RF Technologies before the start of the season, and according to Sprint there were huge increases in DAS traffic compared to 2014.

Here are some DAS numbers from Sprint about the playoff traffic at Kauffman Stadium:

— Total tonnage for the 2015 eight game post-season was 2.6 terabytes

— Average tonnage per post-season game increased 4,000% in 2015 compared to 2014

— Sprint fans talked on their phones a total of 178,954 minutes in the post-season

— LTE connection rates for the 2015 post-season improved by approximately 40% compared to 2014

According to Sprint, the DAS supported all the frequencies used by Sprint devices, including the 1.9GHz, 2.5GHz and 800MHz bands.

NFL Stadium Tech Reviews — AFC South

Editor’s note: The following team-by-team capsule reports of NFL stadium technology deployments are an excerpt from our most recent Stadium Tech Report, THE PRO FOOTBALL ISSUE. To get all the capsules in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

AFC SOUTH

Reporting by Paul Kapustka

Screen Shot 2015-11-10 at 12.25.22 PM
Houston Texans
NRG Stadium
Seating Capacity: 71,054
Wi-Fi – No
DAS – Yes

With Super Bowl LI approaching in 2017, NRG Stadium is rumored to be (finally) getting Wi-Fi, with reports that the deployment will be led by 5 Bars and use gear from Ruckus Wireless; however none of this has yet been formally approved, so for now it’s another fall with no Wi-Fi at NRG.

Indianapolis Colts
Lucas Oil Stadium
Seating Capacity: 63,000
Wi-Fi – Yes
DAS – Yes

According to stats from this year’s Final Four basketball weekend, the Wi-Fi and cellular connectivity at Lucas Oil Stadium is working just fine, with just about 11 terabytes of traffic measured over the hoops-happy weekend. According to organizers, the stadium’s Wi-Fi carried more than 5 TB of traffic, which should prove stable enough for Colts fans this fall.

Jacksonville Jaguars
EverBank Field
Seating Capacity: 67,297
Wi-Fi – Yes
DAS – No

Jacksonville fans who are not inside one of the two pools at EverBank Field can use the free Wi-Fi provided by Extreme and SignalShare, with bandwidth provided by Comcast. EverBank also has Wi-Fi “coaches” to help fans connect to the network, reportedly wearing bright yellow hats.

Tennessee Titans
Nissan Stadium
Seating Capacity: 69,149
Wi-Fi – Yes
DAS – Yes

Another outfit by Extreme Networks, Titans fans are into the second year of stadium-wide Wi-Fi, at the newly named “Nissan Stadium” thanks to a sponsor change this summer.

Stadium Tech Report: Wi-Fi arrives at the Green Bay Packers’ legendary Lambeau Field

Lambeau Field, home of the Green Bay Packers, now has Wi-Fi for fans. All photos: Green Bay Packers (click on any photo for a larger image)

Lambeau Field, home of the Green Bay Packers, now has Wi-Fi for fans. All photos: Green Bay Packers (click on any photo for a larger image)

When most NFL fans think of the Green Bay Packers and Lambeau Field, they think of frozen tundra – of Vince Lombardi roaming the sideline in his thick glasses and peaked hat, with visible breath coming through the face masks of behemoth linemen on the field. In the stands, they see the venerable fans braving the cold of northern Wisconsin in their snowmobile suits, with mittens wrapped around a bratwurst and a beer.

But do they think of those same Packers fans pulling out their iPhones and Samsungs to take selfies, and posting them to Instagram or Facebook? Maybe not so much.

The reality is, however, that in 2015, football fans in Green Bay are pretty much like fans anywhere else when it comes to wanting to use their mobile devices while at the game. So to make sure the Lambeau Field fan experience remains at the top of the league, the Packers teamed up with Extreme Networks and Verizon Wireless to bring a fan-facing Wi-Fi network to Lambeau this season, one that will likely be heavily used even at the risk of frostbitten fingers.

Editor’s note: The following profile is an excerpt from our most recent Stadium Tech Report, THE PRO FOOTBALL ISSUE. To get all the profiles in one place as well as our featured reports, interviews and analysis, download your free copy of the full report today.

Bringing the beast to the bowl

With more than 1,000 Wi-Fi access points installed throughout the stadium, the already-live network in Green Bay is the culmination of a 2-year project that started with an overhaul of the venue’s distributed antenna system (DAS), a task completed last year by Verizon, which acts as the DAS neutral host.

According to Wayne Wichlacz, director of information technology for the Packers, the second step of putting in and turning on a full-stadium Wi-Fi network required a lengthy search and qualification process, to ensure that the partners could deliver in the face of big challenges that exist in bringing wireless technology to a historic and legendary facility like Lambeau Field.

Wi-Fi APs visible on press box structure

Wi-Fi APs visible on press box structure

Even the most casual of NFL fans probably has some knowledge of Lambeau Field, which has known more than its share of history since opening in 1957. The glory years of the Packers of the 1960s, when coach Lombardi and quarterback Bart Starr won the first two Super Bowls, helped cement the Green Bay “Titletown” lore, and the famous “Ice Bowl” game of Dec. 31, 1967, between the Packers and the Dallas Cowboys, gave birth to the “Frozen Tundra” nickname for the big concrete circle on Lombardi Avenue.

That big bowl, which has been added to significantly since its opening, now can seat 81,435 fans, making it the third-largest in NFL seating capacity, behind only AT&T Stadium in Dallas and MetLife Stadium in New Jersey. Though Lambeau Field previously had Wi-Fi networks for internal business purposes as well as for some suite and premium seating, bringing Wi-Fi to the full stadium was a task of a different magnitude, Wichlacz said.

“It’s a different beast to bring [Wi-Fi] to the bowl,” Wichlacz said.

The two big challenges for Wi-Fi deployment at Lambeau revolved around aesthetics and placements; as a historic and legendary structure, extreme care needed to be taken to make sure Wi-Fi gear placements didn’t detract from the visual experience and old-time charm. And just to make that first task tougher was the challenge of finding enough places for Wi-Fi APs in a facility that is mainly a big open bowl, without much overhang space for mounting.

And don’t forget about the large amount of metal-bench seating, which took away the opportunity to install under-the-seat APs.

“There’s just not a lot of levels [in Lambeau] for us to do things,” Wichlacz said. “It was a real installation challenge.”

After putting out an RFP that took all the necessary considerations into play, Wichlacz said the Packers evaluated proposals from all the major players in the large public venue Wi-Fi gear market before finally settling on Extreme, which has a solid history of NFL stadium deployments. After picking Extreme in the middle of last year, construction got underway in early 2015, Wichlacz said.

On the Extreme side, the company knew it was deploying on the NFL equivalent of hallowed ground, said Norman Rice, executive vice president for marketing at Extreme.

“A lot of additional work went into the design, in part because Lambeau Field is a historical site and such an iconic part of the landscape in the NFL,” Rice said. “We did a lot of unique stuff to get to what a Packers fan expects.”

Yellow paint and handrail enclosures

If most NFL fans are familiar with the Packers’ traditional gold and green colors, so now are the Wi-Fi deployment teams from Extreme and the Packers, who spent a good part of the deployment time painting APs to blend in to the stadium scenery. That meant green for antennas mounted up against certain building sections, and the bright yellow for the handrail antennas that Extreme used to help bring signals down into the rows of the bowl.

“We did a lot of unique stuff,” said Extreme’s Rice. “There are some pretty cool enclosures, where the yellow blends right into the walls.”

“If you’re looking for it, you can probably find it,” said Wichlacz of the painted antennas. “But it blends in pretty good.”

Lambeau bench seating with railing-mounted Wi-Fi APs

Lambeau bench seating with railing-mounted Wi-Fi APs

To gain some important real estate for wireless components, the Packers and their partners actually relocated the team’s signage listing the names of Packers inducted into the Pro Football Hall of Fame, raising it up one level and using it as a way to mask Wi-Fi and DAS gear.

“You can actually see the [names] better now, and we were able to put Wi-Fi and DAS antennas in there,” Rice said. “It’s a nice piece of work.”

All the aesthetic work had to also be blended with the technical requirements of antenna placement, to ensure good coverage without interference. Jacque Vallier, the Illinois/Wisconsin regional executive director of network for Verizon Wireless, compared Lambeau Field to the older college stadiums, the large concrete bowls that are among the hardest structures to bring services to.

“It definitely was an RF and engineering challenge,” said Vallier of the DAS design. Vallier said that AT&T is currently a client on the Verizon neutral DAS, which uses CommScope gear. The DAS also covers the parking lot areas outside Lambeau Field, where tailgating is a high art.

Separate SSID for Verizon Customers

Like other NFL deployments where Verizon is a major sponsor, the Lambeau Field Wi-Fi network will have two separate SSIDs, one reserved for Verizon Wireless customers, and the other for everyone else. According to Verizon’s Vallier, the Verizon subscribers will have access to about 40 percent of the Wi-Fi bandwidth, with some devices supporting automatic authentication to the service. Verizon and Extreme have a similar deployment at CenturyLink Field in Seattle.

According to Extreme’s Rice, the mix of network usage is tuned to ensure that all fans who are seeking Wi-Fi connectivity will have more than enough bandwidth. Both the Verizon-specific network and the public network (which run off the same Wi-Fi gear) will meet or exceed the NFL’s Wi-Fi requirements, he said.

“It’s done to ensure Verizon customers have a good connection, but not at the expense of other users,” Rice said of the split SSIDs. Verizon, which is a big sponsor of the NFL in general (including its $1 billion payment for live-action rights on smartphones for its NFL Mobile app), is also a sponsor of Wi-Fi networks at NFL stadiums in Detroit and Denver.

As a final Green Bay touch, the Extreme “Wi-Fi coaches” program, which trains people who wander the stands on game days helping fans to get connected to the network, will use area high school students as “coaches,” fitting right in with the family-friendly atmosphere that the Packers are famous for.

“It’s really going to be cool to tie the coaches program to the community through the schools,” Extreme’s Rice said. “It’s great fun to be part of that.”

Can’t test the network until the stadium’s full

When it comes to large public venue deployments, there is the Wi-Fi network you design on paper, the network you build, and then the network that happens when the venue fills up with users. Thanks to the mid-year completion of the Lambeau Field network, Wichlacz and his IT team were able to test the Wi-Fi network in several “beta” situations, which included a Kenny Chesney concert and a Brett Favre celebration that filled the bowl.

Wave the flag, Wi-Fi has come to Lambeau Field! Photos: Green Bay Packers

Wave the flag, Wi-Fi has come to Lambeau Field! Photos: Green Bay Packers

“Testing network theory versus having people [using the network] is night and day,” Wichlacz said. Live tests, he said, “give the engineering folks the ability to test and tweak. It’s definitely helpful to have those events.”

And if there was any doubt that fans at Lambeau Field want to use their devices, Verizon’s Vallier can help end the debate.

“During the second preseason game we saw more than 500 gigabytes of traffic [on the DAS],” Vallier said, noting that totals so far are pointing to be one-and-a-half times bigger than in 2014.

And though Wichlacz is reticent to provide exact Wi-Fi data usage numbers, Extreme’s Rice said one of the Packers’ preseason games recorded “one of the highest [Wi-Fi usage] numbers we’ve ever seen.”

That figure seems to answer a question Rice said the team had asked itself earlier, about whether or not the Green Bay Packers and their fans needed stadium Wi-Fi. “There was a time when they [the Packers] had a big question, about if it mattered,” Rice said. Now that the Wi-Fi network is in, he said, “it’s amazing to see how much people use it.”

Wichlacz noted that Packers fans may not need to worry about frozen fingers, since the team has more home games earlier in the season this year. But he also remembers Verizon stats from the DAS last season that showed usage didn’t go down that much when the temperature got cold.

So – if you make it to Lambeau Field from now on, make sure you soak in the atmosphere and if you care to, share it with the world via Wi-Fi – something you can do now with ease thanks to the hard work from the Packers and their partners.

“For our whole team here, it’s been a labor of love,” Wichlacz said. “We spent a lot of hours working on this. We’re excited to launch it, and correct it as we go.”

Levi’s Stadium, AT&T Stadium see lots of Wi-Fi for Seahawks visits

Seahawks vs. Cowboys at AT&T Stadium, Nov. 1. Photo: Dallas Cowboys

Seahawks vs. Cowboys at AT&T Stadium, Nov. 1. Photo: Dallas Cowboys

So far this NFL season we’ve seen something that we call the Patriots effect, where games featuring the defending Super Bowl champs as visitors produce big numbers on the stadium Wi-Fi networks. There appears to be a similar trend following the Seattle Seahawks around, especially when they’re playing NFC rivals like the San Francisco 49ers and the Dallas Cowboys, as both those teams’ stadiums saw big Wi-Fi days during recent Seahawks visits.

The Niners were first to get a Seahawks effect, carding 2.2 terabytes of Wi-Fi network usage during Seattle’s 20-3 victory over San Francisco at Levi’s Stadium on Oct. 22. According to figures provided by Roger Hacker, senior manager of corporate communications for the Niners, out of the 70,799 in attendance for the Thursday-night game there 16,299 unique users on the Wi-Fi network at Levi’s Stadium, with a maximum concurrent user number of 10,306.

Screen Shot 2015-11-03 at 10.16.54 PM

Last Sunday at AT&T Stadium, the Seahawks escaped with a narrow 13-12 win in front of 91,486 fans. According to figures provided by Dallas Cowboys chief information officer John Winborn, there were 36,388 unique users on the Wi-Fi network, with a peak of 24,667 concurrent users. The total tonnage used Sunday at AT&T Stadium was 4.12 TB, perhaps proving once again that 4+ TB is becoming the “new normal” for high-fidelity networks in the largest stadiums.

Nokia deal part of new wholesale/white-label strategy for Artemis Networks

Artemis Networks founder Steve Perlman. Credit all photos: Artemis Networks

Artemis Networks founder Steve Perlman. Credit all photos: Artemis Networks

A deal by startup Artemis Networks to provide test deployments of its pCell wireless networking technology to select Tier 1 phone-network customers of telecom equipment giant Nokia Networks is both a “coming out party” as well as a significant shift in the Artemis business strategy, from a consumer and end-user focus to a wholesale, business-to-business plan.

Though no actual customers, users or live pCell networks have yet been announced, Artemis founder and CEO Steve Perlman said he can see the end to the “long and winding road” toward real-world deployments that officially started when Artemis went public with its ideas back in February of 2014. “We look at this [the Nokia announcement] as our coming-out party,” said Perlman in a phone interview with Mobile Sports Report. “You’ll be seeing [customer] announcements soon.”

In addition to the Nokia “memorandum of understanding,” which says that Nokia and Artemis will “jointly test Artemis pCell wireless technology in 2016 with wireless operators, initially in large indoor venues and other high density areas,” Artemis also announced a shift in its plans for its expected commercial network in its home town of San Francisco, which was originally supposed to launch this past summer. (For a detailed explanation of Artemis technology, scroll to the end of this post and its links.)

From consumer network to wholesale provider

Instead of operating its own network as originally planned and selling access to consumers, Perlman said Artemis will sell LTE capacity wholesale to any interested network provider as soon as the now-approved network is completed. Artemis, which obtained a lease of spectrum from satellite provider DISH, is now setting up antennas on 58 rooftops in San Francisco, Perlman said, after finally getting FCC approval for its plans a little later than expected.

pCell antenna from Artemis Networking

pCell antenna from Artemis Networking

And instead of having to outsource or build its own customer-facing signup, billing and other back-end systems, the 12-person Artemis will instead sell capacity on its San Francisco network to any interested provider. According to Perlman, there are customers ready to buy, even though none are yet named. Potential customers could include MVNOs (mobile virtual network operators) like TracPhone, who don’t own their own networks, or other larger providers looking for roaming capacity or cheap LTE in the crowded city by the Bay.

While it’s less cool than having its own branded devices and network, being a wholesale provider makes sense for the small-size Artemis, instead of trying to compete with wireless giants like Verizon Wireless and AT&T. “Wholesale [capacity] was a market we really didn’t know existed,” said Perlman. “And when they [potential customers] told us what they would pay, it was easy to see B2B as being the way for us.”

Big customers more comfortable with big suppliers

On the networking gear sales side, Perlman said that teaming up with a big equipment provider like Nokia was a necessity to get any traction in the world of LTE cellular networks. As we said before, though pCell’s projected promise of using cellular interference to produce targeted, powerful cellular connectivity could be a boon to builders of large public-venue networks like those found in sports stadiums, owners and operators of those venues are loath to build expensive networks on untested, unproven technology. And big metro wireless providers are even more so.

“We had a lot of Tier 1 operators tell us ‘we love this [pCell technology], we really need this, but we’re not buying from a 12-person startup,’ ” said Perlman. So even while Artemis’ radio technology — which promises huge leaps in performance compared to current gear — was attractive, the company’s lack of any kind of integration with the boring but necessary part of telecom infrastructure, including billing and authentication systems, held it back, Perlman said.

“We were told we could get things done more instantly if we partnered with a large infrastructure company,” Perlman said.

And while real customers from the Nokia deal will probably surface first in a stadium or other large public venue — since such a deployment would be easier to test and install than a new metro network — one team that won’t be using pCell technology any time soon is VenueNext, the app provider for the San Francisco 49ers’ Levi’s Stadium. Though VenueNext was publicly listed as a testing partner last spring, VenueNext has not commented on any results of any testing, and according to multiple sources there was no testing of Artemis equipment at Levi’s Stadium this summer. Though it develops the application and backend systems only, VenueNext does need to work closely with equipment providers, like Aruba Networks at Levi’s Stadium, to integrate its app functionality with the network.

Perlman, who also confirmed there was nothing brewing anymore with VenueNext (“but we’re still friends with VenueNext”), said the app developer also preferred to work with a larger-size developer than the short-bench Artemis. VenueNext, which recently announced the NBA’s Orlando Magic as its second stadium-app customer, has said publicly it would announce an additional 29 new customers before the end of the calendar year.

“We [Artemis] could probably go and do one stadium,” said Perlman about his company’s deployment abilities.

Wi-Fi thrown in for free

And while the main business for Artemis out of the gate will probably be in adding capacity to LTE networks that are running out of spectrum, Perlman said that having Wi-Fi support built into the pCell equipment could make the technology attractive to venues who need or want to bring Wi-Fi services to fans. The Wi-Fi version of pCell technology was also an after-the-fact idea that surfaced after the original pCell announcements.

“The pWave radio heads have [support for] all LTE bands and both Wi-Fi bands,” Perlman said. “So everything that Nokia does [with pCell deployments] can also do Wi-Fi. That’s pretty exciting.”

What’s yet unknown is how the ongoing acquisition of Alcatel-Lucent by Nokia may affect any potential pCell deployments. In the best possible scenario for Artemis, the acquisition could provide more entry points if the pCell technology gets integrated with Alcatel-Lucent telecom gear.