MSR Profile: San Francisco Giants, AT&T Continue to Push the Wireless Envelope at AT&T Park

It’s fun to look back at the news from 2004 to see just how novel an idea it was to put a Wi-Fi network into a ballpark. “SBC Park a hot spot for fans lugging laptops,” said an article in the San Francisco Chronicle, complete with a photo of a fan hunched over a laptop. According to the story, some 200 fans per game might have used the network right after it was launched. Woo-hoo!

Fast forward to 2012, and here are some eye-popping stats from a recent Giants homestand against the Cubs: According to the Giants and AT&T, at one game there were 10,000 fans using the stadium’s Wi-Fi network, and another 10,000 connecting via the various cellular antennas — all using a data app, not even counting phone calls. Still think this is just something for power geeks trying to program in between innings? Or has the wireless fan finally become mainstream?

As impressive as those totals are, what’s a more compelling story is the fact that the Giants and AT&T were ready for that bandwidth demand, with a layered cellular and Wi-Fi network that overdelivers, instead of dropping connections. Why did they put the network in, and how did they make it a success — and a role model for stadiums and teams everywhere? To get the answer to those questions, Mobile Sports Report recently spent a couple hours at the ballpark with Bill Schlough, senior vice president and chief information officer for the San Francisco Giants Baseball Club, and Terry Stenzel, vice president and general manager for Northern California and Reno for AT&T, to hear about lessons learned and where wireless and sports are headed in the future.

The Super-Connected Fans of San Francisco and Silicon Valley

Back when AT&T was still known as SBC, the ballpark with its name seemed as likely a place as any to put in a wireless network. Though it wasn’t even the first in the Bay area — Candlestick Park, former home of the Giants and still host to the football 49ers, had some limited wireless access back in 2000 thanks to then-stadium-naming sponsor 3Com — the network that went live at the China Basin ballpark in 2004 was well received by the wired constituents of the greater SF Bay area. After all, this was Silicon Valley — where folks didn’t mind going to Best Buy to get a wireless LAN card to put in a PCMCIA slot.

The Giants' Bill Schlough, in orange shirt, talks about stadium Wi-Fi. Credit: John Britton, AT&T.

For the Giants and Schlough, every year afterward it became apparent that the initial outlay of 121 Wi-Fi access points wasn’t going to be enough. The 50 bearded guys with laptops from the Valley became a few hundred a night, then pushed into the thousands. By 2010, the network-use number was up to 3,300 per game, with no end in sight to its growth.

“I point to the fans” when asked about where the vision for the network comes from, said Schlough. “In any other city it’d probably be different — anywhere else is probably a couple years behind [in network demand]. Fans here are making it apparent that if they can’t stay connected they’re going to stay home. What we need to do is stay one step ahead.”

Lately, that means staying ahead by blending cellular and Wi-Fi networks, using a “layered” approach that improves not only Wi-Fi coverage inside the stadium, but also reception for 2G, 3G and 4G LTE cell phones. It even means reaching out to rival Verizon Wireless, which is in the process of attaching its own wireless services to the Giants’ stadium network, so that Verizon customers can enjoy improved coverage just like AT&T customers do when in their seats. Even with network loads of 20,000 combined users, the Giants and AT&T right now seem like they’re ahead of the technology curve; but even fairly recently, that wasn’t always the case. Take the start of the 2009 season, when the network became, as AT&T’s Stenzel said, “an absolute disaster.”

A Network Brought to its Knees — by Apps and the iPhone

Perhaps fueled by the twin arrivals in 2008 of the iPhone 3G and the accompanying Apple Appstore, the fan demand for in-stadium bandwidth completely overwhelmed the AT&T Park network at the start of the 2009 season, an epic fail that was quickly noticed by many. The surge in wireless data demand — which also caught AT&T by surprise at that year’s South by Southwest Interactive conference, where iPhones and Twitter brought the network in Austin to a halt — was a harbinger of the future, forcing cellular providers everywhere to scramble to upgrade their networks.

AT&T VP Terry Stenzel points to a Wi-Fi antenna inside a suite at AT&T Park. Credit: John Britton, AT&T.

While Schlough and AT&T responded by doing what they could to fine tune and increase wireless bandwidth, the duo also started installing what is known in the cellular industry as DAS — short for Distributed Antenna System, basically an array of small cellular antennas that improve coverage by bringing the wireless signal closer to the customer. For AT&T Park, that means as close as inside the hallway of the stadium’s suite level, where DAS antennas disguised by small plastic inverted cones keep the well-heeled fans and their inevitable iPhones connected to the outside world.

The DAS antennas help provide what Schlough and Stenzel call their “layered” approach to wireless connectivity, meaning that a blend of Wi-Fi and improved cellular is the best way to achieve the highest level of connectivity. With a layered approach, some fans can use the Wi-Fi network while others use the cellular network — hopefully, using the best signal where it is available.

“The stadium is the perfect example of what’s going on in the outside world,” said AT&T’s Stenzel, whose company of late is investing heavily in both DAS and Wi-Fi for public hotspots in cities, big buildings and campuses to offload some of its cellular-network demand. “You can’t build a network with Wi-Fi only or [4G] LTE only. You need layers of technology.”

The Giants' Bill Schlough in front of some hard-working wireless network hardware. Credit: John Britton, AT&T.

“Cellular sometimes flows better around obstacles or people,” Schlough said. And he should know, since he said he’s always finding new ways to improve the network.

“Thank god we’re not football,” said Schlough. “This isn’t something that you plug it in and it works. We have 81 games a season here, and every day we’re learning something.”

Trials, Errors, and ‘Leaky Coax’

For Giants fans or even other visitors, Schlough has a wireless quest: “I’d challenge anyone to walk in here and find 100 antennas,” he said. With 334 Wi-Fi access points and 196 additional DAS antennas scattered about that seems like it might be easy. But even certified network geeks probably couldn’t spot the DAS antenna that Schlough said was in plain sight, providing access to the outdoor seats on the suite level.

Can you spot the DAS antenna? Look inside the pipe. Credit: Paul Kapustka, MSR.

While your reporter valiantly looked for a telltale wireless box, it was in vain. Schlough finally solved the puzzle by turning us around and pointing at a black-painted conduit pipe just above the seagull net — inside which Schlough said was some leaky coax, or partially unshielded networking cable that allows a signal to pass through parts of its length, in essence acting as a long, thin “antenna.”

“You’ve got to get creative” to solve stadium networking problems, said Schlough, whose team needed to point Wi-Fi antennas upward to serve three rows of upper-deck seats that are located in front of a thick concrete wall. In some parts of the stadium, Wi-Fi antennas are painted dark green to match the stadium metalwork. In the suites, Wi-Fi antennas are tucked into plastic housings that look like smoke detectors, and some DAS antennas are inside small inverted plastic cones — all painted the same color as the ceilings to blend in like wireless chameleons.

“The biggest challenge may be in hiding all the wires” connecting the antennas, Stenzel said. “Nobody wants to see wires hanging down in a stadium.”

One App Will Rule Them All — Unless the Giants get to Tinker

Perhaps the only place where Schlough, the Giants and AT&T have had to take a step backwards — our opinion, not theirs — is on the application side. Until last year, the Giants led in the app innovation arena as well, with a service called “Digital Dugout” which provided lots of AT&T-specific information, like park maps, food ordering, and extended Giants video highlights, among other features. But as part of Major League Baseball the Giants are now in lockstep with the rest of the league and only offer MLB.com’s AtBat app as the in-game app of choice — a strategic move made by the league last year to increase the profitability of its flagship online app and service.

The white inverted cone? A DAS antenna in the AT&T Park suite level hallway. Credit: Paul Kapustka, MSR.

“When we were building the network up and had 3,300 users per game in 2010, there was nobody else doing what we did, and nobody had an eye on us,” Schlough said. Now, with in-game network usage nearing 30 percent plus, the moneymen of baseball aren’t just looking at in-stadium apps, they already have a strategy to put a network in every stadium, and get every fan there using AtBat. What Schlough hopes is that MLB will let teams leverage and add their own features and garlic-fries flavor to the AtBat app, an idea that hasn’t yet reached any conclusion.

“We’re working with MLB to see if we can add any [local] functionality to AtBat,” Schlough said. “We’re the first team to dip our toes into that water.”

Internally, the Giants have become big wireless users themselves. According to Schlough the team now uses its wireless network to run tasks like ticketing, some concession kiosks, the media needs and digital message boards. That’s probably why the team now has two full network-operation rooms in the bowels of AT&T Park, crammed with every flavor of telecom gear from 2G, 3G and 4G cellular to Wi-Fi controllers and a whole assortment of Internet routers, servers and other associated rack-mounted hardware sporting the logos of companies like Cisco, Juniper, Dell and HP.

Can you see the Wi-Fi antenna? It's the green box on the left with two tubes. Credit: Paul Kapustka, MSR.

But after spending some $10 million to build the network over time — a cost shared by the Giants and AT&T, whose unique relationship is intertwined in the stadium sponsorship — in the end, it’s about the fan experience and ensuring fans stay for the experience that keeps Schlough, Stenzel and their teams running to stay in the lead.

“The most common app we see used at the games is maps,” said Stenzel. “It’s all about, ‘where am I going from here,’ for dinner or drinks. A ballgame is a social event, a fan experience that you’re going to remember.”

As long as you stay — and stay connected, that is.

“Now if the DAS goes down, people leave,” Schlough said. And you get the feeling that he was only half joking.

Not-so-Mobile Sports Report: U.S. Open Notebook, and The Beast that is No. 16

A quick disclaimer: Even though we are Mobile Sports Report, where we are “aggressively covering the growing intersection of sports, mobile technology and social media,” at our hearts we are sports fans first and when given entree to an event like the U.S. Open, well we just can’t help ourselves. So here is a not-so-necessarily Mobile Sports Report notebook on fun and interesting stuff we saw and heard at The Olympic Club so far this week:

The Beast that is No. 16

If you are tired of the pros regularly turning par 5 holes into a driver-wedge-eagle, you are going to love No. 16 at the Olympic Club. From some new back tees the hole will play 670 yards long, the longest ever U.S. Open hole. Our quick video taken today from the approximate middle of the hole looks way back toward the tee, then swings toward the green, not really doing the left-curve banana justice.

Do the players like it? Doubtful. With only two par 5 holes on the pros’ scorecard, No. 16 is the first and it will mess with the head of the average tour pro, who when he sees a “5 par” starts thinking birdie. There were all sorts of dire predictions about 16 today, with some players guessing it could serve up the highest scores all weekend. Masters champ Bubba Watson at his press conference said that during his practice round Tuesday he teed off from the back tees and hit driver-driver, “hit two perfect shots,” and still ended up 60 yards short of the green.

The last word went to Phil Mickelson, who was asked after his formal press conference if he thought 16 was unfair.

“Unfair? I’d never say it’s unfair,” said Mickelson. “It’s just not a good hole.”

But No. 17 May Be Worse

After the brutally long No. 16 the Open field will be confronted with No. 17, a seemingly “easy” par 5 at only 522 yards. Though the distance shouldn’t keep some from hitting the green in 2, what will really vex the players is the hole’s slope — it is banked as steeply as the curves at Daytona, dropping some 20 to 30 feet from side to side. The picture here doesn’t do it justice, looking up from the right side of the fairway. It’s safe to guess that a lot of drives that land in the fairway will end up sliding down into the rough, where it will be almost impossible to reach the green in two.

The 17th fairway at Olympic Club, looking up from the right hand side. Credit: Paul Kapustka, MSR.

And getting to the green isn’t necessarily the final chapter here. The green slopes left to right too, and the chipping area behind the right edge of the green is shaven smooth, meaning that mis-hits to the right side — or even too-strong putts from the left — may end up 30 to 40 yards down the hill in a small group of trees, where you can’t air a chip back up because of the branches and you can’t bump one up because the ball just keeps rolling back down. When you are watching on TV or online, watch for train wrecks at 17.

BONUS UPDATE: Check out the videos of balls rolling off the green, courtesy of Stephanie Wei.

Text, text, text

One surprising fact learned during watching some practice rounds today: Pro golfers are texting fiends, often typing away on their mobile devices up until they hit a shot, and then again right after. After admiring the low, bullet trajectory of Charl Schwartzel’s second shot on No. 16 we looked back and before the ball had even landed Schwartzel had his device out and was typing away as he walked up the fairway. We saw other golfers texting on the tee box, right up until their playing partner was in his backswing. Who says it’s the fans who are the only over-cellular culprits?

Only in San Francisco…

Would you see a Deadhead tie-dyed t-shirt with the U.S. Open logo. Wonder if it comes with a free medicinal license? So far in our limited wanderings around Olympic we haven’t caught a whiff of San Francisco’s favorite treat, and we ain’t talking about Rice-a-Roni. But you can bet more than a few of these will sell this weekend.

NBA Pros Stephen Curry, Brandon Jennings Will ‘Hang Out’ on PlayUp App During NBA Finals

Fan interaction app PlayUp has announced that it will be hosting a couple NBA pros — the Golden State Warriors’ Stephen Curry and Milwaukee Bucks’ Brandon Jennings — who will “hang out” in special PlayUp chat rooms during the NBA Finals.

Up first tonight is Golden State’s Curry, “hanging out” in a virtual room on the PlayUp app. If you’ve never tried PlayUp the pro player rooms are a good way to start, since the pros and fans are motivated to have a good interaction. We checked out one such interaction during the NCAA tournament and found it interesting.

“PlayUp is once again offering fans an incredible opportunity to connect with two of the most likeable
budding superstars during what is sure to be an exciting and memorable NBA Finals,” said PlayUp USA
CEO Dennis Lee in a press release. “We are extremely proud to offer a platform for Stephen and Brandon to showcase their
great personalities to fans.”

(If you don’t have the PlayUp app installed yet you can get it here.)

Early Thursday U.S. Open Coverage of Tiger-Phil-Bubba Group Only Available Online

Getting psyched to watch the incredible first-round pairing of Tiger Woods, Phil Mickelson and Bubba Watson Thursday at the U.S. Open? If so you better have an Internet connection or a smartphone with a good cell signal, because the first 90 minutes of that group’s play will only be available online or through the USGA’s mobile app.

Though there’s going to be a ton of regular TV coverage of the Open this week, first from ESPN on Thursday and Friday and then NBC on the weekend, it’s kind of cool that the somewhat staid USGA (an organization that bans cell phones on the course during tournament play) is highlighting its digital chops in this manner.

Starting a 7:33 a.m. Pacific time from the No. 9 tee at the Olympic Club, you can watch Tiger, Phil and Bubba only at usopen.com or via the U.S. Open Golf Championship app, which is available for iPhones and iPads and Android devices. The live online TV at the Open is powered technically by IBM, the same folks who are the technical brains behind the Masters’ excellent online coverage.

“Mobile is an increasingly strategic part of our marketing strategy,” said Joe Goode, managing director of communications for the USGA. “It’s an interesting group and for the first round USOpen.com and the apps will be the only way to watch the first 90 minutes.”

The online coverage of the marquee group will continue throughout their round, so you can keep watching online if you can’t get to a TV screen when ESPN comes on live at 9 a.m.

USGA Considering Allowing Cell Phones on Course — But Not This Week

It looks like the USGA was ready for questions about its cell phone policy, as executives from the country’s governing body of golf were all on message Monday saying generally positive things about considering allowing cell phone use during tournament days in the future — while keeping its ban in place for this year’s U.S. Open in San Francisco.

“We’re comfortable with the current policy [of banning cell phones during competition days] but also looking about what to do for the future,” said Joe Goode, managing director of communications for the USGA, in a quick press-room interview Monday.

The question of fans using cell phones on courses is a hot topic given the recent incident at the Memorial tourney in Ohio, where star player Phil Mickelson withdrew reportedly in part because of too many fans snapping cell-phone pictures while he was trying to golf. This year the PGA has allowed fans to have cell phones at all events for the first time. However, major tourney organizers like the Masters and the USGA (which conducts the U.S. Open) set their own rules, and for the Open this week fans won’t even be allowed to bring cell phones to the course once competition starts on Thursday. On practice days like Monday fans can bring as big a camera as they want, apparently. And nobody seemed to care that I was snapping some photos with a cell phone, though maybe it’s because I had a media badge around my neck.

Media and other VIP folks at the Open may bring cell phones in for use in approved areas like the press tent, but today we had to pass through metal detectors and get a special sticker for our cell phones to show they were approved devices, which seems a bit extreme. But it seems like Goode and other USGA types (including top boss Mike Davis, who told ESPN’s Bob Harig about the same thing) are recognizing that cellular phones have already become as regular a pocket or purse companion as a wallet or car keys, and that all-out bans seem a bit stone age, especially to folks who rely on them for important communications to family members, to work or just for posts to Twitter.

What Goode seemed to be saying — and I am paraphrasing here — is that the USGA gets it, they’re not going to ban phones forever, and they believe that there probably is a way to do things that works for fans as well as sensitive players.

They’re just not ready to say exactly what it is, though, so after Wednesday it’ll be time for fans this year to leave their cell phones at home.

But hey, you can always use the phones at tents like this one to call people — but who uses a phone to make calls anymore? What they really need — and I think some PGA stops like Pebble Beach have already tried things like this — is special areas around the course with Wi-Fi access, where fans can get their online Jones without having to bug Phil or Bubba. Now if the Open here in San Francisco had a Twitter tent, that would be forward thinking and hometown cool. Maybe some Twitter folks can jump on BART and do some kind of foo-camp setup (with appropriate sponsoring dollars) before Thursday?

(All images credit Paul Kapustka, Mobile Sports Report; courtesy of The Olympic Club and the USGA.)

U.S. Open Gets Twitter-Crazy During Day 1

Even though Mobile Sports Report is covering the U.S. Open live and in person, we almost didn’t need to be at the Olympic Club to get a feeling for what was going on, thanks to the multitude of tweets resonating Monday around golf’s biggest event.

With no cell-phone ban yet in place (that doesn’t happen until competition starts on Thursday) there were plenty of certified folks with mobile cellular devices, transmitting 140-character messages as well as pictures and videos from the fairways, greens, practice facilities and sponsor tents hovering on the southwest edge of San Francisco, one hill removed from the Pacific Ocean.

But why just talk about the tweets? Thanks to technology we can share some of our favorites. Why not start with the tour’s hottest player, last weekend’s champ Dustin Johnson, who tweets pretty darn regularly at @DJohnsonPGA. DJ today hit us with a bunch of pictures of his practice day at Olympic, which included a visit with the Most Interesting Man in Golf:

Golf writer extraordinare Geoff Shackelford was a twittering man possessed Monday, shooting little bits of video as well as cool snaps — like this one of USGA executive director Mike Davis greeting 1955 Open winner and Hogan-killer Jack Fleck.

Maybe the best place to get a wide fix of overall U.S. Open tweets was the Open’s own live updates page (which just shows up as “Twitter” on the USGA mobile app). That’s where we found out that Luke Donald, aka World No. 1 is cool enough to RT an answer to a fan request for a photo:

(Don’t everyone tweet @ Luke at once now.)

ESPN talent Scott Van Pelt also arrived on scene, and gave us all a view of his “office” for the week:

And the gear sponsors were all out tweeting heavily as well. From our friends at Nike Golf, a faraway picture of the Man, El Tigre himself:

With two more practice days we expect more tweets to be flying the innerwebs way from Olympic, even with its challenged cellular reception. Our favorite of the day comes from another recently smokin’ player and a personal MSR favorite (we so wanted him to win the PGA last year), Jason Dufner. Apparently the Duf is getting some good travel guides to the more lively areas of town. However it appears he may not be ready for the clothing-challenged scenery:

C’mon, Duf, it’s called the Castro — and it was hot out today! Just wait, they will probably be in your gallery tomorrow!