Game Theory & Super Bowl XLIX

Shortly after Super Bowl XLIX,  there was an interesting opinion piece in the New York Times by Justin Wolfers. The subject was Game Theory application in the waning seconds of the recent Super Bowl. You can access the article here:

http://www.nytimes.com/2015/02/03/upshot/game-theory-says-pete-carrolls-call-at-goal-line-is-defensible.html?_r=0&abt=0002&abg=1

I agree with the main premise of Mr. Wolfer’s position – namely that from a game theory strategy perspective a “mixed strategy” (i.e., one without a lean in either direction – run or pass – and indeed one which is applied randomly when outcomes are likely to be similar) is the best approach. There are however additional game theory points to be made and a more advanced application of Game Theory methodology sheds additional insights.

First, a few indisputable points …

  • Time was of the essence. This was a function of a conscious decision by Belichick to not call a time out and let time run down. The result is that there was time for three plays of which two could be run plays and possibly… but not with certainty… three run plays.
  • The ball was at the one yard line and it was 2nd down with the clock running.
  • Marshawn Lynch was roughly 1 for 5 at “punching the ball in” from the one yard out during the preceding games for Seattle in this season. However, New England was not necessarily known as a stalwart defensive line team … the lone exception being nose guard, Vince Wilfork.
  • An analysis of all NFL games for the season indicated a very similar rate of success (defined as a touchdown) from the one yard line, whether running or throwing. That is to say the “expected payoff” of either a run or a loss from the one yard line was virtually the same.
  • Seattle had one timeout remaining and trailed 24-28 with 26 seconds remaining.
  • A touchdown (and extra point) wins the game and would require a Patriots Field Goal for overtime. Merely kicking a field goal does not earn enough points to go into overtime and as such the option was fully off the table. Basically, the game was on the line (figuratively) and on the one-yard-line (literally).
  • New England’s defensive posture was a heavy package with run-stopping lineman and linebackers. Essentially New England was posturing to defend heavily against a QB sneak or a straight power run (presumably via Lynch). New England wanted to hold or push back the line of scrimmage at the expense of more space and opportunity on the edges of the playing field and at the expense of a more structurally effective pass defense.
  • In game theory terms, this is a simultaneous move scenario with a maximum of three sequential moves given the time constraint. This is a zero sum game – one team wins and one team loses.
  • In game theory terms, there is neither Nash Equilibrium nor strictly/strongly dominant strategy, nor is there a weakly dominant strategy. Basically there are pros and cons of running or passing on offense and stacking the line or nickel/dime packaging in defense. No clear play or strategy on either side exists.

two more salient points …

  • He believes that a big part of Lynch’s success in the regular season & playoffs – and indeed that of the Seattle offense – stemmed from Seattle having a strong “mixed” (i.e., random) balanced approach to offense. Basically, Seattle was likely to run between the tackles (again, Lynch) or use a short-pass or edge run plays (QB Russell Wilson scrambling, read-option run, screens, etc.) or use a medium- or long-passing strategy. This mixed and balanced strategy was largely evident when down and distance did not necessitate a type of play call.
  • He is also skeptical – as am I – that Lynch gets one yard on a single given play. The fact that he had running success earlier in the game is not conclusive; those yards may have been gained against a lighter line/linebacker package. The one-for-five for the season seems suspect as a data set, and I believe that New England’s run-stop/heavy package was not their strength and may well have been inferior to the average NFL team. I believe that Lynch – In full beast mode – gains one yard 50% of the time, if both teams are postured for a power run.

Now for the fun part … 

 1. The role of Credibility and Marshawn Lynch. One common game theory application is the classic “prisoner’s dilemma” whereby two partners in crime are separated. If they both keep quiet, they both walk free. If they both incriminate themselves and the other charged prisoner they both face moderate punishment. If one talks and other does not then one gets a light punishment and one gets a heavy punishment. What makes this work for police forces is the separation of the prisoners so they cannot collude and the credible threat that each will self-optimize.

We now return to the Super Bowl …

It was absolutely credible that Lynch might be chosen to run the ball one yard, and he broke the huddle as part of the offense, so at least initially it was credible. New England’s decision to go “heavy package” endorses the assertion that running was initially a credible threat.

2. The role of making a commitment. When New England committed to a heavy package defense, they sought to seize a first mover advantage. This was ultimately significant as it likely factored in the decision by Seattle to pass the ball.

3. The role of a conditional response. This was a result of the aforementioned commitment by New England. Seattle set up in a bunch-set wide receiver formation and moved Lynch a bit wide in the backfield. The lack of heavy package substituting by Seattle – which would have taken valuable seconds off the clock or forced Seattle to spend their last time out – suggested a pass on the play (second and goal from the one-yard line, 26 seconds remaining).

4. Reputation. (A) Coaches: In game theory terms, both coaches lean toward a mixed strategy, which contributes greatly to their reputations as innovators or even geniuses.
(B) Teams: Seattle’s trading away key receivers this year established a bit more of a “run-first” and “be physical” team ethos. Conversely, Tom Brady and the short-passing game to the little sprites running across the middle had more of a scheme and “finesse ethos” for New England.

5. Real risk versus reputation risk. For both teams, a very real risk of losing the game existed. Reputation risk – akin to ensuring that Michael Jordan takes the last shot when you are down by one point in basketball – can be strongly controlled by play selection. Even if Jordan misses the shot a coach could hardly be faulted for putting the game in the hands of the best clutch player in basketball history.

And then, for Seattle, it all went to hell …

  • The decision to pass was fundamentally sound, but the play selected was simply awful. By passing first, an incomplete pass would stop the clock and would still enable two more plays with the benefit of a time-out still in pocket. Seattle coach, Pete Carroll, could go incomplete pass, stuffed run (time out), stuffed run. Game Lost. Sadness but not criticism of the coach. Reputation risk would be almost fully mitigated. Three plays would be guaranteed. But the pass play itself was bad on at least two levels.

1. The bunch set of wide-receivers and the moving of Lynch a bit to the outside removed the credibility of the power run and tipped off the New England Defensive Backs. A play-action pass likely would have caused the linebackers to not commit as quickly to pass rush/coverage responsibilities. This would have kept the linebackers from gathering in

International Consulting

Patriots DB Malcolm Butler seals the deal. Image Courtesy of Sports Illustrated

the middle as they did. More critically, it would have helped establish credibility of run for the next two plays (in which Seattle may choose to pass given the New England alignment, package, etc.).

New England Defensive Back, Malcolm Butler, made a tremendous play but he also knew from the set-up of the WRs and Marshawn Lynch where he needed to focus. He jumped the route due to no disguise … and then he also made a magnificent play on the ball.

2. If not a play-action pass, then the decision to not use a very capable, mobile quarterback was poor. I can think of no quarterback better at the run/pass option than Seattle Quarterback, Russell Wilson. If this is done to the side with a Tight-End (the strong side) then one could make the case for an equally likely power run (with Wilson behind the offensive tackle and tight end) or a sprint edge-run or short-pass via the roll out. This decision would also enable a sequential mini-game-theory game between the QB and a subset of the players (on both teams) where a first-mover advantage could likely be gained by Wilson via a pump fake or hip fake, reading the other team’s defensive end (and that is one of the advantages of running an option).I do concede that a Lynch play-action followed by a multi-option roll out would likely fail … a play like this has many moving parts and takes time to develop, and on the one-yard line, the field is compressed. It is probable New England would have effectively defended, resulting in a sack, loss of yards, loss of precious time, Seattle to using their final timeout, or any combination thereof.

As such and from a game theory perspective, a choice of either a play-action pass (run fake to Lynch, lined up in a traditional running formation) or the QB option were better plays.

  • From a reputation risk, a safer throw (not over the middle in a packed area) would have been much better. When the ball is thrown, barring penalty, one of three things can happen: A. The ball is caught by a receiver, B. The ball is not caught by the receiver, and C. The ball is intercepted.More so than the ill-fated slant pattern Seattle chose, a fade route to the corner of the end zone may have resulted in an incomplete pass, but it also would have mitigated the risk of interception. Furthermore, and incompletion would enable two more (likely running) plays.On the assumption that a single, one-yard, run play was 50% likely to succeed with both teams featuring a heavy package of linemen and Lynch running for Seattle, the expected value of getting the one yard over three plays would have been over 80% for the three-play series. Had Carroll and his staff chosen a three-play series as outlined above the result, at its worst, would have been losing the Super Bowl with no reputation risk. I’m convinced Seattle’s coaching staff squandered an approximately 80% chance of success.

The Final Gun …

While taking nothing away from an outstanding interception, anyone wanting an example of poor game theory put into practice need look no further than the final 30 seconds of the Seattle Seahawks 2014-15 season.

2 thoughts on “Game Theory & Super Bowl XLIX

  1. Michael Tuosto says:

    Hello Steve. My name is Michael Tuosto. I’m an R&D Program Manager at CareFusion in San Diego.

    Would like to get your thoughts on the phenomenon called ‘Sabermetrics’ – specifically:

    1. Is there evidence that this has really helped ‘level’ the playing field of baseball competition (i.e., big market vs. small market)?
    2. Will (Should) this impact the rules of baseball that have been around for greater than 100 years?
    3. Why haven’t other sports adopted this approach? Can competitive advantages be gained in other sports (or industries) through a sabermetrics type approach?

    Looking forward to your insights.

    Like

  2. spepmiller says:

    Hi Mike,

    Great questions and each of them quite weighty… I will take each in turn based on my perspectives.

    1. With regards to baseball, Sabermetrics provided a small window of advantage for the teams that were forward thinking – most notably the Oakland A’s of Moneyball fame. Within a few years the competition (e.g., the GM’s of various other teams) added more advanced metrics analysis into their thinking (and management team to include a stats expert)… as such, I think the advantage has been lessened in recent years. However, I would suggest that Sabermetrics was best at mining “peculiarities” of individual player performance and often these peculiarities and less obvious performance attributes are not necessarily “box office” in attraction to paying fans. So an awkward off-speed pitcher might be equally effective to a massive flame-throwing reliever… but a fan base – and indeed Managers and GMs – are still slow to embrace anything other than “what the eyes tell them.” Given spending limit constraints, I think that smaller market teams may therefore be a little more inclined to go shopping for players with great metrics but less flattering aesthetics and they will get a market discount on performance as a result. This helps level the playing field a bit I believe.

    2. I can see some of the Sabermetrics / statistical analysis impacting some of the rules of baseball but only nominally. I think pace-of-play is where we are most likely to see changes. A couple of examples to illustrate my perspective on this. Advanced statistics may strongly suggest a particular “righty-lefty” switch of pitchers for certain situations due to the metrics for a single batter… and then bring in another pitcher… and then perhaps another to get incremental Sabermetrics advantages. However, MLB has to balance competitive fair play with a product which is enjoyable to the fans and marketable to the TV networks. Nobody gets pay increases unless MLB is a huge and growing commercial success. A second example might be a statistical advantage to stepping out of the batters box after every pitch – settle the mind, think through the pitch history, runner and fielder positions, etc.. – however, again pace-of-play and aesthetics may dictate a more rapid pace and a rules change to “stay in the box” or even a maximum duration between pitches to move the game along.

    3. One reason that makes baseball so compelling for statistical analysis and Sabermetrics is that baseball is, in effect, a series of relatively discrete “encounters” between a very small amount of participants – fundamentally the pitcher and the batter. And these encounters have a strong statistical base of information following (e.g., batting averages, ERA, SO to K, slugging percentage, et. al.). There are also a few over-riding and toggle switch parameters for decisions – Right / Left handed pitcher… Right / Left / Switch hitters. These input phenomenons make statistical analysis more meaningful than a more fluid style of game with a broader range of considerations and indeed total numbers of players which impact performance.

    Still, other sports could do more. In the area of Game Theory, there is an excellent explanation (lesson 4) by Ben Polak on “best response strategy” in the area of penalty kicks on Soccer. Worth watching (and the free course is excellent) you can find it here:
    http://oyc.yale.edu/economics/econ-159/lecture-4
    While not strictly metrics analytics (but rather Game Theory) it is the type of analyses that more sports could incorporate.

    I would suggest that the less players on the field and the more discrete the “encounters” the higher the applicability of advanced analyses to sports management. Cricket – with its similarities to baseball – is an obvious contender. And this sport has a high statistical following – evidenced by lengthy discussions on “run rates” and the sequencing of off-spin and pace bowlers, etc..

    I also firmly believe that Basketball could evolve and do a lot more in the area of Sabermetrics in particular. One of my favorite examples involves Allen Iverson – a player my wife adored for his tenacity and small guy ferociousness at driving to the basket and scoring. I intuitively saw it through a different lens when I noted that he missed a lot of shots, had his share of turnovers and played so-so defense (more due to his stature than his effort). So I checked into it and found that he made about 42% of his shots… which is below the average shooting percentage of about 80% of the NBA teams in a given year. “Net, net” he was less effective than an average shooter on an average team (and he did not, for instance, shoot 3 point shots particular well which might help justify his case) and indeed was typically in the bottom 20% percentile. To my glee, somebody actually did a great analysis entitled Game Theory – and this includes a Win Score (basically a basketball version of baseball’s Wins Above Replacement or “WAR”) – and talks about Allen Iverson and other sports challenges with perception and statistical reality. A lot of his greatness is debated through statistical analysis.
    This article is here: http://www.newyorker.com/magazine/2006/05/29/game-theory-2

    Finally, you asked about industries which could use more Game Theory or advanced analytics. The take-away is that it is most applicable to industries with fairly rigid rules, few players and a high level of capital and competitive constraints. The Airline industry – with specific and not easily expanded airport gate slots, long lead times for plane orders, set flight plans, etc. – make it ideal and indeed this is an industry that has historically been at the forefront of Game Theory applications. I could see telecom providers and other heavy infrastructure, oligopoly and “scale is everything” type of industries being prime candidates for more Game Theory & Sabermetrics applications. Competition in “the cologne / perfume wars” for instance would lend itself to heavy Game Theory applications (most perfumes/colognes are sold in a few large stores and duty free, very high marketing costs to even play in the game, etc.). Game on!

    Like

Leave a comment