Perception and misperception in gaming

Jon Alterman has written a short and thought-provoking piece for a CSIS newsletter about his experience on the U.S. team in a recent multi-cell policy game. Worth reading in full, but here's an excerpt:

The U.S. team swiftly leapt into a series of actions intended to direct the actions of its allies and blunt the efforts of its foes. In the second move, things got worse, and the U.S. side tried even harder to marshal its forces, artfully deploying its military and diplomatic assets. By the third move, the situation continued to worsen in many respects, but the U.S. team saw light at the end of the tunnel. We had a plan, and our allies were looking to us for leadership. Equally importantly, they were all acting precisely as we had hoped, abandoning the troublesome sorts of freelancing that had marked their earlier moves. We thought we had played the game well.

When we all gathered after the final move, however, it was clear how much we had misjudged the situation. Opponents talked about how easily U.S. moves were blunted or ignored. Allies were beside themselves that the United States had missed numerous opportunities to consult with them and raised tensions needlessly. But most importantly, they charged that the U.S. team had fundamentally misjudged the motivations of their actions. The U.S. team had congratulated itself on its ability to integrate all of the instruments of national power—in contrast to allies that could either convene summits or issue statements or host American military forces, but rarely more than one of those and almost certainly not in a sustained, purposive and coordinated way. Yet allies explained that perceptions of their own national interests drove their decisions, and that U.S. actions rarely shaped those decisions. It is true, the U.S. team had moved military aircraft and issued statements to and fro, but the other players did not find it very impressive. They had their own calculus. In their telling, it was as if the U.S. team was trying to take credit for the sun rising in the East. If anything, they said, the U.S. team’s actions had made it harder for them to comply with U.S. wishes.

There's a lot here. First, this is the sort of discussion that is missing in many public depictions of gaming events. Alterman was constrained by the event sponsor's desire to keep details of the scenario private, but the generalized insight he describes is probably of at least as much value to him and the other participants as any specifics of the game outcome.

My sense is that games are a largely unexploited avenue to bring participants to a better understanding of their own perceptions and misperceptions. In Alterman's example, the stark contrast between the U.S. team's sense of agency and the view of other actors will likely stick with him to a greater extent than hearing someone lecture about the pitfalls of psychological decision-making biases. Thomas Schelling viewed the RAND crisis games of the 50's and 60's as a tool uniquely suited to examining perceptual factors (discussed briefly here), but I'm not aware of much work since then on the subject, nor have I seen much application of social psychology to gaming, with a couple of exceptions that I should blog about sometime.

The role of the debrief session is key in all of this, as it was for Alterman's experience. Unfortunately, it's much easier to say how important debriefing is than it is to concisely define what it is about a debrief that makes it effective. How would you set up a game and the subsequent debrief to address perception and decision-making biases directly? Multiple cells, for starters, would be a key factor, as Schelling would have said, with closed information conditions. The debrief would have to be substantial enough to give each cell the opportunity to understand what was going on in each of the other cells, and the debriefer would need to be focused on drawing out the differing perceptions of the participants. Beyond that, I'm really not sure.

CNA - Wargaming Strategic Linkage and Conversations with Wargamers

Two recent papers from the Center for Naval Analyses are great examples of the benefits of robust professional dialogue in the gaming field.

Wargaming Strategic Linkage was the result of a project conducted for the Naval War College, looking for ways to structure wargames to include more than one level of war (strategic, operational, tactical). While this was undertaken in support of the revived Global War Game, most of the ideas involved would apply equally well to gaming outside of a military context. Traditionally, the divisions between the levels of war have been more clearly specified than those between the policy and implementation levels of other issues. However, there has been a blurring of the lines between strategic, operational, and tactical concerns, an ambiguity that Wargaming Strategic Linkage has to deal with.

As noteworthy as the results of the project is the process by which it was undertaken. As a part of their research, Peter Perla and Michael Markowitz consulted a number of other wargaming experts (including CASL's Erik Kjonnerod). Even better, they decided to release their notes on these discussions as a separate paper, Conversations with Wargamers. These detailed interviews provide a great deal of insight into the gaming process, not all of which was directly relevant to the problem Perla and Markowitz had set out to address. Together, these two papers are a testament to how much different gaming practitioners have to teach one another, especially when guided by a targeted research question and researchers who are themselves experts.

Gaming's contribution to the new maritime strategy

The Navy released its new maritime strategy in October 2007, and gaming played a critical role in the development process. Writing in the Spring 2008 issue of the Naval War College Review, Robert Rubel explained how (the article begins on page 69 of the magazine, page 75 of the .pdf file).

Here are some key paragraphs:

From the outset, this project would not simply derive from existing strategic guidance, such as the National Security Strategy or the National Defense Strategy. This may seem somehow subversive to those who are used to military planning processes in which guidance from higher headquarters is regarded as holy writ. However, consider our situation—the project was undertaken at the end of the Bush administration and our requirement was to look ahead twenty years. We could not responsibly make the assumption that current U.S. security strategy would remain in place, and there was no adequate way to predict the direction of the next administration’s policies. Our solution was to postulate four different potential strategy vectors of a future administration, which resulted in having four U.S. teams in a strategic war game we conducted. The first team represented a “Primacy” strategy, in which the United States would attempt to maintain its near-hegemonic status in the world. The second team adopted a “Selective Engagement” posture, in which the United States would focus its efforts on averting conflict among major powers. The third team played a “Cooperative Security” strategy, in which the nation committed itself to seeking security through multilateralism and international institutions. The fourth team represented an “Offshore Balancing” strategy, in which the United States retracted certain security guarantees and caused major powers to balance each other.

. . . .

The Strategic Foundations Game took about six weeks to play and involved the four U.S. teams, one for each potential policy future, and five “strategic entities,” countries and nonstate groups selected for detailed play. Teams were directed to develop grand strategies for the next twenty years that would maximize their security, aspirations, and interests. Non-U.S. teams were not required to demonstrate hostility to the United States unless that made sense in terms of their grand strategies. This represented a departure from normal gaming, in which worst-case scenarios are the rule. In the open adjudication sessions in which each team proclaimed its strategy, a compelling central thread emerged. Each state had an intrinsic interest in the effective functioning of the global system of trade, even such “rogue” actors as Iran and North Korea. Only al-Qa‘ida and associated groups had endemic hostility to the system. This insight produced the “big idea” that the protection of the existing global system of trade and security (as opposed to the process of globalization) provided both the context for the new strategy and the intellectual glue that tied together all regions of the world. Thus the notion of system security and defense figures prominently in the maritime strategy document, both “up front,” in its introduction, and in the description of the maritime strategic concept. This could not have been more important—even, in its way, more revolutionary. It provided a basis for not only a maritime strategy but a national grand strategy not aimed against a particular country or threat but positive, without being aggressive. The strategic concept upon which the maritime strategy is based—defense of the global system of commerce and security—offers the opportunity for future administrations to adopt a clearly articulated grand strategic defensive posture,with all the political advantages that brings. As a defensive strategy, it makes global maritime cooperation much easier to attain.

Storming the CASL

In August I started a new job at the Center for Applied Strategic Learning (CASL) at National Defense University. Until recently, CASL was known as the National Strategic Gaming Center, which I've mentioned before. This is, quite simply, my dream job.

I hope to get back to blogging more regularly, now that I've made the move to DC and have settled in to some degree. The first few posts will just try to get through a backlog of material I've been meaning to blog about for a while. Watch this space.

Perla: Design, Development and Play of Navy Wargames

Peter Perla, wargamer extraordinaire, wrote this paper for CNA in 1985 as a broad overview of wargame design and development. I meant to write this up shortly after discussing several other CNA papers in the past, but it took me a while to get to it. That's a shame, because this is a great introduction to wargame design. Much of the content remains relevant today, nearly 25 years later. While the focus is on Navy wargames, the principles expressed pertain to a much wider variety of games. Perla went on to write The Art of Wargaming, which is one of the premier works on the subject, covering both the history and practice of wargaming. I highly recommend the book, but this CNA paper is free and will do in a pinch: Design, Development, and Play of Navy Wargames

Gaming economic warfare

Wiggins at Opposed Systems Design posted a link to a Politico story on an attempt to game economic great power conflict at the Warfare Analysis Laboratory. This is a fascinating concept, and I hope it's something that gets developed further.

“This was an example of the changing nature of conflict,” said Paul Bracken, a professor and expert in private equity at the Yale School of Management who attended the sessions. “The purpose of the game is not really to predict the future, but to discover the issues you need to be thinking about.”

Several participants said the event had been in the planning stages well before the stock market crash of September, but the real-world market calamity was on the minds of many in the room. “It loomed large over what everybody was doing,” said Bracken.

Bracken is precisely the person you would want at this sort of event. I've mentioned Bracken before here. It's not clear if he had any role in the design of the game, but it wouldn't surprise me if he did. Details are (as usual in this sort of story) sketchy but intriguing.

The event was unclassified but has not been made public before. It is regarded as so sensitive that several people who participated declined to discuss the details with POLITICO. Said Steven Halliwell, managing director of a hedge fund called River Capital Management, “I’m not prepared to talk about this. I’m sorry, but I can’t talk to you.”

Officials at UBS also declined to comment.

Participants described the event as a series of simulated global calamities, including the collapse of North Korea, Russian manipulation of natural gas prices, and increasing tension between China and Taiwan. “They wanted to see who makes loans to help out, what does each team do to get the other countries involved, and who decides to simply let the North Koreans collapse,” said a participant.

There were five teams: The United States, Russia, China, East Asia and “all others.” They were overseen by a “White Cell” group that functioned as referees, who decided the impact of the moves made by each team as they struggled for economic dominance.

At the end of the two days, the Chinese team emerged as the victors of the overall game – largely because the Russian and American teams had made so many moves against each other that they damaged their own standing to the benefit of the Chinese.

Bracken says he left the event with two important insights – first, that the United States needs an integrated approach to managing financial and what the Pentagon calls “kinetic” – or shooting – wars. For example he says, the U.S. Navy is involved in blockading Iran, and the U.S. is also conducting economic war against Iran in the form of sanctions. But he argues there isn’t enough coordination between the two efforts.

And second, Bracken says, the event left him questioning one prevailing assumption about economic warfare, that the Chinese would never dump dollars on the global market to attack the US economy because it would harm their own holdings at the same time. Bracken said the Chinese have a middle option between dumping and holding US dollars – they could sell dollars in increments, ratcheting up economic uncertainty in the United States without wiping out their own savings. “There’s a graduated spectrum of options here,” Bracken said.

It is rare to find such a perfect example of the right way to frame the benefits derived from a game in a press report. The result that 'China won' is next to meaningless, but Bracken's comments have some real value.


On an only tenuously related note, here is a clip from Bloggingheads.tv that touches on Nassim Taleb's ideas about uncertainty, previously discussed here and here, as applied to the financial crisis:




This isn't directly relevant to gaming, but it does reinforce Bracken's point about the economic game not being about predicting the future, but rather about identifying issues to think about. Gaming in general is a very poor predictive tool, all the more so when applied to something as ridiculously complex as the global economy.

Disclosure: I work for Bloggingheads.tv on an irregular basis.

Reacting to the Past at Barnard College

(via PaxSims) Barnard College runs an interesting program called "Reacting to the Past," a set of classroom roleplaying exercises based on historical situations:

“Reacting to the Past” (RTTP) consists of elaborate games, set in the past, in which students are assigned roles informed by classic texts in the history ideas. Class sessions are run entirely by students; instructors advise and guide students and grade their oral and written work. It seeks to draw students into the past, promote engagement with big ideas, and improve intellectual and academic skills. Pioneered by Barnard College in 1996, the project is supported by a consortium of colleges and universities.

All of the games are set in the past, and thus might be regarded as history, but each game also explores multiple additional disciplines. Part of the intellectual appeal of RTTP is that it transcends disciplinary structures. In addition to games in the published series, the consortium seeks to expand the curriculum by supporting faculty workshops and collaboration on new game designs that explore a variety of historical moments in the humanities and sciences.

Neat stuff. There are some upcoming faculty conferences in different regions for those interested in using or contributing to the program (Paxsims has more about that). What struck me after watching the sample video at the RTTP site was that it was difficult to see what the structure of the exercises really was. Is this a roleplaying debating society, or are there some underlying game elements that aren't shown? Based on the accompanying web pages, it seems that there are some other aspects to the game that I just wasn't able to pick up on. This reminds me of some of the games designed by Megagame Makers (discussed in another post a while back), and I wonder if some of them (particularly the Washington Naval Conference one) could be transferred to this RTTP framework without much trouble. Perhaps that wouldn't be sweeping enough in scope for the RTTP program. I also wonder if the good folks at ChoMUN and MUNUC are aware of this... and vice versa....