Wordplay: When Language Meets Games 


                                    $$\      $$\                           $$\           $$\                                                 
                                    $$ | $\  $$ |                          $$ |          $$ |                                                
                                    $$ |$$$\ $$ | $$$$$$\   $$$$$$\   $$$$$$$ | $$$$$$\  $$ | $$$$$$\  $$\   $$\ $$\                         
                                    $$ $$ $$\$$ |$$  __$$\ $$  __$$\ $$  __$$ |$$  __$$\ $$ | \____$$\ $$ |  $$ |\__|                        
                                    $$$$  _$$$$ |$$ /  $$ |$$ |  \__|$$ /  $$ |$$ /  $$ |$$ | $$$$$$$ |$$ |  $$ |                            
                                    $$$  / \$$$ |$$ |  $$ |$$ |      $$ |  $$ |$$ |  $$ |$$ |$$  __$$ |$$ |  $$ |$$\                         
                                    $$  /   \$$ |\$$$$$$  |$$ |      \$$$$$$$ |$$$$$$$  |$$ |\$$$$$$$ |\$$$$$$$ |\__|                        
                                    \__/     \__| \______/ \__|       \_______|$$  ____/ \__| \_______| \____$$ |                            
                                                                               $$ |                    $$\   $$ |                            
            $$\      $$\ $$\                                 $$\               $$ |                    \$$$$$$  |                            
            $$ | $\  $$ |$$ |                                $$ |              \__|                     \______/                             
            $$ |$$$\ $$ |$$$$$$$\   $$$$$$\  $$$$$$$\        $$ |       $$$$$$\  $$$$$$$\   $$$$$$\  $$\   $$\  $$$$$$\   $$$$$$\   $$$$$$\  
            $$ $$ $$\$$ |$$  __$$\ $$  __$$\ $$  __$$\       $$ |       \____$$\ $$  __$$\ $$  __$$\ $$ |  $$ | \____$$\ $$  __$$\ $$  __$$\ 
            $$$$  _$$$$ |$$ |  $$ |$$$$$$$$ |$$ |  $$ |      $$ |       $$$$$$$ |$$ |  $$ |$$ /  $$ |$$ |  $$ | $$$$$$$ |$$ /  $$ |$$$$$$$$ |
            $$$  / \$$$ |$$ |  $$ |$$   ____|$$ |  $$ |      $$ |      $$  __$$ |$$ |  $$ |$$ |  $$ |$$ |  $$ |$$  __$$ |$$ |  $$ |$$   ____|
            $$  /   \$$ |$$ |  $$ |\$$$$$$$\ $$ |  $$ |      $$$$$$$$\ \$$$$$$$ |$$ |  $$ |\$$$$$$$ |\$$$$$$  |\$$$$$$$ |\$$$$$$$ |\$$$$$$$\ 
            \__/     \__|\__|  \__| \_______|\__|  \__|      \________| \_______|\__|  \__| \____$$ | \______/  \_______| \____$$ | \_______|
                                                                                           $$\   $$ |                    $$\   $$ |          
                  $$\      $$\                       $$\                      $$$$$$\      \$$$$$$  |                    \$$$$$$  |          
                  $$$\    $$$ |                      $$ |                    $$  __$$\      \______/                      \______/           
                  $$$$\  $$$$ | $$$$$$\   $$$$$$\  $$$$$$\    $$$$$$$\       $$ /  \__| $$$$$$\  $$$$$$\$$$$\   $$$$$$\   $$$$$$$\           
                  $$\$$\$$ $$ |$$  __$$\ $$  __$$\ \_$$  _|  $$  _____|      $$ |$$$$\  \____$$\ $$  _$$  _$$\ $$  __$$\ $$  _____|          
                  $$ \$$$  $$ |$$$$$$$$ |$$$$$$$$ |  $$ |    \$$$$$$\        $$ |\_$$ | $$$$$$$ |$$ / $$ / $$ |$$$$$$$$ |\$$$$$$\            
                  $$ |\$  /$$ |$$   ____|$$   ____|  $$ |$$\  \____$$\       $$ |  $$ |$$  __$$ |$$ | $$ | $$ |$$   ____| \____$$\           
                  $$ | \_/ $$ |\$$$$$$$\ \$$$$$$$\   \$$$$  |$$$$$$$  |      \$$$$$$  |\$$$$$$$ |$$ | $$ | $$ |\$$$$$$$\ $$$$$$$  |          
                  \__|     \__| \_______| \_______|   \____/ \_______/        \______/  \_______|\__| \__| \__| \_______|\_______/


Back to the future ›››



Wordplay: When Language Meets Games @ NAACL 2022.

Date and time: Full day workshop on July 14th.

Location: Room 501 - Chiwawa

Virtual links: Underline.io; Live Session Recording.

One line version: Your one stop shop for all things interactive narrative + AI!

The slightly longer version

This workshop will focus on exploring the utility of interactive narratives, think everything from classic text-adventures like Zork to modern Twine games, to fill a role as the learning environments of choice for language-based tasks including but not limited to storytelling. A few previous iterations of this workshop took place very successfully with hundreds of attendees, at NeurIPS 2018 and NeurIPS 2020. Since then, the community of people working in this area has rapidly increased. This workshop aims to be a centralized place where all researchers involved across a breadth of fields can interact and learn from each other. Furthermore, it will act as a showcase to the wider NLP/RL/Game communities on interactive narrative’s place as a learning environment. The program will feature a collection of invited talks in addition to contributed talks and posters from each of these sections of the interactive narrative community and the wider NLP and RL communities.

We like all things:

The actual version

Interactivity has been shown to be a core component of learning. Humans learn various skills such as language, vision, motor skills, etc. more effectively through interactive media [Feldman and Narayanan, 2004; Barsalou, 2008]. In the realm of machines, interactive environments have served as cornerstones in the quest to develop more robust algorithms for learning agents across many machine learning sub-communities. Environments such as the Atari Learning Environment (ALE) [Bellemare et al., 2013] and Malmo [Johnsonet al., 2016] have enabled the development of game agents that perform complex tasks while operating on raw video inputs, and more recently THOR [Kolve et al., 2017] and Habitat [Savva et al., 2019] attempt to do the same with embodied agents in simulated 3D worlds.

There has been a void for such environments in terms of purely language-oriented tasks. Recently, however, there has been much work showing that interactive narratives—existing at the intersection of natural language processing, storytelling, and sequential decision making—provide ideal platforms to develop situated language learning agents that span these fields [Narasimhan et al., 2015; Côté et al., 2018; Fuldaet al., 2017; Zahavy et al., 2018; Hausknecht et al., 2019]. Interactive narratives for our purpose refer to settings in which a narrative unfolds sequentially, driven by an agent’s interactions. These interactions themselves are fully language based—the agent “perceives” and “talks” in this simulation using only text. Examples include, but are not limited to, text-adventure or interactive fiction games such as Zork [Anderson et al., 1979], improvisational storytelling [Martin et al., 2017; Mathewson and Mirowski, 2017], situated dialogue [Urbanek et al., 2019] and interactive question answering in these worlds [Yuan et al., 2019]. In order to infer the context and objectives of these narratives, humans bring competencies in natural language understanding, commonsense reasoning, and deduction to bear. These are competencies that a learning agent will need to acquire to master the domain.

From the perspective of developing situated language learning agents, interactive narratives can be modelled as sequential decision making problems in which actions change the subsequent world states of the game. Additionally, choices made early in a game may have long term effects on the eventual endings. Interactive narratives thus pose a different set of challenges than the more traditional machine learning domains in the area. Their puzzle-like structure coupled with a partially observable state space, sparse rewards, and a combinatorially-sized action space require extensive understanding of previous context to enable more effective exploration—an implicit long-term dependency problem that agents must overcome.

Interactive narratives further provides us with the ability to study storytelling in an interactive setting. Interactive storytelling is one of the most natural forms of human communication and imagine how much more we could do with our machines if we could get them to tell stories. This task features many of the challenges previously discussed including: long-term coherence, and genre-specific and everyday commonsense reasoning. This can be in one of many forms: (1) through procedural generation of interactive language-based environments [Guzdial et al., 2015; Ammanabrolu et al., 2019; Fan et al., 2019; Tamari et al., 2019; Womack and Freeman, 2019; Ammanabrolu et al., 2020], (2) improvisational or collaborative storytelling [Martinet al., 2017; Mirowski and Mathewson, 2019], or (3) persona-driven situated dialogue [Urbanek et al., 2019; Prabhumoye et al., 2020].

Diversity and Inclusion

This workshop aims to provide an environment with open exchange of ideas, freedom of thought and expression, and respectful scientific debate. Thus harassment and hostile behavior (Including but not limited to harassment based on race, gender, religion, age, color, appearance, national origin, ancestry, disability, sexual orientation, or gender identity.) are unwelcome in the workshop.

During the workshop, any participant who experiences harassment or hostile behavior may contact any of our organizing committee members, the organizers will take actions upon the situation to make sure we have a diverse, inclusive and friendly environment.

References