Publications

2023

Zeqiu Wu, Yushi Hu, Weijia Shi, Nouha Dziri, Alane Suhr, Prithviraj Ammanabrolu, Noah A. Smith, Mari Ostendorf, and Hannaneh Hajishirzi
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS) (2023).
Conference Paper Link Project Website bibtex

Bill Yuchen Lin, Yicheng Fu, Karina Yang, Faeze Brahman, Shiyu Huang, Chandra Bhagavatula, Prithviraj Ammanabrolu, Yejin Choi, and Xiang Ren
SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS) (2023).
Conference Paper Link Project Website Code bibtex

Ximing Lu, Faeze Brahman, Peter West, Jaehun Jang, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Yuchen Lin, Skyler Hallinan, Xiang Ren, Sean Welleck, and Yejin Choi
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
Empirical Methods in Natural Language Processing (EMNLP) (2023).
Conference Paper Link bibtex

Kolby Nottingham, Prithviraj Ammanabrolu, Alane Suhr, Yejin Choi, Hannaneh Hajishirzi, Sameer Singh, and Roy Fox
Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling
International Conference on Machine Learning (ICML) (2023).
Conference Paper Link Project Website bibtex

Pei Zhou, Andrew Zhu, Jennifer Hu, Jay Pujara, Xiang Ren, Chris Callison-Burch, Yejin Choi, and Prithviraj Ammanabrolu
An AI Dungeon Master's Guide: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons
Association for Computational Linguistics (ACL) (2023).
Conference Paper Link bibtex

Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel, JaeSung Park, Ximing Lu, Rowan Zellers, Prithviraj Ammanabrolu, Ronan Le Bras, Gunhee Kim, and Yejin Choi
Multimodal Knowledge Alignment with Reinforcement Learning
Conference on Computer Vision and Pattern Recognition (CVPR) (2023).
Conference Paper Link bibtex

Rajkumar Ramamurthy*, Prithviraj Ammanabrolu*, Kianté Brantley, Jack Hessel, Rafet Sifa, Christian Bauckhage, Hannaneh Hajishirzi, and Yejin Choi
Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization
International Conference on Learning Representations (ICLR) (2023).
Conference Paper Link Project Website Code bibtex

Ruoyao Wang*, Peter Jansen*, Marc-Alexandre Côté, and Prithviraj Ammanabrolu
Behavior Cloned Transformers are Neurosymbolic Reasoners
European Chapter of the Association for Computational Linguistics (EACL) (2023).
Conference Paper Link bibtex

2022

Zeqiu Wu, Ryu Parish, Hao Cheng, Sewon Min, Prithviraj Ammanabrolu, Mari Ostendorf, and Hannaneh Hajishirzi
INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactions
Transactions of the Association for Computational Linguistics (TACL) (2022).
Journal Paper Link bibtex

Xiangyu Peng, Mark O Riedl, and Prithviraj Ammanabrolu
Inherently Explainable Reinforcement Learning in Natural Language
Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS) (2022).
Conference Paper Link Code bibtex

Ximing Lu, Sean Welleck, Liwei Jiang, Jack Hessel, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, and Yejin Choi
Quark: Controllable Text Generation with Reinforced Unlearning
Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS) (2022).
Conference Paper Link bibtex

Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hannaneh Hajizhirzi, and Yejin Choi
Aligning to Social Norms and Values in Interactive Narratives
North American Chapter of the Association for Computational Linguistics (NAACL) (2022).
Conference Paper Link bibtex

Ruoyao Wang*, Peter Jansen*, Marc-Alexandre Côté, and Prithviraj Ammanabrolu
ScienceWorld: Is your Agent Smarter than a 5th Grader?
Empirical Methods in Natural Language Processing (EMNLP) (2022).
Conference Paper Link Project Website Code bibtex

Prithviraj Ammanabrolu, Renee Jia, and Mark O Riedl
Situated Dialogue Learning through Procedural Environment Generation
Association for Computational Linguistics (ACL) (2022).
Conference Paper Link bibtex

2021

Prithviraj Ammanabrolu and Mark Riedl
Learning Knowledge Graph-based World Models of Textual Environments
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS) (2021).
Conference Paper Link bibtex

Prithviraj Ammanabrolu and Mark Riedl
Modeling Worlds in Text
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track (Round 1) (2021).
Conference Paper Link Code bibtex

Xiangyu Peng, Prithviraj Ammanabrolu, and Mark Riedl
Explainable Reinforcement Learning Agents with Stacked Hierarchical Graph Attention
Workshop on Explainable Graph-based Machine Learning at AKBC (2021).
Workshop Code bibtex

Prithviraj Ammanabrolu and Mark Riedl
Modeling Worlds in Text
The First Workshop on Commonsense Reasoning and Knowledge Bases (CSKB) at AKBC (2021).
Workshop Paper Link Code bibtex

Wai Man Si, Prithviraj Ammanabrolu, and Mark O Riedl
Telling Stories through Multi-User Dialogue by Modeling Character Relations
SIGDIAL 2021 (2021).
Conference Paper Link Code bibtex

Prithviraj Ammanabrolu and Mark O Riedl
Situated Language Learning via Interactive Narratives
Patterns, Cell Press (2021).
Journal Paper Link bibtex

Prithviraj Ammanabrolu, Jack Urbanek, Margaret Li, Arthur Szlam, Tim Rockt"aschel, and Jason Weston
How to Motivate Your Dragon: Teaching Goal-Driven Agents to Speak and Act in Fantasy Worlds
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (2021).
Conference Paper Link Project Website bibtex

2020

Sahith Dambekodi, Spencer Frazier, Prithviraj Ammanabrolu, and Mark O Riedl
Playing text-based games with common sense
The Second WordPlay: When Language Meets Games Workshop (2020).
Workshop Paper Link bibtex

Gautam Singaraju and Prithviraj Venkata Ammanabrolu
Techniques for building a knowledge graph in limited knowledge domains
(2020).
Paper Link bibtex

Prithviraj Ammanabrolu, Wesley Cheung, William Broniec, and Mark O Riedl
Automated storytelling via causal, commonsense plot ordering
Thirty-Second AAAI Conference on Artificial Intelligence (2020).
Conference Paper Link Code bibtex

Prithviraj Ammanabrolu, Ethan Tien, Matthew Hausknecht, and Mark O Riedl
How to avoid being eaten by a grue: Structured exploration strategies for textual worlds
arXiv preprint arXiv:2006.07409 (2020).
Preprint Paper Link Code bibtex

Prithviraj Ammanabrolu and Matthew Hausknecht
Graph Constrained Reinforcement Learning for Natural Language Action Spaces
International Conference on Learning Representations (2020).
Conference Paper Link Code bibtex

Prithviraj Ammanabrolu, Wesley Cheung, Dan Tu, William Broniec, and Mark O Riedl
Bringing stories alive: Generating interactive fiction worlds
Proceedings of the Sixteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE-20) (2020).
Conference Paper Link Code bibtex

Prithviraj Ammanabrolu, William Broniec, Alex Mueller, Jeremy Paul, and Mark O. Riedl
Toward Automated Quest Generation in Text-Adventure Games
International Conference on Computational Creativity (ICCC) (2020).
Conference Paper Link bibtex

Matthew Hausknecht, Prithviraj Ammanabrolu, Marc-Alexandre Cot'e, and Xingdi Yuan
Interactive fiction games: A colossal adventure
Proceedings of the AAAI Conference on Artificial Intelligence 34 (2020).
Conference Paper Link Code Blog bibtex

Prithviraj Ammanabrolu, Ethan Tien, Wesley Cheung, Zhaochen Luo, William Ma, Lara J. Martin, and Mark O. Riedl
Story Realization: Expanding Plot Events into Sentences
Proceedings of the AAAI Conference on Artificial Intelligence 34 (2020).
Conference Paper Link Code bibtex

2019

Prithviraj Ammanabrolu, Ethan Tien, Wesley Cheung, Zhaochen Luo, William Ma, Lara Martin, and Mark Riedl
Guided Neural Language Generation for Automated Storytelling
Proceedings of the Second Workshop on Storytelling (2019).
Workshop Paper Link Code bibtex

Prithviraj Ammanabrolu and Mark Riedl
Transfer in Deep Reinforcement Learning Using Knowledge Graphs
Proceedings of the Thirteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-13) at EMNLP (2019).
Workshop Paper Link bibtex

Prithviraj Ammanabrolu and Mark Riedl
Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning
North American Chapter of the Association for Computational Linguistics (NAACL-HLT) 2019 (2019).
Conference Paper Link Code Blog bibtex

2018

Lara J Martin, Prithviraj Ammanabrolu, Xinyu Wang, William Hancock, Shruti Singh, Brent Harrison, and Mark O Riedl
Event Representations for Automated Story Generation with Deep Neural Nets
Thirty-Second AAAI Conference on Artificial Intelligence (2018).
Conference Paper Link Code bibtex

2017

Lara J Martin, Prithviraj Ammanabrolu, Xinyu Wang, Shruti Singh, Brent Harrison, Murtaza Dhuliawala, Pradyumna Tambwekar, Animesh Mehta, Richa Arora, Nathan Dass, and lastothers others
Improvisational storytelling agents
Workshop on Machine Learning for Creativity and Design (NeurIPS 2017) (2017).
Workshop Paper Link bibtex