Code for the paper "Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition", ACL 2024
Go to file
2024-06-11 15:51:37 +02:00
config clean dataset paths 2024-06-11 15:51:37 +02:00
scripts scripts folder 2024-06-11 15:41:57 +02:00
src rm DS_Store 2024-06-11 15:48:20 +02:00
.gitignore gitignore 2024-06-11 15:46:57 +02:00
__init__.py up 2024-06-11 15:36:55 +02:00
baselines_with_dialogue_moves.py up 2024-06-11 15:36:55 +02:00
baselines_with_dialogue_moves_graphs.py up 2024-06-11 15:36:55 +02:00
compare_tom_cpa.ipynb up 2024-06-11 15:36:55 +02:00
intermediate_representations.py up 2024-06-11 15:36:55 +02:00
LICENSE up 2024-06-11 15:36:55 +02:00
logistic_regression_tom_feats.py up 2024-06-11 15:36:55 +02:00
plan_predictor.py up 2024-06-11 15:36:55 +02:00
plan_predictor_graphs.py up 2024-06-11 15:36:55 +02:00
plan_predictor_graphs_oracle.py up 2024-06-11 15:36:55 +02:00
plan_predictor_graphs_test.py up 2024-06-11 15:36:55 +02:00
plan_predictor_oracle.py up 2024-06-11 15:36:55 +02:00
README.md up 2024-05-31 16:14:34 +02:00

Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition

Matteo Bortoletto,   Constantin Ruhdorfer,   Adnen Abdessaied,   Lei Shi,   Andreas Bulling

ACL 2024, Bangkok, Thailand
[Paper]

Citation

@inproceedings{bortoletto24_acl,
  author = {Bortoletto, Matteo and Ruhdorfer, Constantin and Abdessaied, Adnen and Shi, Lei and Bulling, Andreas},
  title = {Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition},
  booktitle = {Proc. 62nd Annual Meeting of the Association for Computational Linguistics (ACL)},
  year = {2024},
  pages = {1--16},
  doi = {}
}

Dataset

Original Dataset

Extended Dataset

Code overview

The code is based on the original implementation.

ToM tasks

Baselines:

  • training code: baselines_with_dialogue_moves.py
  • bash script: baselines_with_dialogue_moves.sh
  • model: src/models/model_with_dialogue_moves.py

Graph models:

  • training code: baselines_with_dialogue_moves_graphs.py
  • bash script: baselines_with_dialogue_moves_graphs.sh
  • model: src/models/model_with_dialogue_moves_graphs.py

To extract ToM features, run intermediate_representations.py

CPA tasks

Baselines:

  • training code: plan_predictor.py
  • bash script: run_plan_predictor.sh
  • model: src/models/plan_model.py

Baselines with ToM ground-truth as input:

  • trainining code: plan_predictor_oracle.py
  • bash script: run_plan_predictor_oracle.sh
  • model: src/models/plan_model_oracle.py

Graph models:

  • training code: plan_predictor_graphs.py
  • bash script: run_plan_predictor_graphs.sh
  • model: src/models/plan_model_graphs.py

Graph models with ToM ground-truth as input:

  • training code: plan_predictor_graphs_oracle.py
  • bash script: run_plan_predictor_graphs_oracle.sh
  • model: src/models/plan_model_graphs_oracle.py

Graph models with full candidate sampling (i.e. considering all possible candidate edges):

  • training code: plan_predictor_graphs_allcand.py
  • bash script: run_plan_predictor_graphs_allcand.sh
  • model: src/models/plan_model_graphs.py (same as the constrained selection)

Train graph model with int0 features as input: run_plan_predictor_graphs_int0.sh

Analysis

  • correlation analysis: compare_tom_cpa.ipynb
  • diagnostic probing: logistic_regression_tom_feats.py. To extract CPA features, use plan_predictor_graphs_test.py