๐ป Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
active 2023-10-21 โ 2025-05-20 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 578 days from 2023-10-21 to 2025-05-20. Pushes: 22 total, peak 5 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 7 total, peak 2 in a day. Comments: 9 total, peak 3 in a day. Stars: 55 total, peak 7 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 โ โ95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments โ stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| skywalker023 | 32 | 22 | 0 | 7 |
| dniku | 4 | 0 | 0 | 2 |
| Jiayi-Pan | 1 | 0 | 0 | 0 |
| lukasberglund | 1 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#3skywalker0232024-04-06 05:34Some factQA questions have identical correct_answer and wrong_answer
- Issue#4skywalker0232024-04-03 21:06Dataset size does not match what is reported in the paper
- Issue comment#3skywalker0232024-04-03 21:06Some factQA questions have identical correct_answer and wrong_answer
- Issue comment#3dniku2024-03-29 09:48Some factQA questions have identical correct_answer and wrong_answer
- Issue comment#3skywalker0232024-03-28 23:04Some factQA questions have identical correct_answer and wrong_answer
- Issue comment#3dniku2024-03-27 14:15Some factQA questions have identical correct_answer and wrong_answer
- Issue comment#3skywalker0232024-03-27 01:38Some factQA questions have identical correct_answer and wrong_answer
- Issue comment#4skywalker0232024-03-27 01:36Dataset size does not match what is reported in the paper
- Issue#4dniku2024-03-26 18:16Dataset size does not match what is reported in the paper
- Issue#3dniku2024-03-25 13:30Some factQA questions have identical correct_answer and wrong_answer
- Issue comment#2skywalker0232024-02-09 01:16Did you try few-shot prompting GPT-4?
- Issue#2lukasberglund2024-02-06 23:38Did you try few-shot prompting GPT-4?
- Issue#1skywalker0232023-11-02 23:24Dataset/code release?
- Issue comment#1skywalker0232023-11-02 23:18Dataset/code release?
- Issue#1skywalker0232023-11-02 23:18Dataset/code release?
- Issue#1Jiayi-Pan2023-11-01 22:58Dataset/code release?
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals โ 55 stars here means stars gained during the window, not the repo's star count.