ExpliCITA

Code and data to replicate the experiments of the paper "LLMs Struggle on Explicit Causality in Italian"

Usage

Simply run the run_multiplechoice.sh script to replicate our experiments with local models.

The run_multiplechoice.sh script also includes information on how to call the Python script to get answers for a single model.

Citation

@inproceedings{bondielli-etal-2025-llms,
    title = "{LLM}s Struggle on Explicit Causality in {I}talian",
    author = "Bondielli, Alessandro  and
      Miliani, Martina  and
      Paglione, Luca  and
      Auriemma, Serena  and
      Passaro, Lucia C.  and
      Lenci, Alessandro",
    editor = "Bosco, Cristina  and
      Jezek, Elisabetta  and
      Polignano, Marco  and
      Sanguinetti, Manuela",
    booktitle = "Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)",
    month = sep,
    year = "2025",
    address = "Cagliari, Italy",
    publisher = "CEUR Workshop Proceedings",
    url = "https://aclanthology.org/2025.clicit-1.10/",
    pages = "83--94",
    ISBN = "979-12-243-0587-3"
}