Tasks:

• 1 - Topical competence

  This task will test and verify a model's understanding of an application domain and specific topic of interest.

• 2 - Veracity and hallucination

  This task will test how the truthfulness or veracity of automatically generated text can be assessed.

• 3 - Robustness

  This task will test the capability of a model to handle input variation -- e.g. dialectal, sociolectal, and cross-cultural -- as represented by a set of equivalent but non-identical varieties of input prompts.

• 4 - Voight Kampff

  This task will explore whether automatically-generated text can be distinguished from human-authored text. This task will be organised in collaboration with the PAN lab at CLEF.