Senseval 3
March 2004
Evaluation exercises for Word Sense Disambiguation
Organized by ACL-SIGLEX
|
|
Registration, Data Download/Upload
Registration and Data Download/Upload
Guidelines for scoring and results format.
General Schedule
|
Evaluation
|
March, 1 - April, 15 2004
|
|
Workshop
|
July 2004
|
Detailed Schedule
The Senseval-3 evaluation period will start on March 1, 2004, and will end on April 15, 2004. During this period, participants can download training/test data for any given task at any time, with the following restrictions:
- Results for a given task have to be submitted no later than 21 days after downloading the training data for that particular task.
- Results for a given task have to be submitted no later than 7 days after downloading the test data for that particular task.
Exceptions from the 21/7 rule:
- The Automatic Labeling of Semantic Roles task (Task 13) does not have the 21-day restriction on training data. Participants can work with the training data as long as they like. The 7-day restriction for submitting results after downloading the test data still applies.
- The Word-Sense Disambiguation of WordNet Glosses task (Task 12) has a 14-day restriction for the test data.
- The Identification of Logic Forms in English task (Task 14) has a 7-day restriction on the test data, and the test period is fixed to March 25-31.
Check below for details regarding the tasks you want to participate in. The table reflects the dates when trial/training/test data will become available for a given task. Click on a task name for more details regarding the task (in some cases also including a dedicated webpage). With the exception of tasks 13 and 14, the data for all other tasks will follow closely the Senseval-2 data format. In particular, the tasks that do not provide trial data are guaranteed to use the same data format as in Senseval-2.
|
|
|
|