Advances in Computer Science and Engineering
Volume 3, Issue 2, Pages 127 - 136
(July 2009)
|
|
BUILDING A KOREAN QA EVALUATION SET
Bo-Hyun Yun (Korea)
|
Abstract:
This paper presents the processes of building a Korean Question Answering (QA) evaluation set based on the encyclopedia. We try to build well-balanced question set for various domains and highly confirmed answers corresponding for each question. We considered various levels of question/answer types and extended our evaluation set from simple questions to complex ones step by step. As a result, we obtained 7,024 questions and built KorQAEval Set which consists of 923 question/answer sets. By applying our result in evaluating the operational QA system, we proved the validity of our evaluation methodology. |
| Keywords and phrases: question answering, evaluation, test collection. |
| |
| Number of Downloads: 320 | Number of Views: 871 |
|
