Implicit knowledge, that is, task performance knowledge which cannot be articulated by the expert, presents one of the most difficult problems for knowledge acquisition. The present paper examines the information value of the expert's eye movements as a complementary method to elicit implicit knowledge. In a first step, a focused interview and a repertory grid analysis were carried out with a single poetry expert, leading to a first draft of the conceptual domain of poetry criticism. In a second step, the expert was requested to assess 10 poems; his thinking aloud and eye movements while reading the poems were registered. A group of 42 subjects (knowledge engineers) received 10 poems, together with the expert's assertions and information about his eye movements while reading the poems. For half the assertions, the eye information was genuine; for the other assertions, the eye information was misleading. The subjects were asked (a) to decide whether or not genuine eye movements were presented with the assertion, (b) to formulate a paraphrase of the assertion, (c) to formulate a production rule from the assertion, and (d) to decide to what degree the eye information was useful to the elicitation of the knowledge structure. A direct comparison of the findings from the protocol analysis with and without genuine eye information revealed both quantitative and qualitative differences, pertaining to the structure of the information that the expert is attending to during classification. With this information, the reconstruction of the expert's implicit problem analysis was considerably enhanced.
All Science Journal Classification (ASJC) codes
- Human Factors and Ergonomics
- Human-Computer Interaction
- Hardware and Architecture