| Título: |
Towards automatic recognition of irregular, short-open answers in Fill-in-the-blank tests Towards automatic recognition of irregular, short-open answers in Fill-in-the-blank tests |
| Autores: | Rojas, Sergio; Universidad Distrital Francisco José de Caldas |
| Fecha: | 2013-12-21 |
| Publicador: | Tecnura |
| Fuente: |
 |
| Tipo: | |
| Tema: |
Evaluación automática de aprendizaje, reconocimiento de patrones, análisis de texto Automatic learning assessment, pattern recognition, text analysis. |
| Descripción: |
Assessment of student knowledge in Learning Management Systems such as Moodle is mostly conducted using close-ended questions (e.g. multiple-choice) whose answers are straightforward to grade without human intervention. FILL-IN-THE-BLANK tests are usually more challenging since they require test-takers to recall concepts and associations not available in the statement of the question itself (no choices or hints are given). Automatic assessment of the latter currently requires the test-taker to give a verbatim answer, that is, free of spelling or typographical mistakes. In this paper, we consider an adapted version of a classical text-matching algorithm that may prevent wrong grading in automatic assessment of FILL-IN-THE-BLANK questions whenever irregular (similar but not exact) answers occur due to such types of error. The technique was tested in two scenarios. In the first scenario, misspelled single-word answers to an Internet security questionnaire were correctly recognized within a two letter editing tolerance (achieving 99 % accuracy). The second scenario involved short-open answers to computer programming quizzes (i.e. small blocks of code) requiring a structure that conforms to the syntactic rules of the programming language. Twenty-one real-world answers written up by students, taking a computer programming course, were assessed by the method. This assessment addressed the lack of precision in terms of programmer-style artifacts (such as unfamiliar variable or function nomenclature) and uses an admissible tolerance of up to 20 % letter-level typos. These scores were satisfactory corroborated by a human expert. Additional findings and potential enhancements to the technique are also discussed. Assessment of student knowledge in Learning Management Systems such as Moodle is mostly conducted using close-ended questions (e.g. multiple-choice) whose answers are straightforward to grade without human intervention. FILL-IN-THE-BLANK tests are usually more challenging since they require test-takers to recall concepts and associations not available in the statement of the question itself (no choices or hints are given). Automatic assessment of the latter currently requires the test-taker to give a verbatim answer, that is, free of spelling or typographical mistakes. In this paper, we consider an adapted version of a classical text-matching algorithm that may prevent wrong grading in automatic assessment of FILL-IN-THE-BLANK questions whenever irregular (similar but not exact) answers occur due to such types of error. The technique was tested in two scenarios. In the first scenario, misspelled single-word answers to an Internet security questionnaire were correctly recognized within a two letter editing tolerance (achieving 99 % accuracy). The second scenario involved short-open answers to computer programming quizzes (i.e. small blocks of code) requiring a structure that conforms to the syntactic rules of the programming language. Twenty-one real-world answers written up by students, taking a computer programming course, were assessed by the method. This assessment addressed the lack of precision in terms of programmer-style artifacts (such as unfamiliar variable or function nomenclature) and uses an admissible tolerance of up to 20 % letter-level typos. These scores were satisfactory corroborated by a human expert. Additional findings and potential enhancements to the technique are also discussed. |
| Idioma: | en |
1 Barreras para la implementación de generación distribuida: dos representantes de países desarrollados vs. un representante de país en desarrollo por Castillo Ramírez, Alejandro; Ingeniero de materiales, estudiante de la Maestría en Ingeniería de la Universidad
de Antioquia. Medellín, Colombia. | 6 Modelamiento y análisis de pequeña señal de un generador de inducción y un STATCOM conectados a un sistema de potencia por Zuluaga Ríos, Carlos David; Universidad Tecnológica de Pereira.,Alzate Gómez, Alfonso; Universidad Tecnológica de Pereira. |
2 Comparación del modelo Wavelet multifractal entre una red ethernet y una red MANET por Aguirre Buenaventura, Edgar Alirio; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia.,Puerta Aponte, Gabriel Alberto; Universidad Distrital Francisco José de Caldas. | 7 Arranque de un motor de inducción usando control difuso por Barriga Turriago, Camilo; I.M.MAN.COL.,Zambrano, Juan; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia. |
3 Control de admisión multicast por González, Jaime Uriel; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia.,Hernández, Cesar; Universidad Distrital Francisco José de
Caldas.,Lopez, Danilo; Universidad Distrital Francisco José de Caldas. | 8 Control de posición de un sistema bola y viga con actuadores magnéticos por Lopez, Francy; Universidad Distrital Francisco
José de Caldas. Bogotá, Colombia.,Monroy, Paola; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia.,Rairán Antolines, José Danilo; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia. |
4 Control de admisión para redes móviles AD HOC con base en estimación de ancho de banda disponible por Alzate, Marco A.; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia.,Támara, Leydi J.; Universidad Distrital Francisco José de Caldas. | 9 Enrutamiento basado en el algoritmo de Dijkstra para una red de radio cognitiva por Pedraza, Luis F.; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia.,López, Danilo; Universidad Distrital Francisco José de Caldas. Bogotá, Colombia.,Salcedo, Octavio; niversidad Distrital Francisco José de Caldas. Bogotá, Colombia. |
5 Intersecciones tipo diamante divergente, análisis de implementación en ciudades colombianas por Porras Díaz, Hernán; Universidad Industrial de Santander,Martínez Estupiñán, Yerly Fabián; Universidad Industrial de Santander | 10 La robótica aplicada a la lúdica por Galán Munévar, Jonathan; Universidad Nacional de Colombia. Bogotá, Colombia.,Robles Sánchez, Edisson Leandro; Universidad Nacional de Colombia. Bogotá, Colombia.,Moreno Mosquera, Henry; Escuela Colombiana de Ingeniería. Bogotá, Colombia. |