ICT for assessing mathematics achievement

In the Advise-Me project we develop an approach to using ICT for assessing mathematics achievement of pupils using learning environments for mathematics. In particular, we look at fine-grained cognitive assessment of free-form answers to math story problems, which requires determining the steps a pupil takes towards a solution, together with the high-level solution approach used by the pupil. We recognise steps and solution approaches in free-form answers and use this information to update a user model of mathematical competencies. We use the user model to find out for which student competencies we need more evidence of mastery, and determine which next problem to offer to a pupil. We have tested our work on a large dataset for one problem, and have performed multiple pilot studies in different European countries.

[Example question: In the photo above you see the first Matryoshka dolls of a series. The puppets fit into each other, due to a decreasing height. The biggest puppet is 32 cm high. Each next puppet is 25% smaller than the previous one. In this sequence, there are no puppets smaller than 6 cm. How many puppets are there in this series? Write down your intermediate steps.]

Advise-Me project

Advise-Me is a Strategic Partnership from the European Union’s Erasmus+ programme and involves the Computer Science department of the Open University of the Netherlands, Utrecht University, Cito, Saarland University and Université Paris-Est Créteil. The project started September 2016 and runs until September 2019. For more information about the project, visit the projectsite Advise-Me or contact Bastiaan.Heeren@ou.nl.