Creating tests and question pools in ILIAS – a guide

Creating tests and question pools in ILIAS - A guide

ILIAS offers a comprehensive testing and assessment system that teachers can use for different purposes.
In addition to the query of prior knowledge, tests to check the understanding of the content by teachers or the students themselves, ILIAS can also be used to create and conduct e-exams. For this purpose, the so-called kiosk mode can be activated if required.
Such tests can be automated, semi-automated and/or evaluated manually.

The following article describes how such tests can be created in ILIAS.
A complete documentation of the very extensive setting options around the ILIAS test and assessment system in version 5.4 can be viewedhere if required.

ILIAS, by the way, is directly linked to Stud.IP and is to be considered together with Stud.IP as a common system. If you want to create an ILIAS course, you must first activate ILIAS as a function via the “More” tab in the Stud.IP navigation bar.

The three basic components of the test and assessment system

Questions

Single-choice, multiple-choice, formula questions, numerical answers or cloze questions…ILIAS has a whole range of question types to choose from. It is also possible to enter free text and upload various file types under the question type “Upload file“.
A detailed explanation of all question types can be found in the video of the Hochschule Ostwestfalen- Lippe.

A question can be given a question text, scores, different answer options, feedback and/or processing times, among other things. You can create questions either within the ILIAS object Question Pool or in tests.

Question pool

You can create and save any number of questions in a question pool. If required, you can also manage these question pools according to content, random or other criteria. For a test, you can in turn obtain questions from any number of question pools.
It is also possible to set up taxonomies if, for example, you want to map the same question in an exam but with changed values.

Test

Within the Test object, you can obtain self-defined questions from one or more previously created question pools. Alternatively, you can create new questions directly in the object test.

Please click to enlarge.

A detailed description of all setting options including screenshots of the University of Bern can also be downloaded here.

Recommendation: If you intend to create several tests in ILIAS, we recommend that you first create one or more question pools. Only then do you create the Test object. The advantage is: You don’t have to create questions twice, but can obtain questions from existing question pools – even across courses.

Setting options using an example

Under the Settings tab in the Test object, you have extensive options for determining general and detailed test settings (such as defining the grading scheme and evaluation modalities).

Adjustment options

As an example, a test with selected prerequisites is set up below and it is explained at which points these settings can be made in the object:

    • Participants can only complete the test within 90 minutes.
      Settings> General settings> Execution: Control Test run> Limit processing time
    • Each student is asked different questions. The questions are selected randomly from one or more question pools
      Settings> General Settings>Settings of the test>Selection of the test questions>Random question selection
    • Students should see an overview of all questions during the test
      Settings> General settings>Implementation: Functions for participants>Show question list and processing status
    • Students can mark questions, e.g. in order to work on them at a later point in time.
      Settings> General settings>Implementation: Functions for participants>Mark questions
    • Unanswered questions are pushed to the end of the test
      Settings> General settings>Implementation: Functions for participants>Questions not answered
    • Students can download an overview of their answers as a PDF document after submitting the test
      Settings> General Settings>Complete test>Answers handed over> PDF-Download
    • Announcement of the test result on a specific date
      Settings>Evaluation>Announcement of the test result>Participants see test results (tick box)>From defined date

Tip

For a smooth run-through, it is advisable that you give your students some instructions on how to process tests in ILIAS in advance. The University of Hanover, for example, has provided a template with selected important information here (in the document at the very end).

Evaluations

ILIAS offers various setting options for the evaluation of tests. These can be found under the Settings tab and the subcategory Evaluations (cf. screenshot Settings options).
Here you will find various options as to whether and when results or correct solutions are displayed.

A detailed explanation of the test evaluation options in ILIAS is also provided by the Hochschule Ostwestfalen-Lippe.

If you prefer it in writing, you can find it in the ILIAS documentation of Leibnitz Universität Hannover.

Kiosk mode for exams

ILIAS enables the test to be carried out in restricted editing mode when the examination view is activated. All screen elements that do not belong to the test are hidden.

To activate the kiosk mode, please follow this path:

Settings>General Settings>Implementation: Control test run>Exam view

However, this does not replace the use of a browser specialised in e-exams, so that students are prevented from opening other applications on their device while taking the test. For this purpose, the computer centre uses the Safe Exam Browser – the “Institute of Embedded Systems” in turn uses the exam browser “YAPS”, which was specially developed by TUHH staff. If you have any questions, please do not hesitate to contact us.

If you have any questions about ILIAS and/or the development of tests, the ZLL will be happy to advise you.

Contact person ZLL:
Katrin Billerbeck on questions regarding the didactic development of examination tasks
Stephanie Wichmann with questions about Ilias

Leave a Reply

Your email address will not be published. Required fields are marked *