Evaluation system

Evaluations are conducted in order to safeguard the quality of the educational programme. After all, it is important to investigate whether the students (among others) are satisfied with the programme.

Introduction

Evaluation involves the collection, interpretation and presentation of information in order to determine the value of a result or process.
It is important that a programme regularly reflects how the courses are given, so that efficiency and effectiveness can be monitored.

Through evaluations, we can analyse what was successful and what was less successful. The reasons for this and the bottlenecks are revealed and agreements reached on how to improve our performance in future.
An evaluation is thus a moment of reflection when the programme explores whether the working methods used produce the desired results. β€˜To what extent were the objectives achieved?" and "What should be changed in the future?"

In the Programme Committee (11 November 1998), four evaluations were identified, all of which have now been implemented.

These are the subject evaluation of the propaedeutic year, the evaluation of the general part (A) of the study units BA2, BA3, MA and RMA, the cohort evaluation and evaluation of the variable parts (B, C) of the BA/MA/RMA, and finally the general curriculum evaluation.

List of abbreviations

  • OLC: Programme Committee (undergraduate programme)
  • EC: Education Committee (graduate programme)
  • PO: portfolio holder education (Professor P. Akkermans)
  • BKW: policy officer quality assurance (F. Tomas)
  • DUG: director undergraduate programme (Dr J. Mol)
  • DG: director graduate programme (Dr D. Fontijn)
  • OS: Administration Office (Jochem Koopman)

The evaluation of the propaedeutic year

Takes place once every two years. That means that every year, half is evaluated by means of a standard survey.

  • Each subject should be evaluated once every two years. The OLC gives advice based on the proposal of the policy officer, in which order the evaluation takes place. The dates are chosen based on the exam timetables. The timetable shows which part will be evaluated. This means that both lecturers and students are aware of the survey.
  • The BKW requests the ICLON at least two weeks before the end of each block to deliver the survey forms (c/o OS address).
  • The OS gives the forms to the lecturer supervising the exam of the subject concerned and asks him/her to distribute them.
  • This lecturer asks the students to return the forms immediately after the exam to the lecturer or the OS. In principle, the OS is responsible for collecting the forms.
  • The collected forms will be forwarded by the BKW to the ICLON for processing in EvaSys.
  • The results are sent as soon as possible to the study coordinator of the propaedeutic year, the policy officer for education and the DUG.
  • In the next OLC meeting, they provide a written report with recommendations (as evidence during inspections).
  • The written report, including recommendations from the BKW and perhaps amendments based on the advice of the OLC, is sent to the board of the faculty. If necessary, the PO will be requested to discuss change measures with the lecturer(s) (perhaps in cooperation with the BKW to supplement the content part).

The evaluation of the general part (A)

Takes place once every two years. That means that every year, half is evaluated by means of a standard survey.

  • Based on a proposal by the BKW, the OLC will draw up a schedule for the evaluation of the various subjects. The dates will be established based on the exam timetables. The timetable shows which part will be evaluated, so that both lecturers and students are aware of the survey.
  • The BKW requests the ICLON at least two weeks before the end of each block to supply the survey forms (c/o OS).
  • The OS gives the forms to the lecturer supervising the exam of the subject in question so that he/she can distribute them.
  • This lecturer asks the students to return the forms to the lecturer or the OS immediately after the exam. In principle, the OS is responsible for collecting them.
  • The BKW will forward the collected forms to the ICLON for processing in EvaSys.
  • The results will be sent to the OLC as soon as possible, for the attention of the BKW and the chairperson.
  • The BKW reports in writing to the OLC with recommendations (as evidence for the inspection). The results are shared with all the lecturers concerned. If necessary, the PO is requested to discuss measures to bring about changes with the lecturer(s).
  • The written report with recommendations, perhaps after amendment on the advice of the OLC, is offered to the board of the faculty.

The Cohort Evaluation and evaluation of the variable parts (B/C)

Takes place midway through each academic year in the form of a questionnaire, which is discussed by the students in a group session. A report is then submitted to the OLC/EC by a student member. Internships and fieldwork are evaluated separately on forms included with the internship forms. The internship coordinator will submit the fieldwork evaluations to the OLC/EC.

  • At the start of each academic year, in September, the chairperson of the OLC/EC asks the student members of the OLC/EC per year representation to organise a meeting. Five blocks can be distinguished here: BA2, BA3, MA, RMA and PhD.
  • At the meeting, a standard questionnaire is completed, but everyone is of course free to contribute additional comments. The meeting is not attended by lecturers, although a yet-to-be-appointed project coordinator for programme innovation may be present.
  • The student representing the relevant cohort in the OLC/EC reports in writing about the meeting to the OLC/EC and the BKW. This report addresses at minimum the questions asked.
  • The reports are discussed in the OLC/EC, which requests – if necessary – that the PO contacts the lecturer(s) concerned about the results of the survey. A subject that required attention should be re-evaluated the following year to see whether improvements have been made.
  • The written reports with recommendations, possibly after amendment on the advice of the OLC/EC, are offered to the board of the faculty.
  • The students should receive feedback about the decisions taken. This can be given via the student members of the OLC/EC and/or by an announcement in the newsletter.

The evaluation of the programme as a whole (curriculum evaluation)

Takes place every 3 years prior to the programme inspection or the midterm review.

  • It is conducted on behalf of the PO and executed by the BKW.
  • The results are submitted for advice to the OLC/EC.
  • The OLC/EC gives advice to the PO based on this report.
Students and lecturers should receive feedback about the results and actions via newsletters, among other things.

Alumni evaluation

Takes place every 3 years prior to the programme inspection or the midterm review

  • It is conducted on behalf of the PO and executed by the BKW in partnership with the ICLON and the OS.
  • The results are submitted to the OLC/EC for advice.
  • The OLC/EC gives advice to the PO based on this report.

Lecturer evaluation

Takes place every 3 years prior to the programme inspection or the midterm review

  • It is conducted on behalf of the PO and executed by the BKW in partnership with the ICLON and the OS.
  • The results are submitted to the OLC/EC for advice.
  • The OLC/EC gives advice to the PO based on this report.
  • Lecturers receive feedback about the results and actions by means of an AOO (General Programme Consultation).

Guidelines evaluations

The evaluation system of the Faculty of Archaeology works on the basis of a 5 point scale.
An average final score above 3 means that the students are sufficiently satisfied. An evaluation result is only relevant if at least 30% of students respond.

The cohort evaluations use open questions directed at the students in a panel discussion. All comments by students are noted. If a majority of the students present express the same criticism, this is reported by the OLC/EC student member during an OLC/EC meeting. The OLC/EC will decide whether action will be taken.

Reporting

Once a year, an Education Quality Assurance Report is drawn up by the BKW based on the results of the subject evaluation propaedeutic year, evaluation of the general part and the result details.

Filing and documentation

The BKW files the results of the surveys along with the summarising reports for the term of the inspection period. The reports will also be published on the faculty website.

 
Last Modified: 25-02-2015