Information Services offers the following automated assessment services:
QuestionMark Perception is the assessment tool within Queen’s Online that enables academics to develop, schedule, deliver and obtain reports for various different types of assessment.
Author – (A) Question Banks (B) Assessments (exams, quizzes, tests and surveys)
Schedule – assessments for your students
Deliver – your assessment to students through standard and secure web browsers
Report – generate comprehensive reports on individual and group performance. Note: If you intend using this system for online exams you must inform the exams office and the University QuestionMark support team.
Browser based Authoring
Users will typically be permitted access to QuestionMark through browser based authoring. Browser based authoring permits you to utilise the following question types:
The browser-based authoring (BBA) software allows you to create the following question types:
- Essay question : the participant answers by typing up to 30,000 characters of text. You may define what is right or wrong in advance by entering a list of acceptable answers or print out a report of the responses for manual grading. The logic can also allow scoring based on the presence or absence of keywords or key phrases. This question type is also used to solicit opinions or suggestions on a particular subject.
- Likert scale : the participant selects one of several options such as "strongly agree" through "strongly disagree" that are weighted with numbers to aid analysis of the results.
Multiple choice: the participant selects one choice from up to 40 possible answers. There is no limit to the length of each answer.
- Multiple choice: the participant selects one choice from up to 40 possible answers. There is no limit to the length of each answer.
- Multiple response : similar to multiple choice except the participant is not limited to choosing one response; he/she can select none, one or more of the choices offered.
- Numeric questions : a participant is prompted to enter a numeric value, and this may be scored as one value for an exact answer and another score if the response is within a range.
- True/False : the participant selects "true" or "false" in response to the question.
- Word response (text match): the participant types in a single word, or a few words to indicate their answer. You define right or wrong words or phrases in advance by entering a list of acceptable answers. The grading logic can also allow scoring based on the presence or absence of keywords or key phrases and check for misspellings.
- Yes/No : the participant selects "Yes" or "No" in response to the question.
Windows Based Authoring
There are a limited number of windows based authoring (Authoring manager) licenses available and these licenses will be distributed through Directors of Education on a per school bases.
Question mark Perception Authoring Manager allows you to create the following question types as well as those available in browser based authoring:
- Drag-and-Drop:the participant clicks and drags up to ten images into position. The feedback and score is dependant upon the final position of the images.
- Explanation screens:insert text or graphics for the participant to view prior to answering a series of questions.
- File Upload: participants are often required to complete an assignment which requires them to create a document in the form of a computer file. Question authors can use File Upload questions to enable participants to upload their document files.
- Survey Matrix: This question type enables you to include multiple rows of Likert questions within a table with column headers included.
- Fill-in-the-blank:the participant is presented with a statement where one or more words are missing and completes the missing words. The score can be determined from checking each blank against a list of acceptable words and can checked for misspelled words.
- Hotspot:a participant clicks on a picture to indicate their choice. Depending upon their choice, certain feedback and grades will be assigned. A graphics editor is provided to simplify specifying the choice areas.
- Knowledge Matrix:this question type presents several multiple-choice questions together where the participant selects one choice for each statement or question presented. This question type is used to cross-relate responses from a single item.
- Matching:two series of statements/words are presented and the participant must match items from one list to items within the other list.
- Pull-Down List (selection question):a series of statements are presented and the participant can match these statements with a pull-down list.
- Ranking (Rank in Order):a list of choices must be ranked numerically with duplicate matches not allowed.
- Select-a-blank:the participant is presented with a statement where a word is missing; words can be selected from a pull-down list to indicate their answer.
- Adobe (Macromedia) Captivate Simulations:Perception supports an interface with Macromedia Captivate that allows subject matter experts to create simulations that can provide scoring information for multiple interactions and have the results recorded within the answer database.
- Adobe (Macromedia) Flash:Perception supports an interface with Macromedia Flash that allow programmers to program customised items using Flash and have the results recorded within the answer database.
Information Services also provides access to a ‘Form Reader’ system that can scan and mark large volumes of paper based exams. This system allows the lecturer to design a paper based ‘master form’, which can be mass produced and distributed to candidates. Candidates can then complete the assessment by filling in a range of check boxes. Papers can then be bulk scanned, marked and collated into an assessment report. It should be noted that the system works with standard paper and scanners, so no major expense is involved.
The system can support a range of uses including: marking of exam papers, and class tests, collection of information from student evaluation forms.