edgehill.ac.

uk/ls
Electronic Assessment
Management
- Using the right tools
Adrian Cain, Mark Wilcock & David Callaghan

edgehill.ac.uk/ls
 Programme of Session
Introduction
• Why use it?
• Opportunities for online submission
Our Experience
• Process considerations
• EHU Experiences of use
Options
• Turnitin
• Blackboard Assignment Tool
Data Management – In progress course considerations
Data Curation – Post course considerations

edgehill.ac.uk/ls
 Definition
Electronic Assessment Management:
The use of information and communication technology to facilitate the
creation, submission, marking, moderation and/or feedback of student
work for assessment – usually summative, sometimes formative.

edgehill.ac.uk/ls
 Description
• Creation
Administration, tutors, proforma/template
• Submission
Online (various electronic formats) and offline submission
• Marking
On or off-line – even off screen, but eventually added online
• Moderation
Online, email (zip), offline
• Feedback
Online – Text and/or audio
• Release
Online

edgehill.ac.uk/ls
2011-12 Annual Edge Hill University Student eLearning Survey
Insight into our students’ experience and expectations of TEL

84% it is important to submit/collect assignments online.

42.7% that Online self-tests & quizzes are important

“I find having access to lecture notes/slides enables me to reinforce any learning I have
partaken in, and the quizzes/mocks are a useful way of checking learning is up to date.”

The 5 Most Important Things My Lecturer Does

Colin Gibson, SU President, Edge Hill University Students Union (2012)
Blackboard

‘…..how important the basic things are to students….’

• Submit online “… a little thing we changed which made a big difference to our
student’s lives.”
• LE ‘…really, really powerful use it!
• LE ‘…for all info, not just PowerPoints!

edgehill.ac.uk/ls
Increase use of EAMs
..... results in the increased use of the grade centre
Positives
• Less travel
• More parking spaces! +
• Less paper
• Anytime and anywhere
Negatives
• System/s down – Plan B
• Internet access and device
• More time on computer
• More difficult to spread mark/review
Student demands
• NSS and local demand

edgehill.ac.uk/ls
Opportunities for online submission
Blackboard
• Assignments
• Tests
• Surveys
• Discussions
• Journals
• Blogs
• Wikis
Learning Edge
• Turnitin
• Campus Pack (Wikis, Blogs, Journals etc.)
• Pebble Pad
Offline
• Performance …and go to?
• Viva • Grade Centre (Staff)
• Artwork • My Grades (Students)

edgehill.ac.uk/ls
Our Experience of Typical
Process (if there is such a thing!)

edgehill.ac.uk/ls
Start to finish considerations
Set-up (start)
Consistency - Follow Faculty/Department/Programme processes/guides (if nothing exists, start it)
Testing - Add your ‘Test Student’ account to check operation
Instructional text – Make sure there are adequate student instructions (one file, cover sheet, lates, Plan B etc)
Student Experience
Competent – Become familiar with your submission process to support your students
Differences – There is no EHU/HE fixed submission process and all tools offer different functionality
Formative/Survey – Some tools can offer students formative or survey processes
Submission (due date)
Attempts – Single or Multiple attempts
Timing – Open for exam period or module duration
Marking
Auto/manual – Instance tests with predefined answers or delayed manual marking
Online/Offline – Some tools offer either or both, central co-ordination advised
Multiple markers – Central co-ordination is advised when you divide your marking
Wait and hide - Don’t start marking until due date has passed and hide relevant columns
Moderation
What to send out – File/paper, including plagiarism detection etc
Feedback and returns (post date)
Data Management and Data Curation

edgehill.ac.uk/ls
 User Experiences
FoHSC
• Turnitin – Faculty wide adoption
– Training and process consultancy
– Consistency
– Support
– Evolution of central control and management
• Assignment Handler – Portfoilio/Level wide adoption
– Training and process consultancy
– Mixed portfolio confusion (CPD and Pre-Reg)
– Student/staff confusion (Which system and process)
– CPD – Moved to Turnitin
• Exams (A and P, Mat Pack, Manual Handling)
– Set-up – Changing course teams
– Data curation
FoE
• Pebble Pad,
• Campus Pack

edgehill.ac.uk/ls
Preview your course with ‘Add Test Student’

Go to the course:
• Control Panel
• Course Tools
• Add Test Student
• The panel opposite appears:

Your student account name is:

• YourLoginName_S (i.e. caina_s)

You can add this student to any course you are an

instructor on.
Learning Edge: Add Test Student http://www.eshare.edgehill.ac.uk/1050/

edgehill.ac.uk/ls
Options

edgehill.ac.uk/ls
Blackboard Assignment Features
• Submitting work electronically (eSubmission)
increased flexibility
• Marking offline
Download in batch
• Marking work online (eMarking) – Issues with Crocodocs
reduced marking time
• Comments and Feedback(eMarking)
improved feedback consistency
• Student Expectations
meeting student expectations of online assignment submission

edgehill.ac.uk/ls
Blackboard
Assignment -
Interface

edgehill.ac.uk/ls
Blackboard Assignment Advice
• Plan B (have one, but don’t advertise it)
eMail?
• Test student
Use a different browser
• Submit as a single file
Use a template – Cover sheet, Los, Feedback etc (one doc)
• Single / multiple attempts
If single you may have to reset
• Dates
Hand in on Thu, at 12pm?
• Hide columns during marking period
… because if you don’t students see their draft results!?

edgehill.ac.uk/ls
Turnitin Features
• Submitting work electronically (eSubmission)
increased flexibility
• Detecting plagiarism (Similarity indexing)
academic integrity
• Teaching referencing skills
formative and summative learning tool
• Marking work online (eMarking)
reduced marking time
• Comments and Feedback(eMarking)
improved feedback consistency
• Student Expectations
meeting student expectations of online assignment submission

edgehill.ac.uk/ls
Turnitin Interface

Originality/GradeMark/PeerMark
edgehill.ac.uk/ls
Turnitin Advice
• Files <20MB, <400 pages
Word better than PowerPoint, PDFs (5-20% fail), any file type
• Consistency – Programme, Portfolio, Faculty
same settings between modules
• Students responsible for own work
don’t change policy - 6 weeks storage with paper copies
• Not as flexible as a box ……. but more available
a second late is a second late!
• Understand the students' perspective
role play a student with ‘add student
• Know your process ……. if not ask!
lates, re-sits, EMCs, new drop-boxes, new areas ……
…. and always, always, always back -up

edgehill.ac.uk/ls
Data Management

edgehill.ac.uk/ls
Data Management – Tutor practice
Short Term – For the length of the module/Academic year
Why
• Short-term data storage (for all the same reasons you may have kept an individuals
assignment)
• Second and external marking/moderation
• Privacy – Other students’ marks may be seen every time you have to view
someone's work, particularly important in student tutorial/class events.
• Need to present/look at some assignments/work, where there is no access to the
internet.

How
• Check data curation procedures (admin)
• Analysis future needs, by what you have done in the past
• Export data and store it with in departments/faculties

edgehill.ac.uk/ls
Data Curation

edgehill.ac.uk/ls
Data Curation – Admin practice
Long Term Archiving
Why
• Blackboard upgrades (changes to existing VLE (5yr Licence))
• Data storage/archive - how long courses will remain available for
• Details transferred to SID ASAP (BB is not an alternative to SID)

How
• Don’t change policy (or get lazy) just because its online
(but digital stuff lasts forever … doesn’t it?)
• Analysis future needs, by what you have done in the past
• Export data and archive it with in departments/faculties
• Create reports at Grade Centre level and download/copy individuals work at tool level
(i.e. Turnitin)

edgehill.ac.uk/ls
Trouble Shooting and Support

edgehill.ac.uk/ls
Trouble Shooting and Support
• Learning Services Helpdesk Level’s of support
1 – Help desks
• ltdsupport email 2 – LTDOs
• LTD Operations Co-ordinator 3 – Escalated to providers
• LTDOs
• Faculty Senior Solstice Fellows
• Faculty Administrators
• DDE Blackboard area – Enrol
Exemptions include; Content and tool development/management/set-up, bespoke process issues,
enrolment issues, etc.
We will help consult on all aspects of TEL including those identified exemptions

edgehill.ac.uk/ls
Bespoke needs
We offer bespoke training, awareness and implementation
of technologies and processes.
• Team approach/members
• Needs assessments
– Present process
– Proposed process
– Critical processes
• Block out time for group session

edgehill.ac.uk/ls
Questions and Links

edgehill.ac.uk/ls
Specific Links
Please note: These guides may be/become slightly out of date as many of our systems have regular routine upgrades,
plus they may also have been developed for a particular audience which doesn’t match your requirements. Therefore,
when you use these guides please have this in mind.
Contact your faculty Learning Technologists if you need any further assistance 01695 650757 (x7754)
Turnitin
• Turnitin - Setting up a Paper Assignment (PB - Mar 13) http://www.eshare.edgehill.ac.uk/3087/
• Getting Started with the Turnitin for iPad App (MJ - Aug 13) http://www.eshare.edgehill.ac.uk/3727/
• Turnitin for formative assessment (DC - Oct 13) http://www.eshare.edgehill.ac.uk/4060/ (presentation with set-up)
• Turnitin – Submitting Work (CC – Mar 13) http://www.eshare.edgehill.ac.uk/3224/
• Students FAQ (KR – Sep 11) http://www.eshare.edgehill.ac.uk/883/ (Slightly out of date, but a good reference point)
Blackboard Assignment
• Blackboard Assignment - Creating a Blackboard Assignment Drop-box http://www.eshare.edgehill.ac.uk/2528/
• LTD7013: Blackboard Assignment Resetting the Assignment Dropbox http://www.eshare.edgehill.ac.uk/3070/

edgehill.ac.uk/ls
Associated Links
Please note: These guides may be/become slightly out of date as many of our systems have regular routine upgrades,
plus they may also have been developed for a particular audience which doesn’t match your requirements. Therefore,
when you use these guides please have this in mind.
Contact your faculty Learning Technologists if you need any further assistance 01695 650757 (x7754)
Grade Centre
• LTD7014: Create additional columns (in Grade Centre) (for ‘offline’ submission)
http://www.eshare.edgehill.ac.uk/3069/
• LTD3036 Hiding a Column from Student View http://www.eshare.edgehill.ac.uk/3068/
• LTD3033.pdf Creating a 'My Grades' menu button http://www.eshare.edgehill.ac.uk/2678/
Mobile
• Blackboard Mobile Learn: Best Practices for Making Online Courses Mobile-Friendly
http://www.eshare.edgehill.ac.uk/1372/

edgehill.ac.uk/ls