The balance of online proctored exams and test center proctoring has experienced a massive shift since the challenges of the pandemic and regional lockdowns. As a result, online proctoring has seen vastly accelerated implementation as credentialing bodies continue their proctoring service in a new, expanded marketplace.
The shift away from reliance on exam test centers was imperative during lockdown and through social distancing, and many organizations implemented critical changes to the way they administered exams to test takers in a short space of time. Remote learning and automated proctoring gathered pace quickly, and remain a popular way for exams and online assessment to be carried out anywhere a test taker can find an internet connection.
At PSI, this included changes to:
- Policies and Procedures– Certifying bodies identified new proctoring modalities and implemented PSI Bridge™ to augment the test delivery process. Consequently, online proctor administration rules and exam security concerns had to be addressed in the context of this new environment.
- Vendor Relationships– Weekly implementation meetings for online proctoring, as well as monitoring statistical outcomes, were introduced with no changes to COI or NDA agreements.
- Technology Configurations– There was a move in proctoring software to a new technology-enabled scheduling system, the implementation of single sign-on, and the development of new APIs to transmit candidate data. In addition to these and numerous other process changes, communication to candidates was another critical area that required revisiting. For example, during lockdowns that closed test centers, emails had to be sent to candidates who were already registered for exams so that extensions for eligibility could be provided. Communications about computer specifications for online exams and proctoring were also required, as well as clear instructions on accessing support in the event of technical issues.
Testing organizations have had to address the impact of technical issues on the candidate experience, particularly when those issues prevent candidates from completing their test. When this happens, implementing processes that preserve the continuity of the candidate journey has needed careful consideration and a reliable proctoring service is essential. Issues such as the extension of eligibility or the provision of timely re-take opportunities, potentially under different delivery modalities, must be clearly defined and communicated.
Furthermore, privacy policies and security measures had to be evaluated and revised to take account of the fact that those taking exams via remote proctoring may have utilized any the following:
- Lockdown browsers, limiting usage of other apps, tabs, messaging, sites, etc.
- Microphone/webcam check
- Candidate authentication using valid ID
- Camera panning and room scans
- Recorded exam sessions
- Exported data transfers
- Proctor troubleshooting
With the rapid shift to online proctoring, credentialing organizations were faced with determining and deciding between what constitutes a major infraction versus a minor infraction when it comes to cheating. This means that the role of the proctor in online proctoring has become even more important.
Trained third-party proctors, like those at PSI, have no vested interest in the certification program or the candidate taking the exam. Proctors participate in live monitoring with a set of predetermined rules set out by the credentialing organization to help detect any violations, thereby giving a consistent experience across all test takers. Chat and audio capabilities allow PSI proctors to communicate with test takers if needed as they are taking the exam, with a proctor incident log to document the test taking experience across candidates.
As the market moves into phased re-openings, we are seeing test centers re-opening and both modalities (in-person and online proctoring) becoming available to test takers. Studies show that pass rates in online proctoring are similar to in-person pass rates. Performance indicators are similar overall regardless of the testing modality used.
With candidate experience surveys, credentialing organizations can further improve their online proctoring processes and address any concerns before they become larger issues for test takers. Survey responses overall have indicated satisfaction with the remote scheduling and registration process as well as the experience itself.
Online proctoring, like any technology, is on an arc, it continues to improve as more organizations utilize it and refine their processes. In addition to general improvements, online proctoring is seeing some future-forward implementations such as gaze detection, facial recognition, mobile device auto detection, and automatic candidate motion alerts, among others. The technology continues to mature in an effort to accommodate test takers requiring the convenience of online proctoring.
As we move through the challenges of a pandemic and its recovery, it is clear that online proctoring has and will become a consistent and more pronounced presence for credentialing organizations looking to keep their businesses moving. And that is not to say that test centers will become obsolete – but these modalities will likely easily co-exist with no marked difference in metrics or performance.
Statistical analyses suggest that outcomes in either proctoring modality do not differ, and candidate satisfaction appears to be similar in most respects. Having both (with the assumption that it is safe to continue test center operations) also gives candidates the opportunity and flexibility to choose which approach works best for them. However, as with any change in test administration, work must be done to update policies, procedures, and candidate communications to ensure a seamless and secure testing experience.
Find out more about online proctoring with our guide.
PSI powers world leading online proctoring tests. Delivered with trusted science and the very best test taker experience. Speak to PSI about becoming a test partner or request a demo today
