High Stakes Unsupervised Testing
What we recommend
Online remote testing has changed the approach people need to take regarding testing. Since this is often unsupervised there are two critical issues that need to be addressed which are
- The security of the items
- The identity of the candidates
The solution we have recommended to ALL our clients for many years is a Test Identity Validation Process (see FAQ’s below). This is based on the fact that if people have the ability they should be able to replicate it. It involves re-testing candidates that make it through to a second or later stage of a selection process following screening using online tests that have been administered unsupervised.
This process requires that the second test has not been exposed and so we supply tests specifically for this purpose (our Closed Tests). These are only administered in supervised conditions thus ensuring that there is no prior knowledge of the specific items. Any person who scores significantly less the second time should be investigated since they may have had prior knowledge or help with the online unsupervised test.
Current features
With multiple versions of the tests clients can choose to vary the versions they use. Some will change the tests they use on a yearly basis; other do this more or less frequently. This reduces the test exposure and the likelihood that pre-knowledge will influence results. However there is no way to reduce the risk of cheating to zero when using online unsupervised tests. For this reason Team Focus has always recommended to its clients that they conduct a Test Identity Validation Process (see FAQ’s below). However, to reduce the risk of cheating and to increase the chances of detection Team Focus has implemented many anti-cheating measures. These include the monitoring of behaviour and timing patterns although Team Focus cannot disclose any specific measures put into place with any specific customers. Our test delivery platform – PfS – has successfully served over one million PfS online tests since 2003 to blue chip companies and government organisations.
New features and capabilities for 2019
The landscape is changing and in 2019 we are introducing additional algorithum-based test monitoring features on the Profiling for Success (PfS) online test platform. More sophisticated behavioural analysis is becoming a highly effective way to identify individual and groups attempting to cheat on tests. We are making the way that customers implement this capability to be highly configurable including flagging abnormal test results and following up on abnormal test results based upon the specific requirements of each customer. In addition, some clients would like to see test items presented in a randomised way which will be a feature available early in 2019. This feature will generate additional behavioural analysis data to identify attempted cheating even further. If required we can also provide technology solutions such as locking down remote PCs, PC Browers, and keyboards and remote screen displays to further deter and prevent attempts to cheat on online tests.
The above is an automated solution aimed at controlling the test taking environment and analysing behaviour. Some clients would prefer to use online proctoring which means that test takers are observed using video recordings. This can be done live or recorded for later examination. This adds another level of confidence in the results obtained from remote testing. Team Focus are partnering with industry leading remote proctoring organisations when it is impractical or not cost effective for early stage candidates to travel to countries and locations where local human proctoring can assure the organisation that all candidates are taking tests properly.
Team Focus invites its customers to get in touch to discuss all these capabilities, learn more about PFS anti-cheating capabilities and how to best implement them in 2019.