Credentialing exams have rapidly transitioned toward online proctored formats since COVID-19. Many certification and recertification candidates are older adults (Workcred, 2021) who are assumed to struggle with the technical aspects of online exams. Determining whether this test administration modality is fair to them is crucial to ensure the validity of online proctored exams for all age groups.

Online proctored exams administered at a private place of the candidate’s choice require tasks like operating webcams and microphones, troubleshooting internet or computer issues, and real-time proctor communication. Structured computer education became common only after 2000, leaving many older adults born before 1980 with limited digital literacy (Code.org Advocacy Coalition et al., 2021). Older adults generally use computers only for essential activities and prefer minimal screen time (Faverio, 2022). Certain professions, like crane operation, rarely involve computer use, further reducing familiarity. Therefore, limited early computer education, reduced professional need, and minimal personal interest in digital platforms may present significant barriers for older candidates in opting for online proctored testing.

The present study examined modality choices and performance of older candidates (for this study, we defined candidates aged 57 to 59 as "older") in online proctored exams for the mobile crane operator credential offered by the National Commission for the Certification of Crane Operators (CCO). 

The mobile crane operator credential requires passing the core examination and one of three specialty examinations. The 90-minute core written exam comprises 85 scored items that assess overall mobile crane operation. The 60-minute specialty written exams each comprise 26 scored items that measure specific skills, such as using reference materials and performing calculations for operating particular types of mobile cranes. CCO administers these written examinations through computerized test center testing (TCT), computerized group-administered testing at authorized event online testing centers (EOT), and remote online proctored testing (OPT) at a private place of the candidate’s choice. OPT requires independent technical management from the candidates. This study analyzed data from 16,860 candidates in 2024, comparing older candidates (upper quartile, N = 4,206) with younger ones (lower quartile, N = 4,348). The findings clarify older candidates' modality preferences, behaviors and performance in online proctored crane operator exams.

Below are a few questions answered through the results of the study.

Who are the older candidates of the Mobile Crane Operator credential?

Older mobile crane operator candidates are typically aged 57-59, while younger candidates are aged 26-28, resulting in a 30-year age gap. This gap may affect their test modality preferences and performance on technology-intensive online proctored exams. Approximately two-thirds of older candidates take the exam for recertification, suggesting familiarity with its content and format. Meanwhile, 94% of younger candidates are first-time test takers and likely less familiar with the examination content and format. The performance gap between young and old candidates is consistent across both certification and recertification populations. Therefore, the first time taking does not appear as a significant confounding factor (Table 1). 

Do older candidates avoid online proctored exams?

No. We anticipated that older candidates might avoid OPT due to technological demands, but it does not appear to be the case. Results of the study showed that 12-16% of older candidates chose OPT across core and specialty exams, while slightly more (18-30%) preferred computerized TCT, which is technologically simpler. These modest differences indicate that online testing requirements do not significantly deter older candidates. Similarly, 14-22% of younger candidates chose OPT, suggesting that online proctored testing is not the top choice for either group. 

Most older certification candidates (55-69%) chose EOT in centers linked to training providers. Among recertifying older candidates, 35-41% continued with EOT, while others may have shifted to other modes as they gained more job experience. Many likely remained with these familiar centers for recertification due to the support they offer. Younger candidates showed similar preferences. About 64-75% of those certifying and 34-44% of those recertifying selected EOT. 

Most candidates favor EOT. Since the technological setup is similar for EOT and TCT, the choice likely reflects comfort with training center environments rather than technological ability. Although slightly fewer older candidates select OPT, the technological barrier does not appear to be a significant deterrent.

Do older candidates perform poorly on online proctored exams?

No. Older candidates perform slightly better than younger ones on all three test administration modalities for the core exam (Cohen's d = 0.113 to 0.237). However, they score approximately one point lower on specialty exams at our organization, showing small to moderate differences (Cohen's d = 0.291 to 0.633). Specialty exams involve complex tasks like split-screen navigation, referencing materials, and using onscreen calculators, likely contributing to older candidates' slight underperformance. Crucially, performance trends remain consistent across all test modalities (Figure 1). This indicates that OPT does not specifically disadvantage older candidates. Those uncomfortable with OPT likely opt for in-center alternatives, leveling the playing field once the choice is made.

Do older candidates take longer to finish online proctored exams?

Older candidates consistently take longer to complete all exams. On the 90-minute core exam, they need three to six more minutes than younger candidates on all three test administration modalities (Cohen's d = 0.238–0.338), and four to nine minutes longer on 60-minute specialty exams (Cohen's d = 0.436–0.876). The complexity of digital navigation and multistep tasks likely contribute to this time difference. However, the timing gap is consistent across all test modalities (Figure 2). This suggests that OPT does not uniquely disadvantage older candidates regarding time management.

OPT: Not a Cause for Concern

This study explored the performance of older mobile crane operator credentialing candidates on online proctored testing (OPT) administered at a private place of the candidate’s choice in 2024. These candidates, mostly in their late 50s and often recertifying, clearly preferred test centers tied to training. While they scored slightly lower and took more time on the complex specialty exams, these patterns held across all modalities. Thus, OPT did not introduce any evident fairness bias against older candidates.

Disclosure: ChatGPT was used for minor editing and to align the article to I.C.E. submission guidelines.

Did you enjoy this article? I.C.E. provides education, networking and other resources for individuals who work in and serve the credentialing industry. Learn about the benefits of joining I.C.E. today. And if you enjoyed, share this article with a friend or on your social media page.

References

Code.org Advocacy Coalition, Computer Science Teachers Association, and Kapor Center. (2021). 2021 State of Computer Science Education: Accelerating Action Through Advocacy. Code.org. https://advocacy.code.org/stateofcs

Faverio, M. (2022, January 13). Share of those 65 and older who are tech users has grown in the past decade. Pew Research Center. https://www.pewresearch.org/short-reads/2022/01/13/share-of-those-65-and-older-who-are-tech-users-has-grown-in-the-past-decade/​

Workcred. (2021, March). Variable impacts of new credentials for the older worker (Workcred report). Workcred. Retrieved from https://www.workcred.org/Documents/Variable-Impacts-of-New-Credentials-for-the-Older-Worker.pdf

Table 1. Total score of certification and recertification populations of older and younger candidates

Figure 1. Average Candidate Score on Test Administration Modalities

Figure 2. Average Candidate Response Time on Test Administration Modalities