The following individuals have contributed to ICE Digest and Credentialing Insights. The ICE Editorial Advisory Committee and staff thank them for their time, talent and thought-leadership.
Cynthia Allen founded SeaCrest in 2006 with Janice Moore. She and Moore have completed more than 190 successful accredited applications for NCCA, ABSNC, and ANSI. Allen is the Chair of the ICE Editorial Advisory Committee and has authored "Removing Roadblocks and Clearing the Way for Accreditation Success: Part 1” and “Removing Roadblocks and Clearing the Way for Accreditation Success: Part 2.”
Janice Moore is the co-founder of SeaCrest, established in 2006, along with Cynthia Allen. Together, she and Allen have completed more than 190 successful accredited applications for NCCA, ABSNC, and ANSI. Moore has authored "Removing Roadblocks and Clearing the Way for Accreditation Success: Part 1” and “Removing Roadblocks and Clearing the Way for Accreditation Success: Part 2.”
Nathan Thompson is Chief Product Officer at Assessment Systems Corporation, where he has the opportunity to work his mission of elevating psychometrics through the design of software to automate mundane processes like Angoff studies and annual statistical reports, while making sophisticated approaches like adaptive testing and psychometric forensics more accessible. Dr. Thompson received his PhD in Psychometric Methods from the University of Minnesota, then briefly worked at Prometric and the Joint Commission on Allied Health Personnel in Ophthalmology before moving to ASC in 2008. His scholarly interests remain with item response theory and computerized adaptive testing, where he maintains a research program and is a frequent contributor to professional conferences as well as journals. He is also a cofounder and Membership Director of the International Association for Computerized Adaptive Testing. Thompson is the author of "Adaptive Testing: Multiple Choices, What’s The Right Answer?"
Dr. Sarah Carroll is a senior psychometrician at Castle Worldwide, where she leads her clients through key psychometric processes, including job analysis studies, test and item development efforts, standard setting studies, and statistical and psychometric analyses and reporting. She also has extensive experience in the design and analysis of non-cognitive assessments, surveys, questionnaires, and pre-employment tests. Sarah is actively involved in research, has presented her research at numerous national and international conferences, and has several peer-reviewed journal publications. She currently serves as a psychometric reviewer on the Institute for Credentialing Excellence’s (ICE) Assessment-Based Certificate Accreditation Committee. Sarah earned her MSc and PhD in industrial/ organizational psychology from the University of Calgary in Alberta, Canada. Sarah authored "Job Analysis: Beyond the Basics."
Julia Judish, special counsel at Pillsbury Winthrop Shaw Pittman LLP in Washington, D.C., serves as a trusted adviser on all facets of the employment relationship and on nonprofit governance. Julia provides critical and strategic counseling to nonprofit organizations and private sector employers. Her practice includes ADA accessibility, credentialing and affirmative action issues. In addition to counseling clients on legal compliance, personnel best practices, employment contracts and resolution of sensitive employee disputes, she also advises on structure, governance, fiduciary duties and related areas. She writes extensively on employment and nonprofit legal issues and is a regular speaker on these topics. Judish is the author of “Legal Standards for Disciplinary Policies and Procedures of Certification Organizations.”
Carla Caro, MA, is a research director at Professional Examination Service (ProExam, an ACT-affiliated company). Caro has previously worked as a public policy analyst and in the area of educational advocacy. Her volunteer activities with ICE include serving on the NCCA Standards Revision project in the Technical Advisory Group for Psychometrics and on the Publications and Government Affairs committees. Caro holds the ICE certificate and is a frequent presenter at the ICE annual conference. Caro is the co-author of "Can't Put a Price On It: The Value of Fostering Volunteer and SME Engagement."
Jacqueline Carpenito is a research director at Professional Examination Service (ProExam, an ACT-affiliated company). She holds the ICE certificate, has served on the ICE Publications Committee, and is a frequent presenter at ICE and other industry conferences. Carpenito is the co-author of "Can't Put a Price On It: The Value of Fostering Volunteer and SME Engagement."
Anthony Gage, MS, manager of psychometrics at Ascend Learning, has been in the measurement and assessment industry for 10 years. Currently, he is responsible for managing psychometrics activities for all nine NASM and NHA certification programs. His work with subject matter experts has included facilitating practice analysis, standard setting studies, and the development of low-stakes assessments for continuing medical education. Gage is the co-author of "Can't Put a Price On It: The Value of Fostering Volunteer and SME Engagement."
Margaret Harrison, MS, CPNP-PC, CAE, has served as PNCB’s chief executive officer since 2011 and previously served as PNCB’s executive vice president for general practice exam development from 2006 to 2011. She is a graduate of the Walter Reed Army Institute of Nursing, received her bachelor of science in nursing degree from the University of Maryland and her master’s in nursing degree from the University of Arizona. She has more than 30 years of military and civilian pediatric nursing experience as a nurse practitioner and nurse manager. Harrison is the co-author of "Retention Rates for Voluntary Certifications."
Lori Anne Boocks has served as PNCB’s director of marketing and communications since 2006. Her focus is to create and implement certificant-centric strategies that result in growth, such as the influential No Pass, No Pay testing program. Additional experience includes development of the Campaign for Pediatric Nursing to encourage students to choose a pediatric nursing career and increase gender and cultural diversity in the profession. Boocks is the co-author of "Retention Rates for Voluntary Certifications."
Lisa Lutz is president and CEO of SOLID LLC. She has over 20 years of experience in policy analysis and program evaluation, specializing in education, employment and training issues related to military service members and veterans. Her work has concentrated on the use of occupational credentialing to promote the professional development of service members and ensure their smooth transition from the military to the civilian workforce. She has performed research, provided policy guidance and developed programs in this area for numerous organizations, including the U.S. Departments of Defense, Labor, Army, Navy, Air Force, Energy and Transportation. Lutz is the author of "American Legion Issues State of Credentialing of Service Members and Veterans Report."
Tracy Petrillo, EdD, CAE, is a nonprofit management expert and a thought leader in the areas of continuing professional education, adult learning, credentialing, certification and leadership development. She currently serves as CEO for the Academy of Integrative Health and Medicine (AIHM), a startup interprofessional medical society. Petrillo was the former Chief Learning Officer for EDUCAUSE, a nonprofit whose mission is to advance higher education by promoting the intelligent use of information technology. Dr. Petrillo is a certified association executive (CAE) who was awarded the highest national honor for staff, the 2016 Professional Performance Award, by the American Society of Association Executives (ASAE) and was named a Changemaker by MeetingsNet magazine. Tracy speaks nationally on learning innovations and educational technologies to nonprofit, medical, corporate and higher education audiences and advises educational strategy planning to create actionable initiatives for Entangled Solutions. She completed her doctorate in educational leadership and management with a specialization in human resource development. Petrillo authored “The Value of a Value Proposition Study.”
Dennis Maynes is chief scientist at Caveon Test Security. He has pioneered several methods for the statistical detection of potential test fraud, including the use of clusters to detect cheat rings and the use of embedded verification tests to detect brain dump users. He has conducted more than 450 data forensics projects for more than 50 organizations, including 11 state departments of education, 10 medical programs and 12 information technology certification programs. Maynes holds a master’s degree in statistics from Brigham Young University. Maynes authored "Taking Test Security to the Next Level Through Design."
Michael S. Finger, Ph.D., is a senior research scientist at NWEA. He previously served as the director of psychometric services at Comira. Finger earned his Ph.D. in psychometric methods from the Department of Psychology of the University of Minnesota – Twin Cities. Finger has over 15 years experience in psychometrics and high-stakes testing. He currently serves as a member of the ICE Research and Development Committee.
Jeffrey Tenenbaum chairs Venable’s Nonprofit Organizations Practice Group. He is one of the nation’s leading nonprofit attorneys, and also is a highly accomplished author, lecturer and commentator on nonprofit legal matters. Tenenbaum co-authored "Federal Appeals Court Rules in Favor of Professional Certification Board."
Andrew E. Bigart is an associate at Venable. His practice focuses on antitrust and consumer protection law, anti-money laundering and economic sanctions, and business counseling. Bigart co-authored "Federal Appeals Court Rules in Favor of Professional Certification Board."
Dr. Amy Jauman, SMS, is an author, international speaker, and university professor in her home state of Minnesota. She focuses on using social media, experiential learning techniques, and online resources to make information meaningful to adult learners in traditional and remote business and educational environments. In 2013, after completing her social media strategy certification, she became a Certified SMS Instructor and went on to become NISM’s Chief Learning Officer. In 2017, she authored the NISM textbook "Comprehensive Field Guide for Social Media Strategists: Master the Six Content Domains of the SMS Exam." Jauman has a master’s degree in experiential education and a doctorate in organization development. She authored “Strategic Responses for Certification Agencies on Social Media.”
Gavin Moore is an independent consultant focused on leveraging innovative practices and technology to bolster credentialing, education, and employment pathways and the connections between them. Since 2011, Moore has worked alongside credentialing organizations to assess and recommend meaningful improvements based on established industry standards.
Jennifer Naughton, MA Ed, SPHR, is an experienced credentialing and training leader who has delivered hundreds of client solutions throughout her career. Jennifer is passionate about training and testing and about giving back.
She is currently the Principal and Founder of Naughton Consulting, a firm that specializes in credentialing, competencies, and training. Prior to Naughton Consulting, Jennifer was a senior director at the Association for Talent Development (ATD) where she helped to create ATD’s competency-based stackable credentialing framework to better serve talent development professionals throughout their careers. She also started-up ATD’s first industry certification and certification prep businesses. Prior to ATD, she was an associate at Booz Allen Hamilton and a research scientist at HumRRO, where she managed organizational assessment, performance management, and training projects for federal agencies and associations.
She holds a Master’s in Education (Human Resource Development) from the George Washington University and is SPHR and Product Manager certified. Contact her at firstname.lastname@example.org.
Jennifer Davis is a senior psychometrician at the National Association of Boards of Pharmacy (NABP). She has over 10 years of experience in licensure/certification testing and additional experience as an institutional researcher at the University of Minnesota. Dr. Davis holds a PhD in Psychometric Methods from the University of Minnesota and a Master’s degree in Research and Evaluation from the University of Wisconsin. While in graduate school she entered the licensure/certification arena as a psychometric intern for the National Council of State Boards of Nursing. Prior to joining NABP she worked at Pearson VUE and Assessment Systems Corporation
Ron Hanchar, President and Chief Executive Officer of Hanchar Consulting Services, LLC, has been involved in the development and management of certification and licensure programs for over 20 years. In Ron’s previous roles as Executive Director and Director, he has managed all aspects of certification governance, program development, operations, and maintenance for several certifying organizations. As a result, the expertise he has gained continues to be sought after by those organizations needing help in the development and maintenance of their certification programs. Ron understands the importance of working with stakeholders in developing and monitoring quality certification programs to assure that they are legally defensible and psychometrically sound. Ron obtained baccalaureate degrees in History and Business Management from Calumet College of St. Joseph’s, as well as a Master’s degree in Business Administration from Purdue University.
Ron is the author of the Credentialing Insights article "How to Start a New Certification."
Dr. Cynthia Parshall is the Principal Consultant with Touchstone Consulting. For the last few years, she’s focused her energy on helping exam programs solve their biggest pain points through the use of well-planned nudges. Cynthia’s professional experience includes service as a psychometrician, researcher, and professor. She’s been a consultant since 2004 and she’s the lead author on the book Practical Considerations in Computer-Based Testing.
Dr. Ellen Julian has been fascinated by tests since the second grade and has been trying to figure them out ever since. Trained as a psychometrician, she helps testing programs grow and make transitions from paper to computer, and from multiple-choice to performance tests. Ellen is President of the Performance Testing Council and hosts the DC-area Testing and Certification Salons.
Robert Shaw worked as a respiratory therapist and respiratory therapy educator between 1982 and 1995. After earning a doctorate degree in Higher Education with emphases in measurement and statistics from Missouri University in 1994, Robert began advising occupational credentialing programs in 1995. Robert worked for Applied Measurement Professionals, Inc. (AMP), from 1995 through 2015 while providing psychometric direction to several programs including the National Board for Respiratory Care (NBRC). The NBRC owned AMP until the company was sold to PSI at the end of 2015. Robert is the Vice President of the Examinations division for the NBRC.
Julia Judish is Special Counsel in Pillsbury Winthrop Shaw Pittman LLP’s Washington, D.C. office. Her practice covers both employment law and nonprofit organization law, with a focus on issues affecting certification and credentialing programs, ADA accommodations, governance, and ethics codes and procedures. She is a regular speaker and author on these topics and is a co-author, with Jerald Jacobs, of the Certification and Accreditation Law Handbook (3d ed.). Julia graduated from Harvard Law School, cum laude.
Chad W. Buckendahl, Ph.D., is a Partner with ACS Ventures, LLC. His research interests include standard setting, test evaluation, validity, and legal issues. Dr. Buckendahl has designed and led validation studies for credentialing programs in architecture, dentistry, dental hygiene, medicine, education, finance, and law; general education, end of course, alternate, and English language literacy assessments in PreK-12 education; and language assessment for admissions, citizenship, and certification. Dr. Buckendahl also serves on technical advisory committees for credentialing and PreK-12 education programs; editorial boards for peer reviewed journals; and on volunteer committees for the Association of Test Publishers (ATP), Institute for Credentialing Excellence (ICE) and the National Council on Measurement in Education (NCME).
Avis D. Bullard was named BPS Director of Quality Assurance in 2016. In this role she is responsible for the implementation of ISO 17024 and the maintenance of NCCA accreditation for all BPS pharmacy practice specialties. From 2007-2016, Ms. Bullard served as a Quality Manager and a Branch Manager for URS Federal Services. She received her Master of Science Degree in Clinical Chemistry from the Rochester Institute of Technology in 1996 and recently earned her certification as a Certified Six-Sigma Black Belt from the American Society for Quality in January 2019. In 2018 Ms. Bullard served as Vice-Chair of the 2018 ICE Program Committee, and she is currently serving as the Chair of the 2019 ICE Program Committee.
For the past 17 years Ms. Bullard has implemented quality management systems in various government, industry and non-profit organizations, to include the DoD, VA, and medical device manufacturing, using the organization applicable ISO standards and federal regulatory requirements. As a quality assurance professional, she has extensive experience in helping organizations to improve service and product quality by implementing process controls, performing data analysis and providing appropriate tools for measuring and monitoring performance.
William M. Ellis MS, RPh was named Executive Director of BPS in 2011. From 1997-2011, Mr. Ellis served as CEO and Executive Director of the American Pharmacists Association (APhA) Foundation. He was the Executive Vice President for the Pennsylvania Society of Health-Systems Pharmacists from 1986-1997.
Mr. Ellis also served as the elected Chair of the Council on Credentialing in Pharmacy (CCP) from 2012-2015; CCP provides leadership, guidance, public information, and coordination for the profession of pharmacy’s credentialing programs. In 2014, he was appointed a commissioner to the National Commission for Certifying Agencies (NCCA) and was elected as the 2016 Chairman. The NCCA helps to ensure the health, welfare, and safety of the public through the accreditation of a variety of individual certification programs that assess professional competency. The NCCA is an administratively independent resource recognized as the authority on accreditation standards for professional certification programs.
After receiving his pharmacy degree from the Philadelphia College of Pharmacy (PCP), where he currently serves as the chair of the College’s Board of Visitors. Mr. Ellis completed an executive residency with the American Society of Health-System Pharmacists in 1986 and earned his Master of Science degree in health education from Saint Joseph’s University in Philadelphia in 1994.
As managing director of CFA Institute’s Credentialing division, Stephen Horan leads the development of CFA Institute designation and certificate programs, including the CFA Program, CIPM Program, and CFA Institute Investment Foundations. Horan brings a unique combination of industry and academic experience to CFA Institute. He previously served as an expert witness in securities litigation, a forensic economist in private practice preparing economic impact studies, a principal of a financial advisory firm, a financial analyst, and as a buy-side account manager and sell-side stockbroker. On the academic side, Horan served as a professor of finance and is a recognized researcher in wealth management, tax efficient investing, and derivatives. Horan holds a Ph.D. in finance at the State University of New York/Buffalo and a BBA degree in finance at St. Bonaventure University. He earned the CFA charter in 1993, the CIPM designation in 2011, and the CAIA designation in 2018.
As managing director of CFA Institute’s Credentialing division, Stephen Horan leads the development of CFA Institute designation and certificate programs, including the CFA Program, CIPM Program, and CFA Institute Investment Foundations. Horan brings a unique combinatiTJay Gerber is the Global Certification Manager for Scrum Alliance and oversees twelve certification programs which guide individuals through the application of Agile practices, principles, and values. He holds the Certified Agile Leader (CAL I), Certified ScrumMaster (CSM), and Certified Scrum Product Owner (CSPO) certifications and has helped associations make impactful changes to their certification portfolios. Scrum Alliance is the largest, most established and influential professional membership and certification organization in the Agile community. Gerber is the author of "Improving Efficiency With Scrum"
Josh Stopek is a senior manager with the CPA Exam, having served since 2007 in a variety of roles, all mainly focused on simulation development. His main role is to figure out how to improve the examination through research into accounting trends, testing and psychometric innovations and review of current of our item bank. This includes working with external accounting bodies and CPAs, developing and trying out new item types, talking with external psychometricians and testing bodies, and working with staff to think differently about assessment. Josh is a CPA, who gained experience working in external and internal audit. He has an MBA with a focus in Professional Accounting from Rutgers Business School, as well as B.A.s in Communication and Art history from Rutgers College. Josh is the co-author of “Listening to Test Takers – Pre-Testing New Item Formats and Approaches.”
Matthew Schultz joined the American Institute of Certified Public Accountants (AICPA) in March 2014 and supports psychometric research on new item types, scoring models, practice analysis, automated essay scoring, timing and other relevant research topics. Prior to the AICPA, Matthew was Director, Psychometric Services at Vantage Learning/McCann Associates. Matthew received his Bachelor’s degree in Psychology from Rutgers University, New Brunswick, and his Master’s and Doctor of Philosophy in Psychometrics from Fordham University. He has developed over 30 papers, presentations and book chapters. Matthew is the co-author of “Listening to Test Takers – Pre-Testing New Item Formats and Approaches.”
Nicholas Soto is the Vice President of Professional Development at the Construction Management Association (CMAA), specifically leading the Construction Manager Certification Institute (CMCI). Nicholas actively participates on the Board of Directors of the Institute for Credentialing Excellence (ICE), is the vice chair of the ICE Emerging Leaders Task Force and is a member of the ANSI Certificate Accreditation Program Accreditation Committee (CAPAC). He is also the past chair of the Certification Network Group (CNG) and their board of directors, as well as the past chair of the Washington DC CNG Steering Committee.