This monthly series delves into creating, delivering and reporting on valid and reliable assessments. "Unlocking the Potential of Assessments" offers advice and thought leadership to those just starting out with assessments, those who have been in the industry at length and anyone with a keen interest in the future of assessments lead by host, John Kleeman.
Join Questionmark on our quest to discover and examine the latest in best practice guidance with a wide array of guests - including assessment luminaries, industry influencers, SMEs and customers - and discuss "all things assessment."
John Kleeman is joined by assessment luminary, Marten Roorda, Chief Measurement and Learning Officer at AI and education company, Riiid Labs. Marten is a pioneer in educational technology, a leading innovator in computer-based testing, e-learning and adaptive learning and has an extensive background, which includes ACT, CITO and more. Marten shares how he got started in assessment and discusses how to use AI in assessment, adaptive learning and his best practice advice.
28 min 41 sec
John Kleeman is joined by assessment luminary, Alina von Davier, Ph.D, Chief of Assessment at Duolingo. At Duolingo, Alina and her team operate at the forefront of computational psychometrics. Alina shares how she got into assessment and discusses how to make a high stakes test equitable with multiple instances, her experience as a female leader in the assessment space and her advice to people who want to progress in assessment.
32 min 59 sec
John Kleeman is joined by assessment luminary and "Learning Enthusiast," Riz Khan of SAP. Riz is Global COO and Vice President of Training and Adoption at SAP and frequently partners with CxOs, executives and leadership groups to help them understand the importance of corporate education and the power of user adoption. Riz shares his background in assessment and learning and discusses the value of investing in learning and training and how assessments fit in, his best practice advice and the future of learning and adoption.
29 min 12 sec
John Kleeman is joined by assessment luminary, Gavin Cooney, CEO and co-Founder of Learnosity, the leading provider of assessment infrastructure for the learning industry. As you may have heard Learnosity recently acquired Questionmark. Gavin discusses how he got into assessment and dives into various topics, including the importance of accessibility and inclusivity in education, the trends he's noticed and how Questionmark and Leanosity fit together.
27 min 32 sec
John Kleeman is joined by assessment luminaries, Sharon Shrock and Bill Coscarelli, co-authors of award winning book "Criterion-Referenced Test Development." Sharon and Bill discuss how they got into assessment and tell the story of their book. The pair also shares patterns in testing they've seen working with various organizations and their advice.
31 min 3 sec
John Kleeman is joined by assessment luminary, Dr. Leanne Furby, Director of the Assessment Services Division at National League for Nursing. Leanne discusses how she got into assessments, talks about the assessment program at NLN and remote proctoring during COVID-19 and explains spaced learning and how it helps.
John Kleeman is joined by assessment luminary, Akil Bello, who is an expert in assessment reform. He currently serves as the Senior Director of Advocacy and Advancement at FairTest, the National Center for Fair and Open Testing. Akil discusses how he got interested in assessments and talks about his work with admissions tests, whether recruitment tests are fair and his thoughts on what the testing industry should be doing better.
27 min 5 sec
John Kleeman is joined by assessment luminary, Helen Baron, who is an expert in psychometric measurement and assessment. Helen works with test publishers and employers on developing tests and assessment processes. Helen discusses how she got into assessment, and dives into her time at SHL, the different types of assessments used in recruiting and where personality tests come in and her work on assessment standards.
27 min 16 sec
John Kleeman is joined by assessment luminary, Wendy Kirkpatrick, President and Founder of Kirkpatrick Partners. As a global driving force of the use and implementation of the Kirkpatrick Model, Wendy leads companies to measurable success through training and evaluation. Wendy discusses how she got into training and assessments, and dives into the four levels of evaluation, why level three is the most important and how to measure behavior and her tips for evaluating training while remote working.
32 min 25 sec
John Kleeman is joined by assessment luminary, Chris Norton, Director at Mentor Group, a global sales transformation company based in UK. Chris shares his background and experience with assessments and discusses the value and best practice advice on using assessments in the sales space, the new Questionmark B2B Sales Qualification by Mentor Group and the future of digital selling.
31 min 34 sec
John Kleeman is joined by assessment luminary, Bernt Nilsen, founder of Datakoret (ECDL Norway) and Norsk Test, the leading test developer and supplier of national certification programs in Norway. Bernt discusses how he got into the assessment world and shares what's important when running a testing service business, his best practice advice for creating high-stakes assessments and the value in anonymous testing.
27 min 30 sec
John Kleeman is joined by renowned attorney, Alan Thiemann of Hans Santos, PLLC and General Counsel to the Assocation of Test Publishers (ATP). Alan discusses how he got into testing and his role at ATP and dives into topics such as privacy and remote proctoring, how to avoid being taken to court for a bad test and testing controversies in the US.
28 min 17 sec
John Kleeman is joined by assessment luminary, Liberty Munson, who is the Senior Psychometrician for Microsoft. Liberty discussess how she got into assessments, why people stay in jobs, the value of certifications and the future assessments, among other topics. Liberty also shares her aha! moment - listen to hear more!
33 min 54 sec
John Kleeman is joined by assessment luminary, Jim Holm, CEO of Examity, the leading solution for learning validation and test security. Jim discusses how he got into his current role and the challenges he's faced with COVID-19, and dives into remote proctoring, including the value, his best practice advice, the future of proctoring and his views on artificial intelligence and proctoring.
30 min 33 sec
John Kleeman is joined by assessment luminary, Paul Crump of Cambridge Assessment, the non-teaching department of the University of Cambridge that develops and delivers examinations and tests around the world through their three exam boards. Crump discusses his background in assessments and dives into the Thinking Skills testing initiated by Cambridge Assessment and his best practice advice for those creating questions and assessment.
28 min 49 sec
Host, John Kleeman is joined by assessment luminary, Sue Martin, a pioneer in the assessment industry responsible for implementing the first test center network in Europe. Sue shares her story and advice on transforming certification programs. Discover the five most important considerations when setting up your certification program.
29 min 52 sec
John Kleeman is joined by assessment luminary, William G Harris, Chief Executive Officer of the Association of Test Publishers (ATP), the leading international organization for publishers of assessment programs. G Harris discusses his background in assessments and dives into his advice for those starting out in assessments, the importance of validity in assessments and the different sets of standards for testing, among other topics.
26 min 14 sec
John Kleeman is joined by assessment luminary, Dave Foster, CEO of Caveon, the first test security company. Dave is a psychologist, psychometrician and recognized luminary in the measurement industry. In this episode, Dave discusses his background in assessments and dives into the main risks and threats of testing, his recommendations on the key measures you should take with test security and how statistical analysis fits into this, among other topics.
27 min 21 sec
John Kleeman is joined by assessment luminary, Steve Dept, CEO and founding partner of cApStAn, a high-profile language service provider. Steve received his education in English, Dutch, French and German but he is essentially an autodidact and a field practitioner. In this episode, Steve discusses his background in assessments and dives into good practice advice for translating tests, including the translation process, translation technology and other translation resources.
37 min 6 sec
John Kleeman is joined by one of Questionmark's product managers, Steve Lay. Steve is an expert on scalable, computerized assessment and integration between systems, and has ensured that the million of assessments delivered by Questionmark are robust and scalable. He is also active in the IMS and other e-learning standards groups. In this episode, John dives into many topics with Steve including the impact of technology on the assessment process, QTI and LTI and proctoring.
34 min 56 sec
Host, John Kleeman is joined by assessment luminary, Jim Parry, who has over 40 years of experience as a course designer, developer and instructor. Jim discusses his 12-year tenure at the Coast Guard as a civilian employee as the Test Development and e-testing Manager, during which he guided the move from paper to online testing for the entire Coast Guard.
35 min 42 sec