Location: Olathe, KS
Job Code: PSYCH – KS
Professional Test Development opportunity with PSI Services LLC.
- Performing assignments to lead and support the construction, maintenance, and validation of professional certification tests
- Designing and conducting job/practice analysis studies, including surveys and focus groups
- Developing test specifications
- Developing test items for written and performance exams
- Facilitating exam development workshops, committee meetings, and training sessions, which includes travel
- Conducting statistical analyses of items, constructing item banks and examinations, and evaluating exams using CTT and IRT methods
- Designing and implementing equating, linking, and item banking designs
- Conducting standard setting studies
- Providing consultation services and guidance to professional associations regarding the development and maintenance of certification examinations, including support for NCCA and ISO accreditation requirements
- Writing technical reports
- Making presentations at conferences, client meetings, and business development settings
- Ph.D. in Educational Measurement & Statistics, Quantitative Research Methods, Industrial/Organizational Psychology, Psychometrics, or highly-related discipline
- At least 3 years experience in test development and psychometric methods required
- Graduate training and experience in psychometrics, measurement theory, test development, validation, item bias, standard setting
- Knowledge of SAS or SPSS, Excel, and Word required.
- Experience in using of IRT software programs (i.e. Winsteps, Parscale, BILOG) and CTT applications strongly preferred
- Experience with large-scale testing programs, including Certification and/or Licensure applications preferred
- Experience with NCCA and ISO 17024 accreditation standards strongly preferred
Knowledge, Skills, and Abilities Needed:
- Must be well versed in psychometric methods, measurement principles, test design, and validation
- Oral communication skills are important to make client presentations, facilitate examination committees, and participate in professional organizations.
- Written communication skills are needed to prepare technical reports, develop validation documents, and maintain email correspondence with clients and team members
- Analytical skills are required to identify, evaluate, and solve assessment-related problems
- Teamwork skills are required to work in a collaborative environment with other measurement professionals and support staff
- Project management skills are required to effectively manage multiple project assignments, timelines, deliverables, and milestones
If you are interested in the Psychometrician position, please submit your resume to firstname.lastname@example.org with job code PSYCH – KS on the subject.