Senior Psychometrician


Senior Psychometrician


Virtual, North America


Full-time salaried

Opening Date:


Closing Date:

Open until filled

Reporting To:

Director, Professional Credentialing or Director, IT Credentialing


Position Description

The Senior Psychometrician will engage in a wide range of activities within either the Professional Credentialing or IT Credentialing verticals.  The Senior Psychometrician will be expected to work with clients by providing consultative services including (but not limited to) program design, test development, and psychometric analyses.  In addition, the Senior Psychometrician will conduct psychometric analyses utilizing both classical test theory and item response theory measurement models and facilitate exam development workshops, as necessary.  The Senior Psychometrician will be responsible for ensuring that all activities follow accepted professional standards and industry best practices to the extent possible. The Senior Psychometrician collaborates with internal team members to provide these services to a range of external clients in certification and licensure testing programs.  The Senior Psychometrician will also be expected to maintain an active research program, including presentations at major industry conferences and active engagement with the professional measurement community.  This position requires up to 50% travel.

Key Responsibilities

  • Consult with clients to effectively identify needs and develop solutions regarding current measurement theory, psychometric analyses, and test development policies and practices
  • Lead projects, provide support for, review deliverables, and ensure quality of completed work focused on the design and execution of test development and maintenance processes including program design, test design, domain analysis, test content review and development, test form assembly, test administration, standard setting, validation studies, and program audits
  • Lead and contribute to request for proposal (RFP) evaluation, proposal development, and statements of work that accurately scope level of effort associated with recommended solutions
  • Facilitate workshops such as program design, practice and domain analysis, standard setting, alignment studies, and performance-based assessment exam development
  • Design, plan, conduct, and document psychometric analyses (e.g. item and test analyses, item calibration, scaling, equating, forms assembly) using classical test theory and item response theory (IRT) measurement models
  • Interpret and clearly communicate the results of test development activities and psychometric analyses to diverse audiences through written and oral reports
  • Contribute to the field of psychometrics with an active research agenda, including identifying and pursuing opportunities to partner with clients on research, publications, or presentations

Position Requirements

  • Doctorate in Measurement, Psychometrics, Educational Psychology, or closely related field.
  • At least 7-10 years of applied experience with program and validity framework design, job/domain analysis, item writing, psychometric analyses including classical test theory, item response theory, scaling, equating, and standard setting, ideally in credentialing
  • Experience working with clients and policymakers in the definition of program requirements, as well as project milestones and deliverables
  • Experience leading projects, including the development of resource estimates, management of client communications, and final report development
  • Excellent written, verbal, presentation, analytical, and interpersonal communication skills
  • Ability to work well independently as well as with diverse teams
  • Ability to work effectively in a virtual environment (e.g., discipline, time management)
  • Proficiency with SPSS, Bilog, Parscale, R, Winsteps and/or other analysis software
  • Proficiency with Microsoft Office products (e.g., Word, Excel, PowerPoint, Project, Outlook)
  • Experience with assessment program accreditation a plus
  • Up to 50% travel