Psychometric Analyst

The Canadian Alliance of Physiotherapy Regulators (CAPR) has an immediate opening for a full-time Psychometric Analyst. Working under the guidance of the Lead Psychometrician, this role is responsible for the data analysis, scoring, and reporting of high-stakes entry-to-practice examinations and credentialing assessments for physiotherapists. CAPR is seeking a candidate with a Master’s degree in a quantitative field, 1–3 years of experience, and strong statistical skills

About CAPR:

The Canadian Alliance of Physiotherapy Regulators is a credentialing and assessment agency that provides evaluation services on behalf of the Canadian provincial and territorial physiotherapy regulators (called Colleges). On behalf of the regulators, we review the education and qualifications of applicants educated outside of Canada to determine whether their education is substantially different from those of Canadian-educated physiotherapists. For both Canadian and internationally educated physiotherapists, we administer the entry to practice licensure examination to determine a candidate's readiness for safe, effective, and independent physiotherapy practice.  For more information, please visit our website at http://www.alliancept.org

Position Summary:

The Psychometric Analyst supports the operational delivery of psychometric activities across CAPR’s assessment programs, including the Physiotherapy Evaluation Tool (for internationally educated physiotherapists) and the Canadian Physiotherapy Examination. Working under the guidance of the Lead Psychometrician, this role contributes to data analysis, scoring, and reporting activities, and contributes to maintaining the integrity and defensibility of assessment outcomes.

Key Responsibilities:

Data Analysis & Monitoring

• Conduct routine analysis of data from CAPR’s examinations and assessments, including item-level and test-level statistics.
• Identify trends, patterns, and anomalies in candidate performance and flag for review.
• Support analyses related to credentialling data for internationally educated physiotherapists.
• Analyze and summarize post-exam candidate and examiner feedback survey results.
• Assist in maintaining and updating standard analysis scripts and processes.

Scoring & Results Processing

• Execute scoring processes for all CAPR assessments.
• Support the application of established scoring, standard setting, and equating methods.
• Perform quality checks to ensure accuracy and completeness of candidate results.
• Participate in verification and validation steps prior to release of results.

Reporting

• Assist in the preparation of post-exam reports for candidates, regulators, and academic stakeholders.
• Contribute to the development of annual academic and technical reports.
• Support the creation and maintenance of dashboards (e.g., visual reporting tools) and data summaries for internal use.
• Translate analytical results into clear, accessible summaries.

 Operational Psychometric Support

• Support test assembly processes, including blueprint adherence and item selection.
• Assist with standard setting and validation activities by preparing data and materials.
• Contribute to item banking processes, including data updates and documentation.
• Prepare materials and analyses for internal and external committees (e.g., Exam Validation Committee).

 Quality Control & Data Integrity

• Perform data validation and quality assurance checks on datasets and outputs.
• Follow established procedures to ensure consistency and accuracy across psychometric processes.
• Document processes and support the maintenance of standard operating procedures.
• Escalate data issues or inconsistencies to the Lead Psychometrician, as appropriate.

 Collaboration & Communication

• Work closely with examination and credentialling teams to support assessment delivery.
• Communicate findings and updates clearly to both technical and non-technical audiences.
• Contribute to a collaborative team environment and support shared timelines and deliverables.

Education, Experience and Skills

• Master’s degree in psychometrics, statistics, quantitative psychology, or a related field (PhD considered an asset).
• 1–3 years of experience in assessment, data analysis, or a related field
• Experience with high-stakes assessment considered an asset.
• Experience with statistical analysis using tools such as R, Python, or SPSS.
• Working knowledge of psychometric methods, statistical procedures, and research design.
• Ability to identify and analyze issues in test development and/or administration and contribute to developing solutions.
• Strong attention to detail and commitment to data accuracy and quality.
• Strong written and verbal communication skills, with the ability to clearly present technical information to diverse audiences.
• Strong interpersonal skills and ability to work collaboratively in a team environment to meet timelines and deliverables.

The Compensation Package Includes:

• $70,000 - $90,000 depending on experience
• Comprehensive health and dental benefits, including vision, life insurance, and critical illness
• Long-term and short-term disability coverage
• Health Care Spending Account
• Employer RRSP matching
• 3 weeks paid vacation

Understanding the importance of equity, diversity, and inclusion, we value the uniqueness each person brings to their work, not only because it is the right thing to do, but also because diversity makes us and our workplace stronger. If you share these values, you will be a great addition to our team.

How To Apply:

To apply, submit your resume and cover letter outlining the qualifications and experience you would bring to this position.

We thank all applicants for their interest in this opportunity; however, only those under consideration will be contacted. No phone calls or employment agencies, please.

CAPR is committed to fair and accessible employment practices, and we are committed to providing accommodation for persons with disabilities. If you require accommodation to apply for this opportunity, require this posting in an additional format, or if contacted for an interview and require accommodation during any stage of the recruitment process, please contact us at the email below. We will work with all applicants to determine appropriate accommodation for individual accessibility needs. 

CAPR may utilize Artificial Intelligence (AI) technology during the hiring process, specifically during the screening and evaluation process. AI technology may be used as a tool to support the hiring process and will not replace the human judgment of the hiring team. We are committed to fair and equitable hiring practices and use AI technology responsibly and ethically.