Why does it take so long to get my results?
How is the exam validated?
How on earth do you come up with the passing score?
Do you grade on a curve?

BPS can assure candidates that the examination scoring process is meticulous, fair, and confidential. The Board, in conjunction with its professional testing consultant, has developed the following information to help in understanding its evaluation system.

The “Passing Point” Committee

As with most licensure and certification examinations, a criterion-referenced standard is used to set the passing points for BPS specialty certification.

Rather than evaluating examinees on a bell-shaped curve, a criterion-referenced standard defines the point at which a candidate has demonstrated just enough familiarity with the material to be considered proficient. A level of expertise is established rather than a percentage of successful candidates. Since licensure and certification exams are designed to establish proficiency, this alternative method is most appropriate. If all candidates are qualified, then all should receive a passing score. Likewise, if few are qualified, then few should be credentialed.

A committee of subject matter experts (practitioners and educators with considerable content expertise) has been established to determine the passing point. Questions are rated in terms of basic qualifications, level of difficulty, and eligibility requirements. Once the rating of all examination items is complete, the minimum passing point is statistically computed.

Examination Scoring Process

1. After the exam is administered, answer sheets are immediately sent to the BPS testing consultant for optical scanning and computer scoring. To ensure an accurate mechanical process, selected answer sheets are visually inspected to compare recorded answers with machine results.
   
2. Results are statistically analyzed to pick up any unusual patterns (e.g., items that were not answered as expected; items consistently selected as incorrect by better-performing candidates; or items whose validity was questioned by applicants). As a result of this review, the scoring key is adjusted and all answer sheets rescored.

Score Reporting

Application to take the certification examination constitutes written authorization for the testing agency to release that candidate’s score to BPS and to the examinee ONLY. Once the scoring is complete, statistical information on candidate performance is provided to Specialty Council members for review and confirmation. No names or identifying codes are available so that complete anonymity is maintained.

Confidential score reports are sent to candidates by first-class mail within approximately 60 days of the exam. Score reports contain:

• passing score
• candidate’s score
• maximum score
• average score
• standard deviation and range of scores.

This information is provided for the entire test as well as for each domain.

Requests for hand scoring must be submitted to BPS, in writing, within 90 days of receipt of the score report. A $50 fee is assessed for this added service.

In early January, rosters of newly-certified pharmacy specialists are posted on the BPS web site, and a news release is sent to over 500 pharmacy leaders, journals and media contacts to report the outcomes of the exam.

Computerized Testing

BPS has evaluated the pros and cons of converting from paper and pencil exams to computerized testing. Some current issues include psychometric validity; the relative cost of on-line time; test security and the confidentiality of candidates’ scores. To date, the Board has chosen not to move to a computer-based format but continues to monitor developments with this evolving technology.