National Registry Test Development and Analysis
Solicitation Number:
TBD
Notice Type:
Sources Sought Notice
NAICS Code
611710 - Educational Support Services
Title:
National Registry of Certified Medical Examiners Test Development and Analysis
Set-Aside:
Small Business
Synopsis:
Background
The Federal Motor Carrier Safety Administration's (FMCSA's) National Registry of Certified Medical Examiners (National Registry) was created to ensure that medical examiners can effectively determine if interstate CMV drivers meet FMCSA's physical qualification standards.
FMCSA contractors have provided technical support services in the development and implementation of the National Registry Medical Examiner Certification test since 2005. The development included a Role Delineation Study from which a Detailed Content Outline (DCO) was produced to serve as a blueprint for the development of test forms. Working with panels of ME experts representative of the four professions, Physicians [Medical Doctors (M.D.) and/or Doctors of Osteopathic Medicine (D.O.)], Physician Assistants (PA), Advanced Practice Nurses (APRN), and Chiropractors (D.C.), which constitute the majority of MEs, FMCSA contractors developed and piloted the initial test forms and determined the cut scores for the test forms.
There are multiple current test forms in circulation each containing 100 scored test items and 20 unscored (pre-test) items for the purpose of vetting test items. FMCSA contractors analyzed test results from these test forms annually, and revised, accepted, or discarded unscored test items, based on psychometric analysis of test results from a large number of ME candidates and review by the test panel. The contractors and test panel also reviewed scored test items and changed them for use in new test forms.
Scope of Work
The Contractor shall provide technical services for FMCSA's, Medical Programs Division to support the National Registry Medical Examiner Certification Test implementation with test development, analysis, reporting, and consultation. Specific tasks include the following:
•· The Contractor shall update the DCO in accordance with changes in the Federal Motor Carrier Safety Regulations (FMCSRs) pertaining to physical qualifications and driver examinations (49 CFR 391.41 - 391.69 and related regulations) and current clinical best practices since the first DCO was written in 2008. The Contractor shall eliminate or modify any parts of the DCO that are not within the scope of the FMCSRs.
•· The Contractor shall update and enhance a test item bank and test forms in accordance with current psychometric methodology customized for certified healthcare professionals, provide analysis of test results by profession, and consult with FMCSA and provide input to improvements that could be made to ensure a sound and fair examination process.
•· The Contractor shall recruit members of a Medical Examiner Development Test Panel (MEDTP). The Contractor shall hold three or more item-writing sessions with the MEDTP and designated FMCSA Medical Programs staff the first contract year and four or more item-writing sessions with the MEDTP and designated FMCSA Medical Programs staff annually during the second through fifth contract years.
•· Working with the MEDTP, the Contractor shall maintain a test item bank by adding, revising, and deleting test items as needed. In accordance with current psychometric methodology customized for certified healthcare professionals, the Contractor shall provide two or more test forms, each with a Part A and a Part B, having different pre-test items but the same scored test items. The Contractor shall provide test delivery instructions, and cut scores for each test form. The Contractor shall hold one key verification meeting annually with at least one MEDTP member and designated FMCSA Medical Programs staff to review and modify the draft test forms.
•· The Contractor shall provide administrative/facilitation support for the operation of the MEDTP meetings. Examples of tasks related to administrative/facilitation support are scheduling meetings, managing meeting logistics, providing instructional materials, and facilitating the meeting. The Key Personnel Psychometrician/Scientific Consultant will train MEDTP members and provide guidance in current psychometric methodology.
•· The Contractor shall deliver all test forms in XML format, and cut scores and test delivery instructions in PDF format. The Contractor shall be responsible for having the data storage and analysis tools necessary to accept and evaluate test results. The test results can be up to 50,000 records in a single transfer to the Contractor.
•· The Contractor shall prepare an annual statistical report on test performance aggregated by professional type (Physicians, Physician Assistants, Advanced Practice Nurses, and Chiropractors). This report will include the analysis of question performance and types of items that various healthcare professionals (Physicians, Physician Assistants, Advanced Practice Nurses, and Chiropractors) answered correctly and incorrectly. This report will include the analysis of test results to show areas of weakness in ME candidate training, overall and by healthcare profession.
Instructions:
Interested parties are invited to submit a technical capability statement which clearly demonstrates their ability to meet the governments requirement as summarized above. Contractors should include GSA Schedule, Special Identification Number (SIN), and Contract Number, if applicable. There is a 10-page limit. Responses must be submitted via email to Steve.Fuller@dot.gov. Reference in the subject line of the email: National Registry Test Development and Analysis. Responses must be received by 12:00 p.m. ET on April 2, 2019.
**Please see Draft Statement of Work**
Steve L. Fuller, Contract Specialist, Phone 2024930176, Email steve.fuller@dot.gov - Rick Murray, Contracting Officer, Phone (202) 366-4250, Fax 2023852333, Email rick.murray@dot.gov
