Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft supplier evaluation rubric — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-002/3
Series
Public comment period
Version
1.0
Published
22 Oct 2023
Last reviewed
22 Oct 2023
Next review
22 Oct 2024
Identifier
10.71829/cei.cp.2
Certainty
Not rated
Cycle
2023 Q3
Window
06 Aug 2023 – 20 Sep 2023
Status
Closed
Submissions
10

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-SUPPLIER-RUB/002Dr Wilhelmina ErlingssonThe same concept is given three different names in one documentAccepted
DRAFT-SUPPLIER-RUB/008Dr Rurik Underhill-OkaforA superseded version should remain reachable from the version that replaced itNoted, no amendment
DRAFT-SUPPLIER-RUB/007Xenia Nyquist-ObioraThe document should state what a reader ought to doNot accepted
DRAFT-SUPPLIER-RUB/001Dr Adaeze Dunmore-EkpoScores are reported to a precision the underlying judgements do not supportAccepted in part
DRAFT-SUPPLIER-RUB/010Nkechi Larsson-EkwuemeA rubric score will be read as a statement about product qualityAccepted
DRAFT-SUPPLIER-RUB/009Vittoria QuintanilhaA dossier rests on a small number of documents and does not say how manyAccepted
DRAFT-SUPPLIER-RUB/003Dr Rosalind Grünbaum-SowandePoint estimates are given without an intervalAccepted in part
DRAFT-SUPPLIER-RUB/004Ignatius ErlingssonQuantitative claims are reproduced without the method that produced themAccepted
DRAFT-SUPPLIER-RUB/005Dr Oisín Marchetti-BasseyThe search date is not on the face of the documentAccepted
DRAFT-SUPPLIER-RUB/006Dr Rurik Haverkamp-Diallo industryThe document should not describe uses outside the approved indicationNot accepted
10 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted5The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part2Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment1The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted2The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. The same concept is given three different names in one document — arising from DRAFT-SUPPLIER-RUB/002. A single term is now used throughout for each defined concept, and the glossary entry is linked at first use within each section rather than once per document.
  2. Scores are reported to a precision the underlying judgements do not support — arising from DRAFT-SUPPLIER-RUB/001. Scores are now reported to the precision the criteria support, the criterion-level judgements are published alongside the total so that the derivation can be checked, and the dossier states that a difference smaller than the reported precision is not a…
  3. A rubric score will be read as a statement about product quality — arising from DRAFT-SUPPLIER-RUB/010. A standing statement that the score assesses evidence and documentation rather than product quality is now printed at the head of every dossier, adjacent to every score wherever it appears, and in the comparison table.
  4. A dossier rests on a small number of documents and does not say how many — arising from DRAFT-SUPPLIER-RUB/009. Every dossier now states the number and type of documents examined, the period they cover and the route by which they were obtained, and a criterion assessed from a single document is marked as such.
  5. Point estimates are given without an interval — arising from DRAFT-SUPPLIER-RUB/003. Every estimate now carries its interval where the source reported one, and where it did not, the estimate is annotated as reported without an interval rather than left to appear as a precise figure.
  6. Quantitative claims are reproduced without the method that produced them — arising from DRAFT-SUPPLIER-RUB/004. Every quantitative claim now carries the determination that produced it at the point of use, and figures obtained by non-comparable methods are no longer presented in the same row or sentence.
  7. The search date is not on the face of the document — arising from DRAFT-SUPPLIER-RUB/005. The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.