Draft monograph: CJC-1295 — submissions
The 13 submissions received, published in full with declared interests and secretariat responses.
§2Submissions and responses
13 submissions were received. Each is published in full below with its declared interest, the secretariat response and the disposition. The Institute publishes submissions it did not accept in the same form as those it did.
Effect estimates are given without naming the comparator
Several estimates in the draft state an effect without stating what it was measured against. An estimate against placebo and an estimate against an active comparator are not the same quantity and the draft presents them in one column.
The respondent proposes that the comparator be part of every outcome row rather than a footnote, and that estimates against different comparators never share a column.
The secretariat accepts this submission. A footnoted comparator is a comparator a reader will not carry into the next row.
The comparator is now stated in every outcome row, and estimates against different comparators are reported in separate tables with the comparator named in the table caption.
The population to which the headline estimate applies is not stated with the estimate
The draft carries a headline effect estimate in the abstract without the eligibility criteria of the trials that produced it. The respondent states that the estimate applies to a trial population with specific age, comorbidity and baseline criteria, and that a reader will apply it to whoever is in front of them.
The respondent proposes a one-line population statement adjacent to every headline estimate.
The secretariat accepts this submission. An estimate detached from its population is an estimate of nothing in particular.
Every headline estimate now carries a one-line statement of the population in which it was observed, and the full eligibility criteria are reported in the included-studies table rather than only in the source.
Regulatory status is stated without naming the jurisdiction
The draft states that the compound is approved, or not approved, without saying by whom. The respondent, employed by a health-technology assessment body, states that approval status differs between jurisdictions for several compounds in the series and that an unqualified statement will be wrong somewhere.
The respondent proposes that every status statement name the authority and carry the date on which the status was checked.
The secretariat accepts this submission. An unattributed status statement is a claim the Institute cannot support.
Every regulatory status statement now names the authority, states the date on which the status was verified, and is recorded per jurisdiction rather than as a single global assertion.
Trials are described as terminated where they completed as planned
The respondent states that the draft uses the word terminated for trials stopped at pre-specified interim analyses, for trials stopped for futility and for trials closed for commercial reasons, and that these are three different facts.
The respondent proposes that the status vocabulary be fixed and defined in the glossary.
The secretariat accepts this submission in part. The vocabulary is fixed and defined. The proposal to distinguish commercial closure from futility in every case is accepted only where the Institute holds a document stating the reason.
Trial status now uses a fixed vocabulary defined in the glossary, and where the reason for stopping is not evidenced by a document the Institute holds, the status is recorded as stopped with the reason not established rather than assigned.
The monograph should not describe how the compound is supplied outside a regulated route
The respondent states that describing presentations observed in unregulated supply risks being read as a guide to obtaining them, and asks that the material be removed.
The respondent accepts that the information is accurate and objects to its presence rather than to its content.
The secretariat notes this submission and records the concern as a real one that the draft had already considered.
No amendment arises. The monograph describes what is supplied and names no supplier, price or route of acquisition, and it carries the standing statement that the Institute assesses evidence and does not recommend use. Describing a presentation a reader may already hold is the condition of being useful to that reader.
What happens when the compound is stopped is not addressed
The draft assesses the effect of the compound while it is being taken. The respondent, who declares having used a compound in the class under prescription, states that the question a person actually faces is what happens afterwards, and that the monograph is silent on it.
The respondent proposes that the trajectory after discontinuation be an assessed outcome wherever any contributing trial measured it, and a recorded evidence gap wherever none did.
The secretariat accepts this submission. The omission was one of framing rather than of evidence, and the framing followed the trials rather than the decision.
Discontinuation trajectory is now an assessed outcome in every monograph where a contributing trial measured it, and a recorded evidence gap in every monograph where none did, so that its absence is visible rather than silent.
The compound is supplied under names the monograph does not list
The respondent states that the compound is supplied under several trade names, research codes and transliterations, and that a reader holding a label bearing one of them will not find the monograph.
A list of names observed in supply, with the source of each observation, accompanied the submission.
The secretariat accepts this submission. A monograph a reader cannot find is not serving the reader.
The synonym list is extended to include every name the Institute can evidence from a document it holds, each recorded with its source. Names asserted without a supporting document are not added, and the distinction is stated at the head of the list.
Quantitative claims are reproduced without the method that produced them
Several figures in the draft are quoted from sources that determined them by different methods. A figure obtained by one determination and a figure obtained by another are not comparable, and the draft places them in the same sentence without distinguishing them.
The respondent, an analytical chemist, proposes that every quantitative claim carry the method that produced it at the point of use rather than in the reference.
The secretariat accepts this submission. Placing two figures side by side is an implicit claim that they are the same kind of quantity, and in the cases identified they were not.
Every quantitative claim now carries the determination that produced it at the point of use, and figures obtained by non-comparable methods are no longer presented in the same row or sentence.
The recorded evidence gaps omit outcomes a reader would consider material
The evidence-gap section records what has not been studied. The respondent, a practising clinician, states that the list is drawn from the outcomes the trials chose to measure and therefore reproduces the sponsor's outcome selection rather than correcting for it.
The respondent proposes that the gap list be constructed from the outcomes a prescribing decision turns on, and that outcomes measured by no trial appear in it as such.
The secretariat accepts this submission in part. The gap list is reconstructed from the decision-relevant outcome set rather than from the measured set. The proposal that every unmeasured outcome be listed is declined, because an unbounded list of things not studied is not a finding.
The evidence-gap section is now derived from the anchor and decision-relevant outcomes for the indication, and any such outcome measured by no contributing trial is recorded as not measured rather than omitted.
Storage and reconstitution guidance is given without stating what it rests on
The draft states storage conditions and a period of use after reconstitution. The respondent asks what evidence supports the period, and states that in the absence of a stability study on this presentation the figure is a convention rather than a finding.
The respondent proposes that any in-use period be accompanied by the stability evidence that produced it, or removed.
The secretariat accepts this submission in part. The period is retained where a stability study on a comparable presentation exists and is cited. Where no such study exists the figure is removed rather than annotated, because an annotated figure is still a figure a reader will use.
In-use periods now appear only where supported by a cited stability determination on a stated presentation, and elsewhere the monograph records that no in-use stability evidence was identified for this presentation.
The monograph does not tell a reader that a stated mass may be substantially counter-ion and water
The draft quotes vial contents in milligrams without stating whether the figure refers to peptide content or to total solids. For an acetate or trifluoroacetate salt of a peptide, the difference between the two can exceed a fifth of the stated mass.
The respondent, an analytical chemist, states that this is the single most consequential misreading in the field and that a monograph that does not address it directly is leaving the reader to discover it.
The secretariat accepts this submission. Moderate certainty evidence from published analytical surveys suggests that content and total solids are routinely conflated in supply documentation, and the draft did not warn the reader.
The monograph now states, at the point where vial contents are first mentioned, that a mass figure is uninterpretable unless it states whether it is peptide content or total solids, and cross-references the content standard in the analytical series.
References should carry a persistent identifier for every cited source
Several references in the draft carry a journal, a year and a volume but no persistent identifier. The respondent, who works in a library setting, states that retrieval of such a reference is materially slower and that identifiers should be supplied throughout.
The respondent asks in the alternative that where an identifier exists but is not carried, the omission be explained rather than left as a gap the reader must interpret.
The secretariat accepts the second limb of this submission and declines the first. Identifiers are supplied wherever the Institute holds one. Where the Institute does not hold an identifier it will not supply one, because a reconstructed identifier that resolves to the wrong record is a worse defect than an absent one.
Every reference without a persistent identifier now carries an explicit statement that the identifier is not held by the Institute, so that its absence is a recorded fact rather than an apparent oversight.
Every contributing trial shares one sponsor and the monograph does not say so
The respondent, who has published a systematic review of this literature, states that all of the contributing trials for the principal outcome were conducted by a single sponsor, and that this is a property of the evidence base rather than a criticism of any individual trial.
The respondent proposes that sponsor concentration be recorded as a characteristic of the evidence base in the certainty assessment rather than as a note in the discussion.
The secretariat accepts this submission. Sponsor concentration bears on what an independent replication would add, and the draft recorded it where a reader was least likely to see it.
Sponsor concentration is now stated with the certainty rating, and the monograph records how many independent sponsors contributed evidence to each assessed outcome.
References cited on this page
References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.
- International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute
Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.