Draft monograph: amycretin — submissions
The 16 submissions received, published in full with declared interests and secretariat responses.
§2Submissions and responses
16 submissions were received. Each is published in full below with its declared interest, the secretariat response and the disposition. The Institute publishes submissions it did not accept in the same form as those it did.
Point estimates are given without an interval
Several estimates in the draft appear as single figures. The respondent states that a point estimate without an interval invites a precision the underlying data do not support, and that the effect is worst where the estimate is drawn from a small contributing set.
The respondent proposes that no point estimate appear anywhere in the document set without its interval, including in summary tables and in the abstract.
The secretariat accepts this submission in part. Intervals are added wherever the source reports one. The proposal is declined for figures the source published without an interval, because the Institute will not compute an interval a source did not report.
Every estimate now carries its interval where the source reported one, and where it did not, the estimate is annotated as reported without an interval rather than left to appear as a precise figure.
The preclinical section is extensive and the clinical section is not
The draft summarises a large animal literature and a small or absent human literature. The respondent states that the resulting document reads as though a great deal is known, when what is known concerns rodents.
The respondent proposes that the preclinical section be reduced to a statement of what has been observed in animals and that the detail be removed entirely.
The secretariat accepts this submission in part. The section is shortened and given a standing statement. The proposal to remove the detail is declined, because a reader encountering claims derived from that literature needs to be able to see what it actually contains.
The preclinical section is reduced in length, placed after the clinical assessment rather than before it, and opens with a standing statement that an effect observed in an animal model is not a clinical outcome and does not support a certainty rating.
The compound is supplied under names the monograph does not list
The respondent states that the compound is supplied under several trade names, research codes and transliterations, and that a reader holding a label bearing one of them will not find the monograph.
A list of names observed in supply, with the source of each observation, accompanied the submission.
The secretariat accepts this submission. A monograph a reader cannot find is not serving the reader.
The synonym list is extended to include every name the Institute can evidence from a document it holds, each recorded with its source. Names asserted without a supporting document are not added, and the distinction is stated at the head of the list.
The monograph should not describe how the compound is supplied outside a regulated route
The respondent states that describing presentations observed in unregulated supply risks being read as a guide to obtaining them, and asks that the material be removed.
The respondent accepts that the information is accurate and objects to its presence rather than to its content.
The secretariat notes this submission and records the concern as a real one that the draft had already considered.
No amendment arises. The monograph describes what is supplied and names no supplier, price or route of acquisition, and it carries the standing statement that the Institute assesses evidence and does not recommend use. Describing a presentation a reader may already hold is the condition of being useful to that reader.
The monograph should reproduce the approved labelling rather than paraphrase it
The submission is made on behalf of the marketing-authorisation holder. It states that the draft paraphrases the approved indication, the posology and the contraindications, and that any paraphrase risks diverging from the authorised text.
The sponsor asks that the authorised wording be reproduced verbatim in each case, and offers the current summary of product characteristics as the source.
The secretariat accepts this submission in part. The authorised indication and the contraindications are reproduced verbatim and attributed. The posology is not, because the monograph reports what the trials administered as well as what the labelling authorises, and the two are frequently different.
The approved indication and contraindications are now reproduced verbatim from the named authorisation with its version and date, and the posology section reports the labelled schedule and the schedules studied side by side, with the source of each stated.
The monograph does not tell a reader that a stated mass may be substantially counter-ion and water
The draft quotes vial contents in milligrams without stating whether the figure refers to peptide content or to total solids. For an acetate or trifluoroacetate salt of a peptide, the difference between the two can exceed a fifth of the stated mass.
The respondent, an analytical chemist, states that this is the single most consequential misreading in the field and that a monograph that does not address it directly is leaving the reader to discover it.
The secretariat accepts this submission. Moderate certainty evidence from published analytical surveys suggests that content and total solids are routinely conflated in supply documentation, and the draft did not warn the reader.
The monograph now states, at the point where vial contents are first mentioned, that a mass figure is uninterpretable unless it states whether it is peptide content or total solids, and cross-references the content standard in the analytical series.
Guidance on lyophilised storage is missing
The respondent asks that the monograph state storage conditions for lyophilised material as well as for reconstituted solution, since the two differ and the former governs the longer part of the shelf life.
The respondent states that the omission is the more consequential because lyophilised material is what is generally received.
The secretariat notes this submission. The draft addresses lyophilised storage, in the presentation section rather than in the section on in-use handling, which is where the respondent looked.
No amendment to content arises. The two storage statements have been brought together under a single heading so that a reader looking for either finds both.
The search date is not on the face of the document
The draft carries a publication date and a review date but not the date on which the evidence was last searched. Those are three different dates and only the third tells a reader how current the assessment is. A document published in one quarter may rest on a search run two quarters earlier, and nothing on the page allows that gap to be measured.
The respondent proposes that the search date be printed adjacent to every certainty rating rather than in the methods section, on the ground that a reader who acts on a rating is unlikely to have read the methods section first.
The secretariat accepts this submission. The distinction between publication, review and search dates is real and the draft did not make it visible where it mattered.
The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.
Quantitative claims are reproduced without the method that produced them
Several figures in the draft are quoted from sources that determined them by different methods. A figure obtained by one determination and a figure obtained by another are not comparable, and the draft places them in the same sentence without distinguishing them.
The respondent, an analytical chemist, proposes that every quantitative claim carry the method that produced it at the point of use rather than in the reference.
The secretariat accepts this submission. Placing two figures side by side is an implicit claim that they are the same kind of quantity, and in the cases identified they were not.
Every quantitative claim now carries the determination that produced it at the point of use, and figures obtained by non-comparable methods are no longer presented in the same row or sentence.
A superseded version should remain reachable from the version that replaced it
The respondent states that the draft supersedes an earlier document and that a reader who cited the earlier version has no way to reach it from the new one, which makes it impossible to see what changed.
The respondent asks that every version carry a link both to what it supersedes and to what supersedes it.
The secretariat notes this submission. The corrections and versioning policy already requires bidirectional version links and every superseded document is retained at its own address.
No amendment arises. The requirement is stated in the corrections and versioning policy and the amendment log of this document links to the version it replaced. The respondent is correct that the link was absent from the draft page furnished for consultation, which was a defect of the consultation copy and not of the policy.
Evidence for one member of the class is presented as evidence for this compound
The draft supports a statement about this compound with a citation to a trial of a different compound in the same class. The respondent states that a class-level inference is a judgement that should be labelled as one rather than presented as direct evidence.
The respondent proposes that any class-level extrapolation be flagged at the point of use and excluded from the certainty rating for the compound itself.
The secretariat accepts this submission. Moderate certainty evidence supports several class-level statements in this area, but a class-level statement is not evidence about a particular member of the class.
Class-level inferences are now labelled at the point of use, are excluded from the certainty rating for the compound, and are reported in a separate subsection stating which compound the underlying evidence concerns.
Doses are expressed in units that differ between sections
The draft expresses dose in milligrams in one section and in micrograms per kilogram in another, drawn from different sources without conversion. The respondent, a hospital pharmacist, states that this is the shape of error that reaches a patient.
The respondent proposes a single unit throughout, with the source unit retained in parentheses where a conversion was performed.
The secretariat accepts this submission. The inconsistency was inherited from the sources and should have been resolved in drafting.
A single dose unit is now used throughout each monograph, with the source unit retained in parentheses wherever a conversion was applied, and every conversion is stated rather than performed silently.
Regulatory status is stated without naming the jurisdiction
The draft states that the compound is approved, or not approved, without saying by whom. The respondent, employed by a health-technology assessment body, states that approval status differs between jurisdictions for several compounds in the series and that an unqualified statement will be wrong somewhere.
The respondent proposes that every status statement name the authority and carry the date on which the status was checked.
The secretariat accepts this submission. An unattributed status statement is a claim the Institute cannot support.
Every regulatory status statement now names the authority, states the date on which the status was verified, and is recorded per jurisdiction rather than as a single global assertion.
The certainty rating for the principal assessed outcome cannot be traced to the contributing trials
The draft states a certainty rating for the principal assessed outcome and lists the contributing trials, but does not state which domain drove the downgrade. A reader who disagrees with the rating cannot tell whether the disagreement concerns risk of bias, imprecision, indirectness or inconsistency.
The respondent proposes that each rating carry its downgrade reasons explicitly, in the same row as the rating, so that a reader can accept the evidence assessment while disputing a single domain judgement.
The secretariat accepts this submission. A rating without its reasoning is an assertion, and the draft asserted rather than showed.
Each assessed outcome now carries its downgrade domains in the summary-of-findings row, with a short statement of the judgement made in each, so that the rating can be checked domain by domain against the contributing trials.
Anti-drug antibody data are omitted
The respondent states that immunogenicity is measured in the development programmes of peptide therapeutics and that the monograph does not report it, leaving a reader unable to judge whether loss of effect over time has an immunological explanation.
The respondent proposes that anti-drug antibody incidence and its relation to effect be reported for every compound in the series.
The secretariat accepts this submission in part. Immunogenicity is reported where a contributing trial reported it. The proposal to report it for every compound is declined because for many compounds in the series no such data exist and a uniformly empty row is not informative.
Anti-drug antibody incidence and any reported association with loss of effect are now reported where measured, and recorded as not measured where the contributing trials did not assess them.
The document set should be published in translation
The respondent notes that the assessments concern compounds supplied internationally and that publishing only in English restricts access to the assessment to readers who work in it.
The respondent proposes machine translation of the document set as an interim measure, with human review of the certainty language.
The secretariat does not accept this submission, and records that the underlying point is sound and that the proposed remedy is the difficulty.
A translation whose certainty language has drifted is a different assessment carrying the Institute's name, and the Institute cannot review translations it does not have the capacity to review. The documents remain in English. The submission is published in full because the access problem it identifies is real and unresolved.
References cited on this page
References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.
- International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute
Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.